00000100:00080000:0.0:1746143099.572403:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143099.580079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.580100:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.583620:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.583654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.583698:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.586116:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.586610:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5528 00000100:00100000:0.0:1746143099.586617:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962857930880:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143099.586623:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143099.586626:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3c00/0x25aee876ca7090ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d684 expref: 19 pid: 14794 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143099.586742:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3c00/0x25aee876ca7090ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d684 expref: 19 pid: 14794 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143099.586753:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3c00/0x25aee876ca7090ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d684 expref: 19 pid: 14794 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143099.586767:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800945b2f00) 00010000:00010000:0.0:1746143099.586770:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c045600/0x25aee876ca7091b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143099.586775:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c045600/0x25aee876ca7091b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143099.586779:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143099.586810:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962857930880:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 194us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143099.586815:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5528 00000100:00100000:0.0:1746143099.595702:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962857930496:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11784us (12078us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143099.595713:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5088 00002000:00100000:0.0:1746143099.595723:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8801391da300 x1830962857930496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:250/0 lens 488/440 e 0 to 0 dl 1746143110 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143099.595733:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391da300 with x1830962857930496 ext(1048576->2097151) 00002000:00010000:0.0:1746143099.595738:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391da300 00000100:00100000:0.0:1746143099.596611:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857931008 00000100:00100000:0.0:1746143099.596618:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857931008 00000100:00100000:0.0:1746143099.596658:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7832 00000100:00100000:0.0:1746143099.596665:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30057:x1830962857931008:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143099.596682:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143099.596697:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ac00/0x25aee876ca7091d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164d74f expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.596767:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ae00/0x25aee876ca7091df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143099.596780:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c045600/0x25aee876ca7091b5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d733 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.596786:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ae00/0x25aee876ca7091df lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143099.596824:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c045600/0x25aee876ca7091b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d733 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.596835:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c045600/0x25aee876ca7091b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d733 expref: 11 pid: 14794 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143099.596859:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801391d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962860969856:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143099.603994:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143099.605155:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ae00/0x25aee876ca7091df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143099.605161:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ae00/0x25aee876ca7091df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143099.605197:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9132864 00000004:00200000:0.0:1746143099.605201:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143099.605217:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ae00/0x25aee876ca7091df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143099.605259:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ac00/0x25aee876ca7091d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d74f expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.605275:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ae00/0x25aee876ca7091df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d74f expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.605281:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800945b2f00) 00010000:00010000:0.0:1746143099.605283:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143099.605286:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2ae00, rc 0) 00000100:00100000:0.0:1746143099.605309:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30057:x1830962857931008:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 8646us (9091us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143099.605315:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7832 00000100:00100000:0.0:1746143099.620632:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.628953:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.628993:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.629029:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.629063:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.633029:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.633092:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.633129:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.639627:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962860970880:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143099.639635:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962860971008:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143099.639641:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962860971136:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143099.639656:0:10061:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143099.653701:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.677703:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857934976 00000100:00100000:0.0:1746143099.677712:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857934976 00010000:00010000:0.0:1746143099.677744:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70913e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d6d8 expref: 27 pid: 26949 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143099.677771:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5546 00000100:00100000:0.0:1746143099.677779:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962857934976:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143099.677791:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143099.677818:0:7113:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143097 -> 1746143098 00002000:00010000:0.0:1746143099.677821:0:7113:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143097 -> 1746143098 00010000:00010000:0.0:1746143099.677825:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70913e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d6d8 expref: 27 pid: 26949 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143099.677834:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70913e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2129919) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d6d8 expref: 27 pid: 26949 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143099.677862:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70913e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2129919) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d6d8 expref: 27 pid: 26949 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143099.677885:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143099.677887:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143099.677891:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.677900:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.677921:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143099.677935:0:10061:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.677942:0:10061:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.677957:0:10061:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.677964:0:10061:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.677970:0:10061:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.677985:0:10061:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1537400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143099.677989:0:10061:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.677996:0:10061:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.678006:0:10061:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.678011:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1537400/0x25aee876ca70921e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143099.679129:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962857932544:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 46600us (50096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143099.679137:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10645 00000100:00100000:0.0:1746143099.679586:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962857934976:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1806us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143099.679594:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5546 00000100:00100000:0.0:1746143099.686238:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.689742:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.699730:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.729614:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.733551:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.740119:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.741975:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.744734:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.755701:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.771129:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.795651:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.795705:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.804067:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857937536 00000100:00100000:0.0:1746143099.804076:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857937536 00000100:00100000:0.0:1746143099.804126:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7836 00000100:00100000:0.0:1746143099.804133:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:30064:x1830962857937536:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143099.804151:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143099.804168:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009533d200/0x25aee876ca70925d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164d787 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.804251:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009533ce00/0x25aee876ca709264 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143099.804265:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009533ce00/0x25aee876ca709264 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143099.804275:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009533ce00/0x25aee876ca709264 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:0.0:1746143099.804284:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9132864 00010000:00010000:0.0:1746143099.804372:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009533d200/0x25aee876ca70925d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d787 expref: 212 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.804588:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009533ce00/0x25aee876ca709264 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d787 expref: 211 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.804606:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800945b2f00) 00010000:00010000:0.0:1746143099.804609:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143099.804613:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009533ce00, rc 0) 00000100:00100000:0.0:1746143099.804648:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:30064:x1830962857937536:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 515us (1374us total) trans 8589942008 rc 0/0 00000100:00100000:0.0:1746143099.804654:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7836 00000100:00100000:0.0:1746143099.822397:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.827210:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.833989:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.834070:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.836283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.836871:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.838888:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.839385:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.840578:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.840592:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.840605:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857939328 00000100:00100000:0.0:1746143099.840608:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857939328 00000100:00100000:0.0:1746143099.840622:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857939456 00000100:00100000:0.0:1746143099.840623:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857939456 00000100:00100000:0.0:1746143099.840634:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10657 00000100:00100000:0.0:1746143099.840638:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962857939200:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143099.840644:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143099.840653:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009533c000/0x25aee876ca70929c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164d7b8 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143099.840700:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962860972928:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143099.840739:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143099.840761:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.840811:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.840826:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857939584 00000100:00100000:0.0:1746143099.840829:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857939584 00000100:00100000:0.0:1746143099.840844:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10660 00000100:00100000:0.0:1746143099.840848:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962857939584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143099.840854:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143099.840860:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bdc600/0x25aee876ca7092b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164d7cd expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143099.840869:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143099.840876:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bdc600/0x25aee876ca7092b1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7cd expref: 14 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143099.840884:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bdc600/0x25aee876ca7092b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7cd expref: 14 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143099.840896:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bdc600, rc 0) 00000100:00100000:0.0:1746143099.840907:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962857939584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 59us (145us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143099.840911:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10660 00000100:00100000:0.0:1746143099.841614:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.848672:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.853448:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.862622:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.872171:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.882586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.887289:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.890690:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.896201:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.900076:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.918326:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.922067:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.922102:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.922130:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.958508:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.968851:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.970584:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.970625:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143099.970649:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857943296 00000100:00100000:0.0:1746143099.970654:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857943296 00002000:00100000:0.0:1746143099.970670:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800919de300 x1830962857943296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:250/0 lens 488/0 e 0 to 0 dl 1746143110 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143099.970678:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919de300 with x1830962857943296 ext(3145728->4194303) 00002000:00010000:0.0:1746143099.970680:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919de300 00000100:00100000:0.0:1746143099.970689:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857943552 00000100:00100000:0.0:1746143099.970690:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857943552 00002000:00100000:0.0:1746143099.970698:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800919dea00 x1830962857943552/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:250/0 lens 488/0 e 0 to 0 dl 1746143110 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143099.970704:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dea00 with x1830962857943552 ext(2097152->3145727) 00002000:00010000:0.0:1746143099.970714:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dea00 00000100:00100000:0.0:1746143099.970971:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5099 00000100:00100000:0.0:1746143099.970976:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962857943296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143099.976284:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.003344:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962857943680:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25071us (27063us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143100.003353:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5101 00002000:00100000:0.0:1746143100.003359:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800919dce00 x1830962857943680/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:250/0 lens 488/440 e 0 to 0 dl 1746143110 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143100.003367:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dce00 with x1830962857943680 ext(3145728->4194303) 00002000:00010000:0.0:1746143100.003372:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dce00 00000100:00100000:0.0:1746143100.010183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.191306:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.197802:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.197835:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.197876:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143100.203664:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143100.203670:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143100.216455:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.216509:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.219323:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5555 00000100:00100000:0.0:1746143100.219331:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962857945344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143100.219339:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143100.219547:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd18a00/0x25aee876ca7092b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7d4 expref: 25 pid: 8169 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143100.219565:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd18a00/0x25aee876ca7092b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7d4 expref: 25 pid: 8169 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143100.219577:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18a00/0x25aee876ca7092b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7d4 expref: 25 pid: 8169 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143100.219598:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.219600:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.219605:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5350a00/0x25aee876ca7092db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->3866623) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7f7 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.219612:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5350a00/0x25aee876ca7092db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->3866623) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7f7 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.219638:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5350a00/0x25aee876ca7092db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7f7 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.219649:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962860973952:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143100.220929:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143100.232933:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.246358:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.253737:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.280795:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.290438:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.310248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.312241:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.312315:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.318286:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.331576:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.334129:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.341112:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.346958:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.357187:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.357669:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.358944:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.358958:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857948800 00000100:00100000:0.0:1746143100.358961:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857948800 00002000:00100000:0.0:1746143100.359439:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ae2e680 x1830962857948800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:251/0 lens 488/0 e 0 to 0 dl 1746143111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143100.359448:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2e680 with x1830962857948800 ext(3145728->4194303) 00002000:00010000:0.0:1746143100.359452:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae2e680 00000100:00100000:0.0:1746143100.359469:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857949056 00000100:00100000:0.0:1746143100.359472:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857949056 00002000:00100000:0.0:1746143100.359487:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094510000 x1830962857949056/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:251/0 lens 488/0 e 0 to 0 dl 1746143111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143100.359494:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510000 with x1830962857949056 ext(3145728->4194303) 00002000:00010000:0.0:1746143100.359498:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094510000 00000100:00100000:0.0:1746143100.359508:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5113 00000100:00100000:0.0:1746143100.359513:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962857948800:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143100.366939:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.367009:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143100.368586:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009533d200/0x25aee876ca7092aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7c6 expref: 15 pid: 8169 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746143100.369667:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962860974848:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143100.369693:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a24000/0x25aee876ca7092f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d813 expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.369704:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a24000, rc 0) 00000100:00100000:0.0:1746143100.370835:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30074:x1830962857948672:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11763us (13163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143100.370843:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10670 00000100:00100000:0.0:1746143100.373194:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.375559:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.389694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.389760:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.401151:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.401258:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.401717:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10676 00000100:00100000:0.0:1746143100.401735:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962857950336:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143100.401754:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143100.401771:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c5a000/0x25aee876ca709321 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164d83d expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.402082:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962860975872:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143100.402138:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143100.417757:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.422364:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.422409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143100.422676:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143100.426734:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.427093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.427565:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5562 00000100:00100000:0.0:1746143100.427578:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:1968:x1830962857951232:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143100.427595:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143100.427605:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009533ce00/0x25aee876ca709264 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d787 expref: 212 pid: 17079 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.427864:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009533ce00/0x25aee876ca709264 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d787 expref: 212 pid: 17079 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.427884:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009533ce00/0x25aee876ca709264 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d787 expref: 212 pid: 17079 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.427903:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800945b2f00) 00010000:00010000:0.0:1746143100.427908:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009358c000/0x25aee876ca70933d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143100.427916:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009358c000/0x25aee876ca70933d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143100.427922:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009358c000/0x25aee876ca70933d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143100.427949:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143100.427981:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:1968:x1830962857951232:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 407us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143100.427987:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5562 00000100:00100000:0.0:1746143100.432833:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.433084:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.433155:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.434295:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.434323:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.434360:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.435635:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962860976256:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143100.435741:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135c9a600/0x25aee876ca709352 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d859 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143100.435752:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135c9a600/0x25aee876ca709352 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d859 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143100.435761:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c9a600, rc 0) 00000100:00100000:0.0:1746143100.436049:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962857951616:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 2592us (2893us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143100.436054:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10679 00010000:00010000:0.0:1746143100.445173:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143100.447245:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.453248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.460692:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.467871:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.477437:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.477480:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.487340:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.491413:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.491825:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.493722:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.494614:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.495143:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.495174:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.495747:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10689 00000100:00100000:0.0:1746143100.495755:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962857953536:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143100.495806:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.495820:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a25200/0x25aee876ca7092e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d805 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.495825:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143100.495826:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143100.495828:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.495845:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a25200/0x25aee876ca7092e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d805 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.495856:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a25200/0x25aee876ca7092e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d805 expref: 30 pid: 8450 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746143100.495868:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962860977920:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143100.497146:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143100.507729:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.507761:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.507812:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.507825:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.507864:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.507903:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.507927:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857954432 00000100:00100000:0.0:1746143100.507931:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857954432 00010000:00010000:0.0:1746143100.507947:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca709295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7b1 expref: 14 pid: 8169 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746143100.507959:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857954304 00000100:00100000:0.0:1746143100.507960:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857954304 00010000:00010000:0.0:1746143100.507968:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009409aa00/0x25aee876ca70934b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d852 expref: 13 pid: 8449 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746143100.507976:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857954688 00000100:00100000:0.0:1746143100.507977:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857954688 00010000:00010000:0.0:1746143100.507985:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5504600/0x25aee876ca7092c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7e2 expref: 25 pid: 754 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746143100.507993:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5566 00000100:00100000:0.0:1746143100.507997:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962857954432:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143100.508003:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143100.508020:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca709295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7b1 expref: 14 pid: 8169 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143100.508029:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca709295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7b1 expref: 14 pid: 8169 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143100.508137:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca709295 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7b1 expref: 14 pid: 8169 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143100.508148:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143100.508162:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962857954432:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 164us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143100.508168:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5566 00000100:00100000:0.0:1746143100.508177:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5569 00000100:00100000:0.0:1746143100.508182:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1970:x1830962857954688:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143100.508187:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143100.508193:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5504600/0x25aee876ca7092c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7e2 expref: 25 pid: 754 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.508200:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5504600/0x25aee876ca7092c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7e2 expref: 25 pid: 754 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.508210:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5504600/0x25aee876ca7092c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7e2 expref: 25 pid: 754 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.508217:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.508219:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.508222:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a527c800/0x25aee876ca7093bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.508230:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a527c800/0x25aee876ca7093bb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.508251:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143100.508265:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962857954688:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143100.508269:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5569 00000100:00100000:0.0:1746143100.508387:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962860977920:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143100.508396:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.509109:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962860977792:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143100.509122:0:4756:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.509762:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.509804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.509817:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857955072 00000100:00100000:0.0:1746143100.509820:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857955072 00010000:00010000:0.0:1746143100.509836:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdeec00/0x25aee876ca7092d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7f0 expref: 13 pid: 754 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746143100.511019:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5571 00000100:00100000:0.0:1746143100.511026:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962857955072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143100.511048:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143100.511174:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fdeec00/0x25aee876ca7092d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7f0 expref: 13 pid: 754 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.511193:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fdeec00/0x25aee876ca7092d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7f0 expref: 13 pid: 754 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.511204:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdeec00/0x25aee876ca7092d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d7f0 expref: 13 pid: 754 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143100.511213:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143100.511228:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962857955072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 204us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143100.511233:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5571 00000100:00100000:0.0:1746143100.511285:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.512586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.512605:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.512626:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.514549:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.520385:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.527548:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143100.528575:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.528582:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.528596:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.528613:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.528619:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.528625:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c5a400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143100.528628:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.528636:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.528645:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.528651:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c5a400/0x25aee876ca7093c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.528685:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962857953536:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 32931us (34964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143100.528692:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10689 00010000:00010000:0.0:1746143100.532074:0:4756:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.532082:0:4756:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.532104:0:4756:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.532111:0:4756:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.532117:0:4756:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.532123:0:4756:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e81ca00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143100.532126:0:4756:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.532133:0:4756:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.532142:0:4756:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.532148:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca7093c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.532181:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962857953664:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 36435us (37567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143100.532187:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10688 00000100:00100000:0.0:1746143100.533802:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.536886:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.536970:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.537001:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.537308:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.538069:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.538512:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.542719:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.542836:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000004:00010000:0.0:1746143100.567489:0:14794:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5ccb480 reply state ffff88012d0b4c00 transno 8589942015 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81da00/0x25aee876ca7093de lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143100.567502:0:14794:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746143100.567585:0:14794:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746143100.567599:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:30088:x1830962857956224:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 33632us (33795us total) trans 8589942015 rc 0/0 00000100:00100000:0.0:1746143100.567606:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7841 00000100:00100000:0.0:1746143100.567745:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860979584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.567800:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.567824:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860980096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.567837:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.567846:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860980608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.567858:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.567872:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860981120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.567883:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.567900:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860979840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.567930:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.567940:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860980352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.567963:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.567974:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860980864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.567984:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.567991:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860981376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.568001:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.568017:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860980352 00000100:00100000:0.0:1746143100.568020:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860980352 00000100:00100000:0.0:1746143100.568030:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860980864 00000100:00100000:0.0:1746143100.568032:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860980864 00000100:00100000:0.0:1746143100.568037:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860981376 00000100:00100000:0.0:1746143100.568039:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860981376 00000100:00100000:0.0:1746143100.568064:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10692 00000100:00100000:0.0:1746143100.568068:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3299:x1830962860979712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.568152:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3299:x1830962860979712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (334us total) trans 21474839723 rc 0/0 00000100:00100000:0.0:1746143100.568157:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10692 00000100:00100000:0.0:1746143100.568165:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10694 00000100:00100000:0.0:1746143100.568169:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3302:x1830962860980608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.568215:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10695 00000100:00100000:0.0:1746143100.568220:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3302:x1830962860981120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.568312:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3302:x1830962860981120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (427us total) trans 17179872485 rc 0/0 00000100:00100000:0.0:1746143100.568318:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10695 00000100:00100000:0.0:1746143100.568329:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10697 00000100:00100000:0.0:1746143100.568334:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3300:x1830962860980352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.568364:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10699 00000100:00100000:0.0:1746143100.568368:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3300:x1830962860981376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.568437:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3300:x1830962860981376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (435us total) trans 17179872486 rc 0/0 00000100:00100000:0.0:1746143100.568442:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10699 00000004:00080000:0.0:1746143100.568477:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ccbb80/2, rc 0, transno 21474839726 00000100:00100000:0.0:1746143100.568483:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860979840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.568491:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e96a00/2, rc 0, transno 21474839727 00000100:00100000:0.0:1746143100.568494:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860980864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.568501:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f574e00/2, rc 0, transno 17179872486 00000100:00100000:0.0:1746143100.568504:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860981376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.568528:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860979968 00000100:00100000:0.0:1746143100.568530:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860979968 00000100:00100000:0.0:1746143100.568542:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860980480 00000100:00100000:0.0:1746143100.568544:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860980480 00000100:00100000:0.0:1746143100.568551:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860980992 00000100:00100000:0.0:1746143100.568553:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860980992 00000100:00100000:0.0:1746143100.568562:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860981504 00000100:00100000:0.0:1746143100.568563:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860981504 00000100:00100000:0.0:1746143100.568571:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860981632 00000100:00100000:0.0:1746143100.568572:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860981632 00000100:00100000:0.0:1746143100.568583:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10701 00000100:00100000:0.0:1746143100.568587:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3301:x1830962860980480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.568607:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10702 00000100:00100000:0.0:1746143100.568612:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3301:x1830962860980992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.568679:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962860980992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (170us total) trans 17179872488 rc 0/0 00000100:00100000:0.0:1746143100.568688:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10702 00000100:00100000:0.0:1746143100.568695:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10704 00000100:00100000:0.0:1746143100.568699:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3301:x1830962860981632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.568991:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3301:x1830962860981632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (431us total) trans 21474839728 rc 0/0 00000100:00100000:0.0:1746143100.568997:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10704 00000100:00100000:0.0:1746143100.569097:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962860980480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 509us (607us total) trans 17179872490 rc 0/0 00000100:00100000:0.0:1746143100.569534:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10701 00000100:00100000:0.0:1746143100.572625:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.572646:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10706 00000100:00100000:0.0:1746143100.572652:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3299:x1830962860980736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.572757:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3299:x1830962860980736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (367us total) trans 17179872492 rc 0/0 00000100:00100000:0.0:1746143100.572952:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10706 00000100:00100000:0.0:1746143100.573061:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3300:x1830962860980352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4726us (5096us total) trans 21474839730 rc 0/0 00000100:00100000:0.0:1746143100.573067:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10697 00000004:00080000:0.0:1746143100.573094:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f575c00/2, rc 0, transno 17179872485 00000100:00100000:0.0:1746143100.573098:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860981120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.573107:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc8000/2, rc 0, transno 21474839722 00000100:00100000:0.0:1746143100.573111:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860979584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.573117:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc9500/2, rc 0, transno 21474839724 00000100:00100000:0.0:1746143100.573120:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860980096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.573145:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ccaa00/2, rc 0, transno 21474839730 00000100:00100000:0.0:1746143100.573149:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860980352:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143100.574599:0:4756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143100.574602:0:4756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143100.574603:0:4756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143100.574604:0:4756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143100.574606:0:4756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:0.0:1746143100.574840:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc9880/2, rc 0, transno 21474839725 00000100:00100000:0.0:1746143100.574844:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860980608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.576271:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.594804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.594821:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857958528 00000100:00100000:0.0:1746143100.594824:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857958528 00000100:00100000:0.0:1746143100.604445:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.604502:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.606300:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.606335:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.606897:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5119 00000100:00100000:0.0:1746143100.606907:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962857959552:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143100.606931:0:21521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.606940:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.606941:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.606945:0:21521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.606965:0:21521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.612976:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.615950:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.615990:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143100.619695:0:21521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.619713:0:21521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.619722:0:21521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.619729:0:21521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094efbc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143100.619733:0:21521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.619741:0:21521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.619761:0:21521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.619767:0:21521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094efbc00/0x25aee876ca709439 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.619860:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1969:x1830962857959552:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 12952us (13520us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143100.619870:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5119 00000100:00100000:0.0:1746143100.619895:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5122 00000100:00100000:0.0:1746143100.619903:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1970:x1830962857960320:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143100.619930:0:21521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce400/0x25aee876ca70944e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.620024:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.620026:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.620045:0:21521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce400/0x25aee876ca70944e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.620055:0:21521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce400/0x25aee876ca70944e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.647949:0:31431:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca709455 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.647959:0:31431:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca709455 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.647964:0:31431:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca709455 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.647968:0:31431:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e81d800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143100.647979:0:31431:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca709455 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.647984:0:31431:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca709455 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.647992:0:31431:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca709455 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.647995:0:31431:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca709455 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143100.648060:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1970:x1830962857960576:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 27358us (27567us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143100.648392:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5123 00000100:00100000:0.0:1746143100.654385:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.657678:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.657710:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.657724:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.657734:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.657753:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857961088 00000100:00100000:0.0:1746143100.657760:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857961088 00000100:00100000:0.0:1746143100.657982:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857961344 00000100:00100000:0.0:1746143100.657986:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857961344 00000100:00100000:0.0:1746143100.658558:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10717 00000100:00100000:0.0:1746143100.658575:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962857961600:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:0.0:1746143100.658741:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143100.658744:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.658755:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143096 -> 1746143099 00002000:00010000:0.0:1746143100.658757:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.658759:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4099 -> 4099 00000100:00100000:0.0:1746143100.658811:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1969:x1830962857961600:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 243us (1074us total) trans 17179872494 rc 0/0 00000100:00100000:0.0:1746143100.658818:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10717 00000100:00100000:0.0:1746143100.658869:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.658934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.661638:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.663863:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.687616:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860982016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.687654:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687677:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860982400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.687694:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687707:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860983040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.687720:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687742:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860983552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.687757:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687771:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746143100.687785:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860981888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.687801:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687812:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860982528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.687825:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687834:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860982912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.687846:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687869:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860983424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.687889:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687904:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a24b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860982272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.687917:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687928:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860982784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.687940:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687949:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860983296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.687961:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687969:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860983808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.687979:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143100.687995:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860982528 00000100:00100000:0.0:1746143100.687997:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860982528 00000100:00100000:0.0:1746143100.688007:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860983424 00000100:00100000:0.0:1746143100.688008:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860983424 00000100:00100000:0.0:1746143100.688014:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860982272 00000100:00100000:0.0:1746143100.688015:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860982272 00000100:00100000:0.0:1746143100.688020:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860983296 00000100:00100000:0.0:1746143100.688022:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860983296 00000100:00100000:0.0:1746143100.688049:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10721 00000100:00100000:0.0:1746143100.688053:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3300:x1830962860982400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143100.688181:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143100.688184:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.688187:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.688188:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.688190:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143100.688212:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3300:x1830962860982400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (517us total) trans 21474839734 rc 0/0 00000100:00100000:0.0:1746143100.688314:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10721 00000100:00100000:0.0:1746143100.688327:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10723 00000100:00100000:0.0:1746143100.688332:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3300:x1830962860983552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.689627:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3300:x1830962860983552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1295us (1868us total) trans 21474839740 rc 0/0 00000100:00100000:0.0:1746143100.689632:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10723 00000004:00080000:0.0:1746143100.689667:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a24b480/2, rc 0, transno 17179872500 00000100:00100000:0.0:1746143100.689672:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a24b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860982272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.689680:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094511f80/2, rc 0, transno 21474839736 00000100:00100000:0.0:1746143100.689688:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860982784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.689695:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094513480/2, rc 0, transno 21474839737 00000100:00100000:0.0:1746143100.689698:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860983296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.689704:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094512680/2, rc 0, transno 21474839738 00000100:00100000:0.0:1746143100.689706:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860983808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.689720:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a248a80/2, rc 0, transno 17179872497 00000100:00100000:0.0:1746143100.689723:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860981888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.689728:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a24b100/2, rc 0, transno 17179872498 00000100:00100000:0.0:1746143100.689731:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860982528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.689736:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e94000/2, rc 0, transno 17179872499 00000100:00100000:0.0:1746143100.689738:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860982912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.689744:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e95f80/2, rc 0, transno 17179872501 00000100:00100000:0.0:1746143100.689746:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860983424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.689762:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a248e00/2, rc 0, transno 17179872496 00000100:00100000:0.0:1746143100.689765:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860982016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.689772:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094510e00/2, rc 0, transno 21474839734 00000100:00100000:0.0:1746143100.689784:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860982400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.689792:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094511180/2, rc 0, transno 21474839735 00000100:00100000:0.0:1746143100.689795:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860983040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.689800:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094510a80/2, rc 0, transno 21474839740 00000100:00100000:0.0:1746143100.689803:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962860983552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143100.690136:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a248380/2, rc 0, transno 17179872503 00000100:00100000:0.0:1746143100.690139:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962860982656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.695609:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.717704:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.717953:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.725266:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.725316:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.726281:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7848 00000100:00100000:0.0:1746143100.726289:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30096:x1830962857963136:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143100.726524:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143100.726535:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81cc00/0x25aee876ca7094c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164d8e5 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.726620:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca7094d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143100.726633:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a281400/0x25aee876ca70949b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8d7 expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.726645:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f5d200/0x25aee876ca7094a2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8de expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.726652:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca7094d3 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143100.726690:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092f5d200/0x25aee876ca7094a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8de expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.726702:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f5d200/0x25aee876ca7094a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8de expref: 200 pid: 14794 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746143100.726714:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130765880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962860984064:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143100.726797:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012a281400/0x25aee876ca70949b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8d7 expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.726805:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a281400/0x25aee876ca70949b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8d7 expref: 10 pid: 17079 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746143100.726813:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130767480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962860984192:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143100.726832:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143100.730126:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.730767:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.730814:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.731154:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.737963:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.738500:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.739656:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.739727:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857964672 00000100:00100000:0.0:1746143100.739731:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857964672 00002000:00100000:0.0:1746143100.739758:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880093b5b800 x1830962857964672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:251/0 lens 488/0 e 0 to 0 dl 1746143111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143100.739767:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5b800 with x1830962857964672 ext(0->1048575) 00002000:00010000:0.0:1746143100.739771:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5b800 00000100:00100000:0.0:1746143100.739986:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5124 00000100:00100000:0.0:1746143100.739992:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962857964672:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143100.748441:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.748819:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.763280:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857965312 00000100:00100000:0.0:1746143100.763288:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857965312 00000100:00100000:0.0:1746143100.763327:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10738 00000100:00100000:0.0:1746143100.763335:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30100:x1830962857965312:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143100.763549:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143100.763563:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a527ce00/0x25aee876ca709512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164d916 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.763586:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.763587:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143100.763595:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a527ce00/0x25aee876ca709512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d916 expref: 31 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.763608:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a527ce00/0x25aee876ca709512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d916 expref: 31 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143100.763631:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a527ce00, rc 0) 00000100:00100000:0.0:1746143100.763672:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:30100:x1830962857965312:12345-192.168.201.28@tcp:101:cat.0 Request processed in 337us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143100.763678:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10738 00000100:00100000:0.0:1746143100.781483:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860984576 00000100:00100000:0.0:1746143100.781491:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860984576 00000100:00100000:0.0:1746143100.781519:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860984960 00000100:00100000:0.0:1746143100.781521:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860984960 00000100:00100000:0.0:1746143100.781529:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860984704 00000100:00100000:0.0:1746143100.781531:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860984704 00000100:00100000:0.0:1746143100.781537:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860984832 00000100:00100000:0.0:1746143100.781539:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860984832 00000100:00100000:0.0:1746143100.781547:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10739 00000100:00100000:0.0:1746143100.781553:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3300:x1830962860984576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143100.781710:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143100.781713:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.781715:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.781717:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.781718:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1939 -> 1939 00000100:00100000:0.0:1746143100.781747:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3300:x1830962860984576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (458us total) trans 21474839743 rc 0/0 00000100:00100000:0.0:1746143100.782654:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10739 00000100:00100000:0.0:1746143100.782701:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10742 00000100:00100000:0.0:1746143100.782706:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3300:x1830962860985472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.782828:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3300:x1830962860985472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (1436us total) trans 21474839746 rc 0/0 00000100:00100000:0.0:1746143100.782841:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10742 00000100:00100000:0.0:1746143100.782849:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10745 00000100:00100000:0.0:1746143100.782853:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3301:x1830962860984832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143100.782910:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 4938560 -> 4938560 00002000:00010000:0.0:1746143100.782913:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.782914:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.782916:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143099 -> 1746143099 00002000:00010000:0.0:1746143100.782918:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 5623 -> 5623 00000100:00100000:0.0:1746143100.782933:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962860984832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1476us total) trans 21474839748 rc 0/0 00000100:00100000:0.0:1746143100.782937:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10745 00000100:00100000:0.0:1746143100.783631:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860986368 00000100:00100000:0.0:1746143100.783634:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860986368 00000100:00100000:0.0:1746143100.783650:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10747 00000100:00100000:0.0:1746143100.783654:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3302:x1830962860986368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.783950:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3302:x1830962860986368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (330us total) trans 17179872504 rc 0/0 00000100:00100000:0.0:1746143100.783955:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10747 00000100:00100000:0.0:1746143100.783964:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860985984 00000100:00100000:0.0:1746143100.783966:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860985984 00000100:00100000:0.0:1746143100.783973:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860986496 00000100:00100000:0.0:1746143100.783975:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860986496 00000100:00100000:0.0:1746143100.783982:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10749 00000100:00100000:0.0:1746143100.783985:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3302:x1830962860986240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143100.785311:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3302:x1830962860986240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1324us (1634us total) trans 17179872511 rc 0/0 00000100:00100000:0.0:1746143100.785326:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10749 00000004:00080000:0.0:1746143100.785349:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e97480/2, rc 0, transno 17179872509 00000100:00100000:0.0:1746143100.785353:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860985728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.785358:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130764380/2, rc 0, transno 17179872511 00000100:00100000:0.0:1746143100.785360:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860986240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.785366:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e97b80/2, rc 0, transno 17179872508 00000100:00100000:0.0:1746143100.785368:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860985856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.785372:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130765880/2, rc 0, transno 17179872504 00000100:00100000:0.0:1746143100.785374:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860986368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143100.787770:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009535ca80/2, rc 0, transno 21474839751 00000100:00100000:0.0:1746143100.787783:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962860986880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143100.791418:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.795882:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.800301:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.800520:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.812028:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.820157:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.845540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.845581:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.880294:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.880357:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.912317:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.941661:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.965760:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.985826:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.987316:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143100.993574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.004610:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.004659:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.004697:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857969920 00000100:00100000:0.0:1746143101.004705:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857969920 00002000:00100000:0.0:1746143101.004753:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009c1ea680 x1830962857969920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:252/0 lens 488/0 e 0 to 0 dl 1746143112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.004763:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1ea680 with x1830962857969920 ext(1048576->2097151) 00002000:00010000:0.0:1746143101.004768:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1ea680 00000100:00100000:0.0:1746143101.004808:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857970176 00000100:00100000:0.0:1746143101.004810:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857970176 00002000:00100000:0.0:1746143101.004823:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3371008->3375103) req@ffff88009c1e9500 x1830962857970176/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:252/0 lens 488/0 e 0 to 0 dl 1746143112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.004830:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9500 with x1830962857970176 ext(3371008->3375103) 00002000:00010000:0.0:1746143101.004833:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e9500 00000100:00100000:0.0:1746143101.004851:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5133 00000100:00100000:0.0:1746143101.004858:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962857969920:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143101.027079:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.028544:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.028574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.036097:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857971584 00000100:00100000:0.0:1746143101.036103:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857971584 00010000:00010000:0.0:1746143101.036136:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28ae00/0x25aee876ca70941d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8c9 expref: 14 pid: 4756 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746143101.036182:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5595 00000100:00100000:0.0:1746143101.036189:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962857971584:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143101.036199:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143101.036216:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a28ae00/0x25aee876ca70941d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8c9 expref: 14 pid: 4756 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143101.036225:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a28ae00/0x25aee876ca70941d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8c9 expref: 14 pid: 4756 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143101.036244:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a28ae00/0x25aee876ca70941d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8c9 expref: 14 pid: 4756 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746143101.036258:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143101.036277:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962857971584:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143101.036283:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5595 00000100:00100000:0.0:1746143101.040338:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.040565:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143101.040732:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143101.056808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.060910:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.062135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.070992:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.071113:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.073564:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.075227:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.103650:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.110622:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143101.114127:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143101.127614:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.128969:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.147210:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.159152:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.166463:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.166501:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.166545:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.173456:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.173496:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.180781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.180798:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857976320 00000100:00100000:0.0:1746143101.180802:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857976320 00002000:00100000:0.0:1746143101.180819:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88012bacdf80 x1830962857976320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:252/0 lens 488/0 e 0 to 0 dl 1746143112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.180828:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bacdf80 with x1830962857976320 ext(3145728->4194303) 00002000:00010000:0.0:1746143101.180831:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bacdf80 00000100:00100000:0.0:1746143101.180855:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5144 00000100:00100000:0.0:1746143101.180861:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bacdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962857976320:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143101.191238:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.197932:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.208841:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.212348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.218113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.218193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.218218:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.234500:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857977856 00000100:00100000:0.0:1746143101.234509:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857977856 00000100:00100000:0.0:1746143101.234540:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857977984 00000100:00100000:0.0:1746143101.234542:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857977984 00000100:00100000:0.0:1746143101.234558:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10778 00000100:00100000:0.0:1746143101.234565:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1968:x1830962857977856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143101.234581:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143101.234597:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d60800/0x25aee876ca7095dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164d9cc expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143101.234645:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bacfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962860989824:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143101.234712:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143101.240259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.243143:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bacfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962860989824:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143101.243167:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d60800/0x25aee876ca7095dd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d9cc expref: 39 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.243181:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d60800/0x25aee876ca7095dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d9cc expref: 39 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.244837:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d60800, rc 0) 00000100:00100000:0.0:1746143101.244865:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962857977856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10300us (10496us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143101.244870:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10778 00000100:00100000:0.0:1746143101.251277:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857979136 00000100:00100000:0.0:1746143101.251290:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857979136 00000100:00100000:0.0:1746143101.251330:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3263 00000100:00100000:0.0:1746143101.251338:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30100:x1830962857979136:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143101.251686:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30100:x1830962857979136:12345-192.168.201.28@tcp:35:cat.0 Request processed in 348us (454us total) trans 8589942028 rc 0/0 00000100:00100000:0.0:1746143101.251693:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3263 00000100:00100000:0.0:1746143101.258910:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.270157:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.270231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.279279:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.287169:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.287566:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.297477:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.306390:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.306456:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.311532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.311563:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.311585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.311605:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.311616:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.311637:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.312837:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10786 00000100:00100000:0.0:1746143101.312846:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fefdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1969:x1830962857981184:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143101.312874:0:21048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.312889:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81c800/0x25aee876ca70940f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8b4 expref: 15 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.312906:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a518a800/0x25aee876ca709543 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d947 expref: 26 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.312913:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81da00/0x25aee876ca70952e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d932 expref: 33 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.312918:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143101.312920:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143101.312922:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.312942:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81da00/0x25aee876ca70952e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d932 expref: 33 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.313471:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e81da00/0x25aee876ca70952e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d932 expref: 33 pid: 4756 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143101.313482:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008feff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962860990976:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143101.313512:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a518a800/0x25aee876ca709543 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d947 expref: 26 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.313521:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a518a800/0x25aee876ca709543 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d947 expref: 26 pid: 4756 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143101.313530:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008feff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962860992768:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143101.313561:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81c800/0x25aee876ca70940f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8b4 expref: 15 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.313570:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e81c800/0x25aee876ca70940f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d8b4 expref: 15 pid: 8448 timeout: 983 lvb_type: 1 00000100:00100000:0.0:1746143101.313577:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008feff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962860992896:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143101.313590:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143101.313613:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857981824 00000100:00100000:0.0:1746143101.313616:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857981824 00000100:00100000:0.0:1746143101.313642:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7860 00000100:00100000:0.0:1746143101.313647:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30110:x1830962857981824:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143101.313659:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143101.313670:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61c00/0x25aee876ca70968c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164da12 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.313752:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.313763:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.313783:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.313794:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.313800:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.313812:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.313904:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.313914:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0x25aee876ca709654 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da0b expref: 9 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.313919:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.313935:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0x25aee876ca709654 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da0b expref: 9 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.313943:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0x25aee876ca709654 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da0b expref: 9 pid: 20619 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143101.313951:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008feffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962860993024:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143101.313990:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b00240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143101.317881:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.317990:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.318009:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857982080 00000100:00100000:0.0:1746143101.318012:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857982080 00010000:00010000:0.0:1746143101.318027:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca709520 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d924 expref: 17 pid: 4756 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143101.318429:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5606 00000100:00100000:0.0:1746143101.318436:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962857982080:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143101.318450:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143101.318460:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca709520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d924 expref: 17 pid: 4756 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143101.318469:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca709520 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d924 expref: 17 pid: 4756 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143101.318482:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca709520 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d924 expref: 17 pid: 4756 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143101.318495:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143101.318514:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962857982080:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 78us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143101.318520:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5606 00000100:00100000:0.0:1746143101.324023:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008feff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962860990976:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143101.324375:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008feff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962860992768:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143101.324383:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008feff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962860992896:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143101.324396:0:21048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143101.324600:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008feffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962860993024:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143101.324611:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143101.325190:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.332495:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.332546:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.333741:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.333801:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.333823:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.333867:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334066:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334076:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334086:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334098:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334113:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334123:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334145:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.334629:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143101.334644:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334650:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143101.334669:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9132864 00010000:00010000:0.0:1746143101.334794:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334800:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334805:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334809:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d61600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143101.334817:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334822:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334829:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009b91ac00) 00010000:00010000:0.0:1746143101.334831:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143101.334833:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334838:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61600/0x25aee876ca7096a1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334853:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334857:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334861:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334865:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d61a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143101.334867:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334871:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334876:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143101.334877:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143101.334879:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334889:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61a00/0x25aee876ca709693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334896:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334900:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334904:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334907:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d61800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143101.334909:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334913:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334918:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5288100) 00010000:00010000:0.0:1746143101.334920:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143101.334922:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334926:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61800/0x25aee876ca70969a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143101.334959:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61c00/0x25aee876ca70968c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da12 expref: 202 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.334966:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d61c00/0x25aee876ca70968c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da12 expref: 202 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.334979:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d61c00, rc 0) 00000100:00100000:0.0:1746143101.334992:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30110:x1830962857981824:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 21346us (21431us total) trans 8589942032 rc 301/301 00000100:00100000:0.0:1746143101.334998:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7860 00010000:00010000:0.0:1746143101.336160:0:21048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.336168:0:21048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.336182:0:21048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.336188:0:21048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.336195:0:21048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.336200:0:21048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d60400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143101.336203:0:21048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.336210:0:21048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.336228:0:21048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.336233:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d60400/0x25aee876ca709662 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143101.336261:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fefdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962857981184:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 23417us (24697us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143101.336266:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10786 00000100:00100000:0.0:1746143101.347157:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.358181:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857984512 00000100:00100000:0.0:1746143101.358190:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857984512 00000100:00100000:0.0:1746143101.358243:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7861 00000100:00100000:0.0:1746143101.358252:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30106:x1830962857984512:12345-192.168.201.28@tcp:36:lfs.0 00010000:00010000:0.0:1746143101.358297:0:1037:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143101.358320:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893400/0x25aee876ca70963f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164d9fd expref: 9 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.358355:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009b91ac00) 00010000:00010000:0.0:1746143101.358361:0:1037:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143101.358427:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30106:x1830962857984512:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 176us (935us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746143101.358434:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7861 00000100:00100000:0.0:1746143101.369714:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.378307:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.388114:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.392338:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.395493:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.395531:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.395558:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.395577:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857985536 00000100:00100000:0.0:1746143101.395583:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857985536 00000100:00100000:0.0:1746143101.395606:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857985664 00000100:00100000:0.0:1746143101.395608:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857985664 00000100:00100000:0.0:1746143101.395633:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857985792 00000100:00100000:0.0:1746143101.395635:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857985792 00000100:00100000:0.0:1746143101.395649:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10792 00000100:00100000:0.0:1746143101.395655:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962857985536:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143101.395667:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143101.395679:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d61800/0x25aee876ca7096d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164da27 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143101.395696:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x6814077b, atime: 0x6814077b, ctime: 0x6814077b, blocks: 0x793 00010000:00010000:0.0:1746143101.395709:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143101.395710:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143101.395717:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d61800/0x25aee876ca7096d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da27 expref: 25 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.395729:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d61800/0x25aee876ca7096d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da27 expref: 25 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.395737:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d61800, rc 0) 00000100:00100000:0.0:1746143101.395781:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962857985536:12345-192.168.201.28@tcp:101:cat.0 Request processed in 125us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143101.395798:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10792 00000100:00100000:0.0:1746143101.395929:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.397137:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.397212:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.397232:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10796 00000100:00100000:0.0:1746143101.397239:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962857986176:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143101.397246:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143101.397254:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d61200/0x25aee876ca7096f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164da4a expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143101.397267:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x6814077c, atime: 0x6814077c, ctime: 0x6814077b, blocks: 0x1003 00010000:00010000:0.0:1746143101.397282:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143101.397284:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143101.397288:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d61200/0x25aee876ca7096f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da4a expref: 35 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.397299:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d61200/0x25aee876ca7096f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da4a expref: 35 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.397306:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d61200, rc 0) 00000100:00100000:0.0:1746143101.397326:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962857986176:12345-192.168.201.28@tcp:101:cat.0 Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143101.397332:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10796 00000100:00100000:0.0:1746143101.397385:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.403432:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.406059:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.417976:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.418009:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.418050:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.418073:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.424080:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857987968 00000100:00100000:0.0:1746143101.424087:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857987968 00002000:00100000:0.0:1746143101.424120:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008e80c700 x1830962857987968/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:252/0 lens 488/0 e 0 to 0 dl 1746143112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.424130:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c700 with x1830962857987968 ext(1048576->2097151) 00002000:00010000:0.0:1746143101.424134:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80c700 00000100:00100000:0.0:1746143101.424148:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5154 00000100:00100000:0.0:1746143101.424154:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962857987968:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143101.433912:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.462751:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.473231:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.473280:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.473698:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.473983:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.518124:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.538904:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.538955:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.543782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.546572:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.547121:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.547720:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.547747:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.547779:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.548391:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10803 00000100:00100000:0.0:1746143101.548397:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962857991040:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143101.548404:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143101.548410:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d60600/0x25aee876ca70975e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164da82 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.548419:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143101.548420:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143101.548424:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d60600/0x25aee876ca70975e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da82 expref: 18 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.548433:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d60600/0x25aee876ca70975e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da82 expref: 18 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.548440:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d60600, rc 0) 00000100:00100000:0.0:1746143101.548452:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962857991040:12345-192.168.201.28@tcp:101:cat.0 Request processed in 57us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143101.548456:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10803 00000100:00100000:0.0:1746143101.549017:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.549074:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.562579:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.565865:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.568809:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.579632:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857992576 00000100:00100000:0.0:1746143101.579643:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857992576 00002000:00100000:0.0:1746143101.579685:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008eb77800 x1830962857992576/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:252/0 lens 488/0 e 0 to 0 dl 1746143112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.579709:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77800 with x1830962857992576 ext(1048576->2097151) 00002000:00010000:0.0:1746143101.579715:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb77800 00000100:00100000:0.0:1746143101.579736:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857992448 00000100:00100000:0.0:1746143101.579740:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857992448 00002000:00100000:0.0:1746143101.579751:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3416064->3420159) req@ffff88008eb74700 x1830962857992448/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:252/0 lens 488/0 e 0 to 0 dl 1746143112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.579757:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74700 with x1830962857992448 ext(3416064->3420159) 00002000:00010000:0.0:1746143101.579772:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb74700 00000100:00100000:0.0:1746143101.580022:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5163 00000100:00100000:0.0:1746143101.580049:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962857992576:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143101.581609:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5164 00000100:00100000:0.0:1746143101.581618:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962857992448:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143101.581701:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962857992448:12345-192.168.201.28@tcp:3:cat.0 Request processed in 84us (3914us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143101.581709:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5164 00002000:00100000:0.0:1746143101.581715:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3416064->3420159) req@ffff88008eb74700 x1830962857992448/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:252/0 lens 488/4536 e 0 to 0 dl 1746143112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.581723:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74700 with x1830962857992448 ext(3416064->3420159) 00002000:00010000:0.0:1746143101.581728:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb74700 00000100:00100000:0.0:1746143101.599203:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.606901:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962857993216 00000100:00100000:0.0:1746143101.606906:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962857993216 00010000:00010000:0.0:1746143101.606925:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f5400/0x25aee876ca7096c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da19 expref: 207 pid: 20619 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143101.612669:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.626951:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.655804:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.669777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.695008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.703976:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.714520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.714557:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.714577:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.714609:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.714643:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.763825:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.768412:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143101.778977:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091111a00/0x25aee876ca709750 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da74 expref: 27 pid: 8449 timeout: 983 lvb_type: 1 00000100:00100000:0.0:1746143101.779008:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962860994816:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143101.779021:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f5c00/0x25aee876ca7096e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da2e expref: 39 pid: 8169 timeout: 983 lvb_type: 1 00000100:00100000:0.0:1746143101.779045:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962860994944:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143101.779066:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca7097c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dac1 expref: 38 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.779076:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50ce000, rc 0) 00000100:00100000:0.0:1746143101.779107:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:30124:x1830962857996160:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 15153us (15289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143101.779113:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10810 00000100:00100000:0.0:1746143101.786770:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.786991:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.792324:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.794892:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.796904:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.801426:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.801472:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.805264:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.805838:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.814110:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962860995968:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143101.814127:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5d1600/0x25aee876ca7097ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dae4 expref: 28 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.814134:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5d1600/0x25aee876ca7097ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dae4 expref: 28 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143101.814152:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5d1600, rc 0) 00000100:00100000:0.0:1746143101.814191:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962857997824:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8648us (8930us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143101.814198:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10815 00000100:00100000:0.0:1746143101.815439:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.827803:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5175 00000100:00100000:0.0:1746143101.827810:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962857999104:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143101.890118:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1970:x1830962857999104:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 62302us (63940us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143101.890130:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5175 00002000:00100000:0.0:1746143101.890141:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009f4fdc00 x1830962857999104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:252/0 lens 488/440 e 0 to 0 dl 1746143112 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.890150:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdc00 with x1830962857999104 ext(2097152->3145727) 00002000:00010000:0.0:1746143101.890155:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fdc00 00000100:00100000:0.0:1746143101.891122:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.894714:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962857999360:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 49693us (50072us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143101.894724:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5176 00002000:00100000:0.0:1746143101.894734:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880093b8bb80 x1830962857999360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:252/0 lens 488/440 e 0 to 0 dl 1746143112 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143101.894742:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8bb80 with x1830962857999360 ext(3145728->4194303) 00002000:00010000:0.0:1746143101.894747:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b8bb80 00000100:00100000:0.0:1746143101.930670:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858000256 00000100:00100000:0.0:1746143101.930678:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858000256 00000100:00100000:0.0:1746143101.930777:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3270 00000100:00100000:0.0:1746143101.930785:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:30128:x1830962858000256:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143101.930973:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:30128:x1830962858000256:12345-192.168.201.28@tcp:35:cat.0 Request processed in 188us (329us total) trans 8589942044 rc 0/0 00000100:00100000:0.0:1746143101.930979:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3270 00000100:00100000:0.0:1746143101.997645:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143101.997898:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7868 00000100:00100000:0.0:1746143101.997915:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30134:x1830962858000384:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143101.997936:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143101.997952:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132059000/0x25aee876ca70981b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164daf9 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.998003:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143101.998014:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143101.998024:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143101.998060:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143101.998066:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143101.998070:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143101.998161:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143101.998170:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091110400/0x25aee876ca70977a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da97 expref: 208 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.998176:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143101.998201:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091110400/0x25aee876ca70977a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da97 expref: 208 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143101.998217:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091110400/0x25aee876ca70977a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da97 expref: 208 pid: 20619 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143101.998227:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962860996224:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143101.998318:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143102.000577:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143102.001136:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143102.005334:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143102.005540:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005546:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:0.0:1746143102.005578:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9132864 00000004:00200000:0.0:1746143102.005581:0:20619:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143102.005592:0:20619:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005598:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005605:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005609:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005612:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005623:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132059a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143102.005625:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005629:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005635:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143102.005638:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143102.005640:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005645:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132059a00/0x25aee876ca709822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005654:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005659:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005663:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005668:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132059400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143102.005670:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005675:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005681:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800931f2d00) 00010000:00010000:0.0:1746143102.005683:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143102.005690:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005694:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132059400/0x25aee876ca709829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.005733:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132059000/0x25aee876ca70981b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164daf9 expref: 12 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.005744:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164daf9 expref: 11 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.005750:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009b91ac00) 00010000:00010000:0.0:1746143102.005763:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143102.005765:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132059e00, rc 0) 00000100:00100000:0.0:1746143102.005797:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30134:x1830962858000384:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7884us (8159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.005804:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7868 00000100:00100000:0.0:1746143102.011174:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.012934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.012966:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.013634:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.014965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.014995:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.015014:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858001408 00000100:00100000:0.0:1746143102.015017:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858001408 00000100:00100000:0.0:1746143102.015153:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10821 00000100:00100000:0.0:1746143102.015160:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858001536:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143102.015167:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143102.015180:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132058800/0x25aee876ca709853 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164db23 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.015191:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.015193:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.015198:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132058800/0x25aee876ca709853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db23 expref: 10 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.015207:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132058800/0x25aee876ca709853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db23 expref: 10 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.015214:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132058800, rc 0) 00000100:00100000:0.0:1746143102.015233:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858001536:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.015240:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10821 00000100:00100000:0.0:1746143102.027590:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858001792 00000100:00100000:0.0:1746143102.027600:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858001792 00000100:00100000:0.0:1746143102.027649:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7869 00000100:00100000:0.0:1746143102.027657:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30134:x1830962858001792:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143102.027677:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143102.027693:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132059600/0x25aee876ca709861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164db2a expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.027784:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132058000/0x25aee876ca709868 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.027799:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164daf9 expref: 12 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.027817:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132058000/0x25aee876ca709868 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143102.027847:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164daf9 expref: 12 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.027858:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132059e00/0x25aee876ca709830 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164daf9 expref: 12 pid: 20619 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143102.027869:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962860996608:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143102.027952:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143102.034381:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.040627:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.046228:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.048801:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.048839:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.054080:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.061830:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.101311:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.115183:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143102.115386:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143102.122303:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.129019:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.129101:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.144774:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.145113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.147701:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143102.148189:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143102.166335:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.178778:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.181366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.185187:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.185722:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.186583:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.186638:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.186656:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858005376 00000100:00100000:0.0:1746143102.186659:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858005376 00000100:00100000:0.0:1746143102.186677:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858005504 00000100:00100000:0.0:1746143102.186679:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858005504 00000100:00100000:0.0:1746143102.186695:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10829 00000100:00100000:0.0:1746143102.186701:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858005376:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143102.186709:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143102.186719:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132058400/0x25aee876ca709917 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164db7e expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.186733:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.186734:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.186740:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132058400/0x25aee876ca709917 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db7e expref: 24 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.186765:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132058400/0x25aee876ca709917 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db7e expref: 24 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.186773:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132058400, rc 0) 00000100:00100000:0.0:1746143102.186814:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858005376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 113us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.186846:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10829 00000100:00100000:0.0:1746143102.186858:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10830 00000100:00100000:0.0:1746143102.186863:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858005504:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143102.186869:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143102.186876:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132059c00/0x25aee876ca70991e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164db85 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143102.186905:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e037100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962860997888:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143102.186936:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143102.199946:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.217794:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.226391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.226432:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.226534:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.238134:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.238171:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.238226:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143102.238336:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143102.249816:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.254015:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.254052:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858007552 00000100:00100000:0.0:1746143102.254059:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858007552 00010000:00010000:0.0:1746143102.254085:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca7098f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db69 expref: 11 pid: 8449 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143102.254110:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5641 00000100:00100000:0.0:1746143102.254120:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858007552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143102.254130:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143102.254147:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca7098f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db69 expref: 11 pid: 8449 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.254159:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca7098f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db69 expref: 11 pid: 8449 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.254178:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca7098f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db69 expref: 11 pid: 8449 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.254197:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.254199:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.254205:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132008600/0x25aee876ca709925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1265664->1892351) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db8c expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.254213:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132008600/0x25aee876ca709925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1265664->1892351) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db8c expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.254238:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132008600/0x25aee876ca709925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1265664->1892351) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db8c expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.254874:0:16965:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132008600/0x25aee876ca709925 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1265664->1892351) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db8c expref: 23 pid: 8169 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143102.254890:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a79180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962860998784:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143102.255228:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143102.261103:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a79180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962860998784:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143102.261120:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143102.261154:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858007552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7034us (7145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.261163:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5641 00000100:00100000:0.0:1746143102.269199:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.280884:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.280967:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.281300:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858008832 00000100:00100000:0.0:1746143102.281309:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858008832 00002000:00100000:0.0:1746143102.281350:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1265664->1892351) req@ffff880092a79880 x1830962858008832/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:253/0 lens 488/0 e 0 to 0 dl 1746143113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143102.281359:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79880 with x1830962858008832 ext(1265664->1892351) 00010000:00010000:0.0:1746143102.281367:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132008600/0x25aee876ca709925 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1892351) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db8c expref: 24 pid: 8169 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.281380:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132008600/0x25aee876ca709925 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1892351) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db8c expref: 24 pid: 8169 timeout: 984 lvb_type: 0 00002000:00010000:0.0:1746143102.281386:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a79880 00000100:00100000:0.0:1746143102.281407:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1725 00000100:00100000:0.0:1746143102.281415:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858008832:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143102.288270:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3302:1830962860999040:0@lo:400:kworker.0 00000100:00100000:0.0:1746143102.288305:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143102.288327:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830962860999552:0@lo:400:kworker.0 00000100:00100000:0.0:1746143102.288354:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143102.288371:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143102.288375:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860999424:0@lo:400:kworker.0 00000100:00100000:0.0:1746143102.288391:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143102.288421:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1746143102.288428:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1830962860999168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143102.288457:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1830962860999168:12345-0@lo:400:kworker.0 Request processed in 31us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.288462:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1746143102.288479:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962860999424 00000100:00100000:0.0:1746143102.288482:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962860999424 00000100:00100000:0.0:1746143102.288504:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1746143102.288508:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1830962860999424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143102.288531:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1830962860999424:12345-0@lo:400:kworker.0 Request processed in 23us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.288535:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1746143102.288571:0:3302:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872511 gen 2 00000004:00080000:0.0:1746143102.288576:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa3480, transno 17179872448 00000004:00080000:0.0:1746143102.288582:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa0a80, transno 17179872449 00000004:00080000:0.0:1746143102.288584:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa1500, transno 17179872450 00000004:00080000:0.0:1746143102.288586:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa3800, transno 17179872451 00000004:00080000:0.0:1746143102.288588:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4fdf80, transno 17179872452 00000004:00080000:0.0:1746143102.288591:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa0000, transno 17179872453 00000004:00080000:0.0:1746143102.288592:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4fce00, transno 17179872454 00000004:00080000:0.0:1746143102.288594:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4fd880, transno 17179872455 00000004:00080000:0.0:1746143102.288596:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a708000, transno 17179872459 00000004:00080000:0.0:1746143102.288599:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a70bb80, transno 17179872460 00000004:00080000:0.0:1746143102.288605:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a70a680, transno 17179872461 00000004:00080000:0.0:1746143102.288608:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a708e00, transno 17179872462 00000004:00080000:0.0:1746143102.288610:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a70b800, transno 17179872463 00000004:00080000:0.0:1746143102.288612:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a708380, transno 17179872464 00000004:00080000:0.0:1746143102.288615:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a70ad80, transno 17179872465 00000004:00080000:0.0:1746143102.288616:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a709880, transno 17179872466 00000004:00080000:0.0:1746143102.288618:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a709f80, transno 17179872467 00000004:00080000:0.0:1746143102.288620:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a531aa00, transno 17179872468 00000004:00080000:0.0:1746143102.288622:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5319880, transno 17179872469 00000004:00080000:0.0:1746143102.288624:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa3b80, transno 17179872470 00000004:00080000:0.0:1746143102.288626:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa1180, transno 17179872471 00000004:00080000:0.0:1746143102.288628:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5318a80, transno 17179872472 00000004:00080000:0.0:1746143102.288630:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5319180, transno 17179872473 00000004:00080000:0.0:1746143102.288632:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5319500, transno 17179872474 00000004:00080000:0.0:1746143102.288634:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f575c00, transno 17179872485 00000004:00080000:0.0:1746143102.288636:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f574e00, transno 17179872486 00000004:00080000:0.0:1746143102.288638:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f575500, transno 17179872487 00000004:00080000:0.0:1746143102.288640:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f576300, transno 17179872488 00000004:00080000:0.0:1746143102.288642:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f577b80, transno 17179872489 00000004:00080000:0.0:1746143102.288643:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f575880, transno 17179872490 00000004:00080000:0.0:1746143102.288645:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f576a00, transno 17179872491 00000004:00080000:0.0:1746143102.288647:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f576680, transno 17179872492 00000004:00080000:0.0:1746143102.288650:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a248e00, transno 17179872496 00000004:00080000:0.0:1746143102.288652:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a248a80, transno 17179872497 00000004:00080000:0.0:1746143102.288654:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a24b100, transno 17179872498 00000004:00080000:0.0:1746143102.288656:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e94000, transno 17179872499 00000004:00080000:0.0:1746143102.288658:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a24b480, transno 17179872500 00000004:00080000:0.0:1746143102.288660:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e95f80, transno 17179872501 00000004:00080000:0.0:1746143102.288661:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e97800, transno 17179872502 00000004:00080000:0.0:1746143102.288663:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a248380, transno 17179872503 00000004:00080000:0.0:1746143102.288670:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130765880, transno 17179872504 00000004:00080000:0.0:1746143102.288671:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b599180, transno 17179872505 00000004:00080000:0.0:1746143102.288673:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e94a80, transno 17179872506 00000004:00080000:0.0:1746143102.288675:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5cc9c00, transno 17179872507 00000004:00080000:0.0:1746143102.288677:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e97b80, transno 17179872508 00000004:00080000:0.0:1746143102.288679:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e97480, transno 17179872509 00000004:00080000:0.0:1746143102.288681:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130765c00, transno 17179872510 00000004:00080000:0.0:1746143102.288682:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130764380, transno 17179872511 00000100:00100000:0.0:1746143102.288686:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962860999424:0@lo:400:kworker.0 00000100:00100000:0.0:1746143102.288697:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3302:1830962860999040:0@lo:400:kworker.0 00000100:00100000:0.0:1746143102.288705:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830962860999552:0@lo:400:kworker.0 00000004:00080000:0.0:1746143102.289207:0:14837:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 48 done 00000100:00100000:0.0:1746143102.294306:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858008832:12345-192.168.201.28@tcp:4:cat.0 Request processed in 12884us (13330us total) trans 17179872518 rc 0/0 00000100:00100000:0.0:1746143102.294317:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1725 00002000:00100000:0.0:1746143102.294327:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1265664->1892351) req@ffff880092a79880 x1830962858008832/t17179872518(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:253/0 lens 488/448 e 0 to 0 dl 1746143113 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143102.294337:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79880 with x1830962858008832 ext(1265664->1892351) 00010000:00010000:0.0:1746143102.294346:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132008600/0x25aee876ca709925 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1892351) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db8c expref: 26 pid: 8169 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.294359:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132008600/0x25aee876ca709925 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1892351) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db8c expref: 26 pid: 8169 timeout: 984 lvb_type: 0 00002000:00010000:0.0:1746143102.294366:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a79880 00000100:00100000:0.0:1746143102.308630:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858009472 00000100:00100000:0.0:1746143102.308637:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858009472 00002000:00100000:0.0:1746143102.308670:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008e80e300 x1830962858009472/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:253/0 lens 488/0 e 0 to 0 dl 1746143113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143102.308680:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80e300 with x1830962858009472 ext(1048576->2097151) 00002000:00010000:0.0:1746143102.308684:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80e300 00000100:00100000:0.0:1746143102.308700:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5184 00000100:00100000:0.0:1746143102.308706:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858009472:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143102.312731:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.312816:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.321099:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962860999936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143102.321149:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143102.325006:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962860999936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143102.325493:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858009472:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16784us (17238us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143102.325501:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5184 00002000:00100000:0.0:1746143102.325510:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008e80e300 x1830962858009472/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:253/0 lens 488/440 e 0 to 0 dl 1746143113 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143102.325519:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80e300 with x1830962858009472 ext(1048576->2097151) 00002000:00010000:0.0:1746143102.325523:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80e300 00000100:00100000:0.0:1746143102.336059:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.336125:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858010112 00000100:00100000:0.0:1746143102.336132:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858010112 00000100:00100000:0.0:1746143102.336162:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10835 00000100:00100000:0.0:1746143102.336169:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:30143:x1830962858010112:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143102.336189:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143102.336204:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3eaa00/0x25aee876ca709941 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dba8 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.336229:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091111e00/0x25aee876ca709933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db9a expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.336235:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143102.336237:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143102.336240:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3eaa00/0x25aee876ca709941 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dba8 expref: 28 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.336266:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091111e00/0x25aee876ca709933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db9a expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.336277:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091111e00/0x25aee876ca709933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db9a expref: 18 pid: 4758 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143102.336290:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861000064:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143102.336333:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143102.349076:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5188 00000100:00100000:0.0:1746143102.349083:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858010496:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143102.353681:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.384672:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858010496:12345-192.168.201.28@tcp:3:cat.0 Request processed in 35578us (35846us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143102.384683:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5188 00002000:00100000:0.0:1746143102.384701:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008e80ed80 x1830962858010496/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:253/0 lens 488/440 e 0 to 0 dl 1746143113 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143102.384710:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80ed80 with x1830962858010496 ext(3145728->4194303) 00002000:00010000:0.0:1746143102.384715:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80ed80 00000100:00100000:0.0:1746143102.390344:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.397814:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858011008 00000100:00100000:0.0:1746143102.397821:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858011008 00010000:00010000:0.0:1746143102.397842:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091111e00/0x25aee876ca709933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db9a expref: 11 pid: 4758 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143102.397860:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5643 00000100:00100000:0.0:1746143102.397866:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858011008:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143102.397876:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143102.397890:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091111e00/0x25aee876ca709933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db9a expref: 11 pid: 4758 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.397899:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091111e00/0x25aee876ca709933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db9a expref: 11 pid: 4758 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.397914:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091111e00/0x25aee876ca709933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db9a expref: 11 pid: 4758 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.397937:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.397939:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.397945:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3eaa00/0x25aee876ca709941 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dba8 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.397962:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3eaa00/0x25aee876ca709941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dba8 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.397988:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3eaa00/0x25aee876ca709941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dba8 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143102.397999:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861000320:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143102.398066:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143102.411713:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858011520 00000100:00100000:0.0:1746143102.411722:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858011520 00002000:00100000:0.0:1746143102.411771:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800a5cca680 x1830962858011520/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:253/0 lens 488/0 e 0 to 0 dl 1746143113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143102.411781:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cca680 with x1830962858011520 ext(1048576->2097151) 00002000:00010000:0.0:1746143102.411785:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5cca680 00000100:00100000:0.0:1746143102.411814:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5190 00000100:00100000:0.0:1746143102.411820:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858011520:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143102.435373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.498173:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.508369:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.508405:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.509324:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858012288 00000100:00100000:0.0:1746143102.509328:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858012288 00010000:00010000:0.0:1746143102.509343:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091111000/0x25aee876ca70987d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db31 expref: 13 pid: 20619 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143102.509371:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5646 00000100:00100000:0.0:1746143102.509377:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1969:x1830962858012288:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143102.509383:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143102.509387:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091111000/0x25aee876ca70987d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db31 expref: 13 pid: 20619 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.509395:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091111000/0x25aee876ca70987d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db31 expref: 13 pid: 20619 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.509406:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091111000/0x25aee876ca70987d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db31 expref: 13 pid: 20619 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.509418:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009b91ac00) 00010000:00010000:0.0:1746143102.509422:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3000/0x25aee876ca70995d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.509429:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3000/0x25aee876ca70995d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.509435:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3000/0x25aee876ca70995d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.509448:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143102.509468:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858012288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.509474:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5646 00000100:00100000:0.0:1746143102.515624:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858012416 00000100:00100000:0.0:1746143102.515632:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858012416 00000100:00100000:0.0:1746143102.515813:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10838 00000100:00100000:0.0:1746143102.515821:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30150:x1830962858012416:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143102.516259:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143102.516277:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093245a00/0x25aee876ca70996b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dbc4 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.516306:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5d1400/0x25aee876ca709788 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da9e expref: 11 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.516486:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132058800/0x25aee876ca709853 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db23 expref: 5 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.516492:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a46e0400/0x25aee876ca7097b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dab3 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.516498:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.516499:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.516502:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245a00/0x25aee876ca70996b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3411968->3424255] (req 3411968->3424255) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbc4 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.516531:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a46e0400/0x25aee876ca7097b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dab3 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.516541:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a46e0400/0x25aee876ca7097b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dab3 expref: 24 pid: 8450 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143102.516552:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861000832:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143102.516641:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132058800/0x25aee876ca709853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db23 expref: 5 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.516649:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132058800/0x25aee876ca709853 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164db23 expref: 5 pid: 8448 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143102.516658:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861000960:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143102.524934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.525022:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.527682:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858013056 00000100:00100000:0.0:1746143102.527688:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858013056 00010000:00010000:0.0:1746143102.527713:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5d1400/0x25aee876ca709788 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da9e expref: 11 pid: 8449 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143102.528180:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5649 00000100:00100000:0.0:1746143102.528187:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858013056:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143102.528196:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143102.528209:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5d1400/0x25aee876ca709788 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da9e expref: 11 pid: 8449 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.528219:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5d1400/0x25aee876ca709788 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da9e expref: 11 pid: 8449 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.528233:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5d1400/0x25aee876ca709788 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164da9e expref: 11 pid: 8449 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143102.528726:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.528728:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.528735:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093245a00/0x25aee876ca70996b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->3424255) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbc4 expref: 10 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.528753:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245a00/0x25aee876ca70996b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->3424255) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbc4 expref: 10 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.528787:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093245a00/0x25aee876ca70996b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->3424255) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbc4 expref: 10 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143102.528801:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861001216:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143102.529260:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143102.534072:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.538420:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.552786:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.565168:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.578967:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.621168:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.633706:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.634954:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.675012:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.685594:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.689958:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.689998:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.700735:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.716174:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.716207:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.769467:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.769509:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.781454:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858017536 00000100:00100000:0.0:1746143102.781464:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858017536 00000100:00100000:0.0:1746143102.781509:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10845 00000100:00100000:0.0:1746143102.781516:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858017536:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143102.781532:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143102.781545:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091110200/0x25aee876ca7099b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dbfc expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.781563:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.781565:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143102.781572:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091110200/0x25aee876ca7099b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbfc expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.781586:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091110200/0x25aee876ca7099b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbfc expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143102.781596:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091110200, rc 0) 00000100:00100000:0.0:1746143102.781652:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858017536:12345-192.168.201.28@tcp:101:cat.0 Request processed in 136us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.781658:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10845 00000100:00100000:0.0:1746143102.791729:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.805144:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.805187:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.810872:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143102.811608:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de000/0x25aee876ca7099cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811615:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de000/0x25aee876ca7099cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:0.0:1746143102.811651:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9132864 00000004:00200000:0.0:1746143102.811655:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143102.811668:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de000/0x25aee876ca7099cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811677:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de000/0x25aee876ca7099cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811684:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca7099bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811690:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca7099bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811696:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca7099bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811701:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3de200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143102.811704:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca7099bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811709:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca7099bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811716:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143102.811719:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143102.811722:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca7099bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811735:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca7099bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811769:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3df600/0x25aee876ca7099c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811775:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3df600/0x25aee876ca7099c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811780:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3df600/0x25aee876ca7099c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811784:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3df600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143102.811787:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3df600/0x25aee876ca7099c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811792:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3df600/0x25aee876ca7099c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811798:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92a00) 00010000:00010000:0.0:1746143102.811800:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143102.811803:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3df600/0x25aee876ca7099c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811807:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3df600/0x25aee876ca7099c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143102.811836:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfa00/0x25aee876ca7099b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc03 expref: 14 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.811848:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de000/0x25aee876ca7099cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc03 expref: 13 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143102.811865:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009b91ac00) 00010000:00010000:0.0:1746143102.811867:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143102.811869:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3de000, rc 0) 00000100:00100000:0.0:1746143102.811892:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30163:x1830962858017664:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 19269us (20173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143102.811899:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7877 00000100:00100000:0.0:1746143102.817191:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.817212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.817237:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.817268:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.821943:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.835514:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.839921:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.841869:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.916189:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.973650:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bacfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858020608:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17157us (18334us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143102.973656:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5201 00002000:00100000:0.0:1746143102.973661:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012bacfb80 x1830962858020608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:253/0 lens 488/440 e 0 to 0 dl 1746143113 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143102.973667:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bacfb80 with x1830962858020608 ext(1048576->2097151) 00002000:00010000:0.0:1746143102.973671:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bacfb80 00000100:00100000:0.0:1746143102.975287:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.975336:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.976296:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.977808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.991410:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143102.998233:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.000497:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5205 00000100:00100000:0.0:1746143103.000504:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bacea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858022400:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143103.001817:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bacea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858022400:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1311us (1536us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143103.001824:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5205 00002000:00100000:0.0:1746143103.001830:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (4177920->4182015) req@ffff88012bacea00 x1830962858022400/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:254/0 lens 488/4536 e 0 to 0 dl 1746143114 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143103.001839:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bacea00 with x1830962858022400 ext(4177920->4182015) 00002000:00010000:0.0:1746143103.001843:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bacea00 00000100:00100000:0.0:1746143103.018998:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.038155:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.038190:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.038255:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.038287:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858022784 00000100:00100000:0.0:1746143103.038294:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858022784 00000100:00100000:0.0:1746143103.038322:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858022912 00000100:00100000:0.0:1746143103.038324:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858022912 00000100:00100000:0.0:1746143103.038347:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10855 00000100:00100000:0.0:1746143103.038354:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30172:x1830962858022784:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143103.038541:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143103.038555:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091111e00/0x25aee876ca709a4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dc5e expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.038591:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca709a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc42 expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.038598:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143103.038599:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143103.038603:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091111e00/0x25aee876ca709a4b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc5e expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.038632:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca709a2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc42 expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.038643:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca709a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc42 expref: 11 pid: 4758 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143103.038654:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861004288:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143103.038717:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143103.041802:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858023040 00000100:00100000:0.0:1746143103.041808:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858023040 00002000:00100000:0.0:1746143103.041830:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (4177920->4194303) req@ffff88012bacce00 x1830962858023040/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:254/0 lens 16872/0 e 0 to 0 dl 1746143114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143103.041838:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bacce00 with x1830962858023040 ext(4177920->4194303) 00010000:00010000:0.0:1746143103.041844:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca709a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc42 expref: 12 pid: 4758 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143103.041854:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca709a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc42 expref: 12 pid: 4758 timeout: 984 lvb_type: 0 00002000:00010000:0.0:1746143103.041866:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bacce00 00000100:00100000:0.0:1746143103.041880:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1730 00000100:00100000:0.0:1746143103.041885:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bacce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858023040:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143103.042266:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bacce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858023040:12345-192.168.201.28@tcp:4:cat.0 Request processed in 379us (903us total) trans 17179872521 rc 0/0 00000100:00100000:0.0:1746143103.042272:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1730 00002000:00100000:0.0:1746143103.042278:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (4177920->4194303) req@ffff88012bacce00 x1830962858023040/t17179872521(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:254/0 lens 16872/448 e 0 to 0 dl 1746143114 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143103.042285:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bacce00 with x1830962858023040 ext(4177920->4194303) 00010000:00010000:0.0:1746143103.042290:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca709a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc42 expref: 14 pid: 4758 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143103.042298:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca709a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc42 expref: 14 pid: 4758 timeout: 984 lvb_type: 0 00002000:00010000:0.0:1746143103.042303:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bacce00 00000100:00100000:0.0:1746143103.045532:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.055244:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.077114:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.086781:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.087154:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.116028:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.117466:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858024576 00000100:00100000:0.0:1746143103.117471:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858024576 00000100:00100000:0.0:1746143103.117513:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3278 00000100:00100000:0.0:1746143103.117519:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009499b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:30162:x1830962858024576:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:0.0:1746143103.117766:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009499b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:30162:x1830962858024576:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 246us (1211us total) trans 8589942060 rc 0/0 00000100:00100000:0.0:1746143103.117800:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3278 00000100:00100000:0.0:1746143103.123971:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.156627:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.157597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.167375:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.167416:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.167441:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.167480:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.168199:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5212 00000100:00100000:0.0:1746143103.168207:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858026112:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143103.216762:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.220102:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.369026:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.376336:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.387586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.393986:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.401279:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.471227:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.485886:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.485921:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.487384:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.487422:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858027904 00000100:00100000:0.0:1746143103.488285:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858027904 00010000:00010000:0.0:1746143103.488301:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5dfe600/0x25aee876ca709a67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc7a expref: 13 pid: 21048 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143103.489062:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5670 00000100:00100000:0.0:1746143103.489069:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858027904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143103.489077:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143103.489088:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5dfe600/0x25aee876ca709a67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc7a expref: 13 pid: 21048 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143103.489098:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5dfe600/0x25aee876ca709a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc7a expref: 13 pid: 21048 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143103.489111:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dfe600/0x25aee876ca709a67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc7a expref: 13 pid: 21048 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143103.489124:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143103.489126:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143103.489131:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132eb3800/0x25aee876ca709a8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc8f expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.489138:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb3800/0x25aee876ca709a8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc8f expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.489163:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132eb3800/0x25aee876ca709a8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc8f expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143103.489174:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861005952:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143103.489246:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143103.494280:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b59a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861005952:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143103.494301:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143103.494547:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858027904:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5478us (8624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143103.497064:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5670 00000100:00100000:0.0:1746143103.500796:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.500849:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.502117:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.502306:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858028544 00000100:00100000:0.0:1746143103.502311:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858028544 00000100:00100000:0.0:1746143103.502417:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10862 00000100:00100000:0.0:1746143103.502430:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:30179:x1830962858028416:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143103.502473:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143103.502491:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d523a00/0x25aee876ca709a91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dc96 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.502516:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e550a00/0x25aee876ca709a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc88 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.502524:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143103.502525:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143103.502529:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d523a00/0x25aee876ca709a91 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->2965503] (req 2097152->2965503) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc96 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.502557:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e550a00/0x25aee876ca709a83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3952639) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc88 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.502636:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e550a00/0x25aee876ca709a83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3952639) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc88 expref: 13 pid: 4758 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143103.502647:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861006080:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143103.502706:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143103.505467:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861006080:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143103.505484:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d523a00/0x25aee876ca709a91 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->2965503] (req 2097152->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc96 expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.505494:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d523a00, rc 0) 00000100:00100000:0.0:1746143103.505512:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30179:x1830962858028416:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3084us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143103.505517:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10862 00000100:00100000:0.0:1746143103.538794:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.565984:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.567490:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.577942:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.578066:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.578097:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.578754:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1734 00000100:00100000:0.0:1746143103.578762:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1971:x1830962858029952:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143103.594791:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.640240:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.640300:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.649092:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.649120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.649995:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.651451:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.651468:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858032256 00000100:00100000:0.0:1746143103.651472:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858032256 00010000:00010000:0.0:1746143103.651487:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091110200/0x25aee876ca7099b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbfc expref: 27 pid: 8449 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143103.651505:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5674 00000100:00100000:0.0:1746143103.651510:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858032256:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143103.651518:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143103.651531:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091110200/0x25aee876ca7099b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbfc expref: 27 pid: 8449 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143103.651540:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091110200/0x25aee876ca7099b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbfc expref: 27 pid: 8449 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143103.651554:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091110200/0x25aee876ca7099b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dbfc expref: 27 pid: 8449 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143103.651570:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143103.651596:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858032256:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 85us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143103.651603:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5674 00000100:00100000:0.0:1746143103.658886:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.677355:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.685577:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.690524:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.694211:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.702382:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.708338:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.726594:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.726649:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.736519:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.741085:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.741116:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.756403:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.756455:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.768598:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.778077:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.788929:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.796335:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.805201:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.820265:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.825793:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.830601:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.830626:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858036096 00000100:00100000:0.0:1746143103.830631:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858036096 00000100:00100000:0.0:1746143103.836890:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.851469:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.893346:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.898103:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.914980:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.928690:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.981916:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.983400:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.983511:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143103.983529:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858037632 00000100:00100000:0.0:1746143103.983537:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858037632 00000100:00100000:0.0:1746143103.984430:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858037760 00000100:00100000:0.0:1746143103.984435:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858037760 00000100:00100000:0.0:1746143103.985590:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10881 00000100:00100000:0.0:1746143103.985597:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858037760:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143103.985633:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143103.985645:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b2735200/0x25aee876ca709b16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dd1b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143103.986010:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143103.986012:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143103.986020:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b2735200/0x25aee876ca709b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd1b expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143103.986091:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b2735200/0x25aee876ca709b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd1b expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143103.986101:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2735200, rc 0) 00000100:00100000:0.0:1746143103.986125:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858037760:12345-192.168.201.28@tcp:101:cat.0 Request processed in 529us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143103.986132:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10881 00000100:00100000:0.0:1746143103.986148:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10882 00000100:00100000:0.0:1746143103.986153:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858037888:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143103.986168:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143104.008206:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.023485:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.041097:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.044801:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.048731:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.048770:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.055597:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.061151:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.062609:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.070006:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.081844:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.087985:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.116369:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.123972:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.123999:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.125176:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.127308:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.130107:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5237 00000100:00100000:0.0:1746143104.130116:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858040832:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143104.172689:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.179219:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861011200:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143104.179231:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861011328:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143104.179258:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e19c00/0x25aee876ca709b39 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2945024->3145727] (req 2945024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd3e expref: 31 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.179287:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e19c00, rc 0) 00000100:00100000:0.0:1746143104.179783:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:30205:x1830962858041472:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6839us (9898us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143104.179791:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10886 00000100:00100000:0.0:1746143104.182230:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.182316:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.189000:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.189642:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.189663:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858041856 00000100:00100000:0.0:1746143104.189672:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858041856 00000100:00100000:0.0:1746143104.189702:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858041984 00000100:00100000:0.0:1746143104.189704:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858041984 00000100:00100000:0.0:1746143104.189974:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10887 00000100:00100000:0.0:1746143104.189983:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:30206:x1830962858041856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143104.190000:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143104.190015:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b2734800/0x25aee876ca709b40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dd45 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.190060:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e19c00/0x25aee876ca709b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd3e expref: 32 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.190068:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143104.190070:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143104.190072:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b2734800/0x25aee876ca709b40 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd45 expref: 32 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.190112:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e19c00/0x25aee876ca709b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd3e expref: 32 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.190123:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e19c00/0x25aee876ca709b39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd3e expref: 32 pid: 8169 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143104.190136:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861011584:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143104.191195:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143104.195692:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.205196:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.205238:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.215249:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.218667:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.223643:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.258635:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.258688:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.276928:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.276966:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.278690:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.278763:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858043904 00000100:00100000:0.0:1746143104.278767:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858043904 00000100:00100000:0.0:1746143104.278786:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858043776 00000100:00100000:0.0:1746143104.278788:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858043776 00000100:00100000:0.0:1746143104.278810:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10890 00000100:00100000:0.0:1746143104.278816:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858043904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143104.278833:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143104.278842:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca709b55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dd61 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.278854:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143104.278855:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143104.278860:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca709b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd61 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143104.278870:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca709b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd61 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143104.278878:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2734a00, rc 0) 00000100:00100000:0.0:1746143104.278901:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858043904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 85us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143104.278907:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10890 00000100:00100000:0.0:1746143104.278918:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10891 00000100:00100000:0.0:1746143104.278923:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858043776:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143104.278930:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143104.278937:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b2734000/0x25aee876ca709b5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dd5a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143104.278972:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861012224:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143104.279024:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143104.279172:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858043264:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 18992us (20545us total) trans 0 rc 577536/577536 00000100:00100000:0.0:1746143104.279186:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5242 00002000:00100000:0.0:1746143104.279194:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3616768->4194303) req@ffff880092a73800 x1830962858043264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:255/0 lens 488/440 e 0 to 0 dl 1746143115 ref 1 fl Complete:/200/0 rc 577536/577536 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.279202:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73800 with x1830962858043264 ext(3616768->4194303) 00002000:00010000:0.0:1746143104.279206:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a73800 00000100:00100000:0.0:1746143104.302466:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.302501:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.302524:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.302637:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.302667:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.302703:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858044032 00000100:00100000:0.0:1746143104.302710:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858044032 00000100:00100000:0.0:1746143104.302750:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858044928 00000100:00100000:0.0:1746143104.302937:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858044928 00000100:00100000:0.0:1746143104.302953:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10892 00000100:00100000:0.0:1746143104.302960:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858044032:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143104.302978:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143104.302994:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca709b63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dd68 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143104.303066:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861012352:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143104.303137:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143104.303216:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10893 00000100:00100000:0.0:1746143104.303223:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858044928:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143104.303231:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143104.303248:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca709b6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dd6f expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143104.303272:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861012480:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143104.303295:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143104.303561:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858044416 00000100:00100000:0.0:1746143104.303564:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858044416 00002000:00100000:0.0:1746143104.303590:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->888831) req@ffff880092a73b80 x1830962858044416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:255/0 lens 488/0 e 0 to 0 dl 1746143115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.303598:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73b80 with x1830962858044416 ext(0->888831) 00002000:00010000:0.0:1746143104.303602:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a73b80 00000100:00100000:0.0:1746143104.303612:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858044672 00000100:00100000:0.0:1746143104.303614:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858044672 00002000:00100000:0.0:1746143104.303623:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880092a70a80 x1830962858044672/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:255/0 lens 488/0 e 0 to 0 dl 1746143115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.303629:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70a80 with x1830962858044672 ext(1048576->2097151) 00002000:00010000:0.0:1746143104.303631:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a70a80 00000100:00100000:0.0:1746143104.303639:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858044544 00000100:00100000:0.0:1746143104.303641:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858044544 00002000:00100000:0.0:1746143104.303650:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1720320->2097151) req@ffff880092a70380 x1830962858044544/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:255/0 lens 488/0 e 0 to 0 dl 1746143115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.303655:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70380 with x1830962858044544 ext(1720320->2097151) 00002000:00010000:0.0:1746143104.303658:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a70380 00000100:00100000:0.0:1746143104.303666:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5244 00000100:00100000:0.0:1746143104.303671:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858044416:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143104.328432:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.330125:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858044416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26451us (27666us total) trans 0 rc 888832/888832 00000100:00100000:0.0:1746143104.330133:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5244 00002000:00100000:0.0:1746143104.330140:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->888831) req@ffff880092a73b80 x1830962858044416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:255/0 lens 488/440 e 0 to 0 dl 1746143115 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.330147:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73b80 with x1830962858044416 ext(0->888831) 00002000:00010000:0.0:1746143104.330152:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a73b80 00000100:00100000:0.0:1746143104.330164:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858045184 00000100:00100000:0.0:1746143104.330169:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858045184 00002000:00100000:0.0:1746143104.330193:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800942c7100 x1830962858045184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:255/0 lens 488/0 e 0 to 0 dl 1746143115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.330200:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7100 with x1830962858045184 ext(4194304->5210111) 00002000:00010000:0.0:1746143104.330203:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c7100 00000100:00100000:0.0:1746143104.333105:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5247 00000100:00100000:0.0:1746143104.333117:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858045184:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143104.346679:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858045184:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13556us (18237us total) trans 0 rc 1015808/1015808 00000100:00100000:0.0:1746143104.346691:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5247 00002000:00100000:0.0:1746143104.346702:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800942c7100 x1830962858045184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:255/0 lens 488/440 e 0 to 0 dl 1746143115 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.346711:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7100 with x1830962858045184 ext(4194304->5210111) 00002000:00010000:0.0:1746143104.346729:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c7100 00000100:00100000:0.0:1746143104.353203:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.354086:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.354702:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.361631:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.361653:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858045696 00000100:00100000:0.0:1746143104.361659:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858045696 00002000:00100000:0.0:1746143104.361691:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3616767) req@ffff8800942c4000 x1830962858045696/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:255/0 lens 488/0 e 0 to 0 dl 1746143115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.361698:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4000 with x1830962858045696 ext(3145728->3616767) 00010000:00010000:0.0:1746143104.361704:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a56c7e00/0x25aee876ca709b47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd4c expref: 21 pid: 8169 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143104.361965:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a56c7e00/0x25aee876ca709b47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd4c expref: 21 pid: 8169 timeout: 986 lvb_type: 0 00002000:00010000:0.0:1746143104.361972:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c4000 00000100:00100000:0.0:1746143104.361988:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1743 00000100:00100000:0.0:1746143104.361994:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858045696:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143104.382174:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.383186:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.392212:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.409058:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858046720 00000100:00100000:0.0:1746143104.409069:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858046720 00002000:00100000:0.0:1746143104.409108:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008e037480 x1830962858046720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:255/0 lens 488/0 e 0 to 0 dl 1746143115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.409118:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e037480 with x1830962858046720 ext(3145728->4194303) 00002000:00010000:0.0:1746143104.409123:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e037480 00000100:00100000:0.0:1746143104.409150:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5249 00000100:00100000:0.0:1746143104.409163:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858046720:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143104.417447:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.417465:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.417498:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.422757:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5251 00000100:00100000:0.0:1746143104.422765:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858047232:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:0.0:1746143104.457232:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143104.471139:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.500972:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.506487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.508087:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.516503:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.536668:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.581497:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.581529:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.581560:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.591693:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.602158:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858049280 00000100:00100000:0.0:1746143104.602164:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858049280 00002000:00100000:0.0:1746143104.602195:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fc:0x0] (888832->1048575) req@ffff88008e80fb80 x1830962858049280/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:255/0 lens 488/0 e 0 to 0 dl 1746143115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.602203:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80fb80 with x1830962858049280 ext(888832->1048575) 00010000:00010000:0.0:1746143104.602209:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a315a00/0x25aee876ca709b2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 888832->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd30 expref: 13 pid: 8169 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143104.602220:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a315a00/0x25aee876ca709b2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 888832->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd30 expref: 13 pid: 8169 timeout: 986 lvb_type: 0 00002000:00010000:0.0:1746143104.602233:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e80fb80 00000100:00100000:0.0:1746143104.603097:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1744 00000100:00100000:0.0:1746143104.603105:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858049280:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143104.612361:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.622191:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.645345:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.645399:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.660317:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.660403:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.670840:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.671082:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858050432 00000100:00100000:0.0:1746143104.671090:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858050432 00002000:00100000:0.0:1746143104.671130:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (700416->704511) req@ffff880092aef100 x1830962858050432/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:255/0 lens 488/0 e 0 to 0 dl 1746143115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.671141:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aef100 with x1830962858050432 ext(700416->704511) 00002000:00010000:0.0:1746143104.671146:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aef100 00000100:00100000:0.0:1746143104.674452:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5257 00000100:00100000:0.0:1746143104.674465:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858050432:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143104.674619:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858050432:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 157us (3785us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143104.674626:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5257 00002000:00100000:0.0:1746143104.674633:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (700416->704511) req@ffff880092aef100 x1830962858050432/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:255/0 lens 488/4536 e 0 to 0 dl 1746143115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143104.674660:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aef100 with x1830962858050432 ext(700416->704511) 00002000:00010000:0.0:1746143104.674665:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aef100 00000100:00100000:0.0:1746143104.682435:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.689240:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.689342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.701011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.701098:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.708019:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.714239:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.738320:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.738421:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.746105:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.749737:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.769190:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.772297:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858052736 00000100:00100000:0.0:1746143104.772301:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858052736 00000100:00100000:0.0:1746143104.772325:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10912 00000100:00100000:0.0:1746143104.772330:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858052736:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143104.772336:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143104.772343:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5376000/0x25aee876ca709bef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dded expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143104.772375:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861015936:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143104.772618:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143104.773865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.775301:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861015808:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143104.775334:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090cef800/0x25aee876ca709be1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dde6 expref: 15 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143104.775346:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090cef800/0x25aee876ca709be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dde6 expref: 15 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143104.775663:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090cef800, rc 0) 00000100:00100000:0.0:1746143104.775717:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858052608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6027us (6519us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143104.775725:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10910 00000100:00100000:0.0:1746143104.780893:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.784375:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.790511:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.807013:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.807603:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.811044:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.815646:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.824398:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.835259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.838204:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858054912 00000100:00100000:0.0:1746143104.838207:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858054912 00000100:00100000:0.0:1746143104.838228:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10915 00000100:00100000:0.0:1746143104.838237:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30229:x1830962858054912:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143104.838245:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143104.838259:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a46ee000/0x25aee876ca709c04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164de09 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.838292:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba7400/0x25aee876ca709bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ddd1 expref: 32 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.838298:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143104.838300:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143104.838302:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a46ee000/0x25aee876ca709c04 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de09 expref: 21 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.838327:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba7400/0x25aee876ca709bcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ddd1 expref: 32 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143104.838338:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba7400/0x25aee876ca709bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ddd1 expref: 32 pid: 10061 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143104.838348:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861016832:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143104.839582:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143104.846434:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.862384:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.889939:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.916175:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.920339:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.942998:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.961803:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143104.962147:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.041769:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.051341:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.060125:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.080382:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.080439:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.083770:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5709 00000100:00100000:0.0:1746143105.083812:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1968:x1830962858057472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143105.083832:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143105.083854:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b2734800/0x25aee876ca709b40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd45 expref: 36 pid: 8449 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143105.083868:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b2734800/0x25aee876ca709b40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd45 expref: 36 pid: 8449 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143105.083886:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b2734800/0x25aee876ca709b40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dd45 expref: 36 pid: 8449 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143105.083903:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143105.083905:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143105.083911:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf800/0x25aee876ca709c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de2c expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143105.083918:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf800/0x25aee876ca709c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de2c expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143105.083941:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf800/0x25aee876ca709c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de2c expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143105.083949:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861017472:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143105.089303:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143105.092586:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.092620:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861017472:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143105.092629:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143105.092648:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858057472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8870us (12276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143105.092657:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5709 00000100:00100000:0.0:1746143105.104110:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.116560:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.116662:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.116719:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.117485:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10925 00000100:00100000:0.0:1746143105.117492:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858058624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143105.117500:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143105.117508:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b16c000/0x25aee876ca709c43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164de4f expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143105.117527:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b16c000/0x25aee876ca709c43 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de4f expref: 24 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143105.117536:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b16c000/0x25aee876ca709c43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de4f expref: 24 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143105.117548:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b16c000, rc 0) 00000100:00100000:0.0:1746143105.117587:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858058624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 94us (866us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143105.117604:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10925 00000100:00100000:0.0:1746143105.130594:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.130637:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.142017:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.142100:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.148558:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.149026:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.161227:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.168458:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.168488:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.168506:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858060672 00000100:00100000:0.0:1746143105.168513:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858060672 00002000:00100000:0.0:1746143105.169217:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800906a4000 x1830962858060672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:256/0 lens 488/0 e 0 to 0 dl 1746143116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143105.169227:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a4000 with x1830962858060672 ext(1048576->2097151) 00002000:00010000:0.0:1746143105.169230:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a4000 00000100:00100000:0.0:1746143105.189023:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858061056 00000100:00100000:0.0:1746143105.189026:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858061056 00000100:00100000:0.0:1746143105.189077:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10930 00000100:00100000:0.0:1746143105.189084:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858061056:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143105.189099:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143105.189113:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b16c800/0x25aee876ca709c6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164de72 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143105.189804:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143105.189816:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b16c800/0x25aee876ca709c6d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de72 expref: 19 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143105.189835:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b16c800/0x25aee876ca709c6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de72 expref: 19 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143105.189850:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b16c800, rc 0) 00000100:00100000:0.0:1746143105.189905:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858061056:12345-192.168.201.28@tcp:101:cat.0 Request processed in 820us (1215us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143105.189911:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10930 00000100:00100000:0.0:1746143105.193556:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.202295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.202454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.212325:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.215787:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.216146:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.227204:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.229778:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.233776:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858062464:12345-192.168.201.28@tcp:4:cat.0 Request processed in 3573us (3990us total) trans 21474839766 rc 0/0 00000100:00100000:0.0:1746143105.233792:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1754 00002000:00100000:0.0:1746143105.233801:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4460543) req@ffff88009c1e9880 x1830962858062464/t21474839766(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:256/0 lens 488/448 e 0 to 0 dl 1746143116 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143105.233812:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9880 with x1830962858062464 ext(4194304->4460543) 00010000:00010000:0.0:1746143105.233821:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a275c00/0x25aee876ca709c58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de5d expref: 19 pid: 20836 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143105.233847:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a275c00/0x25aee876ca709c58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de5d expref: 19 pid: 20836 timeout: 987 lvb_type: 0 00002000:00010000:0.0:1746143105.233854:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1e9880 00000100:00100000:0.0:1746143105.235658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.240869:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.262620:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.275804:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.305369:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.306293:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.310321:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.312604:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.323960:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.323996:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.325110:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.346840:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.355726:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.361202:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.361303:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.367142:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.371408:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858065280 00000100:00100000:0.0:1746143105.371416:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858065280 00002000:00100000:0.0:1746143105.371454:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3809280->4194303) req@ffff88009b59b480 x1830962858065280/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:256/0 lens 488/0 e 0 to 0 dl 1746143116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143105.371464:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b480 with x1830962858065280 ext(3809280->4194303) 00010000:00010000:0.0:1746143105.371473:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf200/0x25aee876ca709c35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de3a expref: 21 pid: 4758 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143105.371497:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf200/0x25aee876ca709c35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de3a expref: 21 pid: 4758 timeout: 987 lvb_type: 0 00002000:00010000:0.0:1746143105.371504:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b59b480 00000100:00100000:0.0:1746143105.371522:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1756 00000100:00100000:0.0:1746143105.371529:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858065280:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143105.396256:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.405258:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.435530:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.459905:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.459931:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.459943:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.459957:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.459979:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858066048 00000100:00100000:0.0:1746143105.459987:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858066048 00000100:00100000:0.0:1746143105.465097:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858066176 00000100:00100000:0.0:1746143105.465110:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858066176 00000100:00100000:0.0:1746143105.467171:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858065920:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31336us (31648us total) trans 0 rc 1015808/1015808 00000100:00100000:0.0:1746143105.467178:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5283 00002000:00100000:0.0:1746143105.467186:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093b8b480 x1830962858065920/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:256/0 lens 488/440 e 0 to 0 dl 1746143116 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143105.467193:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8b480 with x1830962858065920 ext(4194304->5210111) 00002000:00010000:0.0:1746143105.467197:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b8b480 00000100:00100000:0.0:1746143105.479618:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.486320:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.506866:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.518518:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.552216:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.555273:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.565223:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.576112:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.625261:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.628326:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.628591:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.630389:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858068224 00000100:00100000:0.0:1746143105.630395:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858068224 00010000:00010000:0.0:1746143105.630521:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a274a00/0x25aee876ca709c97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de9c expref: 39 pid: 8449 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143105.630543:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5724 00000100:00100000:0.0:1746143105.630550:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1969:x1830962858068224:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143105.630558:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143105.630574:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a274a00/0x25aee876ca709c97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de9c expref: 39 pid: 8449 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143105.630586:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a274a00/0x25aee876ca709c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de9c expref: 39 pid: 8449 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143105.630607:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143105.630630:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1969:x1830962858068224:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 81us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143105.630636:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5724 00000100:00100000:0.0:1746143105.630761:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858068480 00000100:00100000:0.0:1746143105.630765:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858068480 00002000:00100000:0.0:1746143105.630781:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008e037800 x1830962858068480/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:256/0 lens 488/0 e 0 to 0 dl 1746143116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143105.630789:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e037800 with x1830962858068480 ext(3145728->4194303) 00002000:00010000:0.0:1746143105.630793:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e037800 00000100:00100000:0.0:1746143105.631046:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5287 00000100:00100000:0.0:1746143105.631053:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858068480:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143105.638188:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861021824:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143105.659217:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.662308:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.683017:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.690186:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.724618:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.729717:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.753410:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861022592:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143105.753432:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143105.753468:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e036d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858070272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8169us (11347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143105.753476:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5728 00000100:00100000:0.0:1746143105.754900:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.754996:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b599500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861022848:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143105.755016:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a6e00/0x25aee876ca709d07 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df05 expref: 28 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143105.755058:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a6e00/0x25aee876ca709d07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df05 expref: 28 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143105.755070:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a6e00, rc 0) 00000100:00100000:0.0:1746143105.755096:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858070656:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7510us (7599us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143105.755103:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 10952 00000100:00100000:0.0:1746143105.767584:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.767620:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.769553:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5290 00000100:00100000:0.0:1746143105.772478:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858071680 00000100:00100000:0.0:1746143105.772488:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858071680 00010000:00010000:0.0:1746143105.772521:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf600/0x25aee876ca709cdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dee2 expref: 27 pid: 8449 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143105.772549:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5729 00000100:00100000:0.0:1746143105.772555:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858071680:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143105.772567:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143105.772586:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf600/0x25aee876ca709cdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2293760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dee2 expref: 27 pid: 8449 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143105.772598:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf600/0x25aee876ca709cdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2293760->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dee2 expref: 27 pid: 8449 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143105.772620:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf600/0x25aee876ca709cdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2293760->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dee2 expref: 27 pid: 8449 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143105.772644:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143105.772647:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143105.772655:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a400/0x25aee876ca709ce4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dee9 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143105.772664:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a400/0x25aee876ca709ce4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dee9 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143105.772706:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a400/0x25aee876ca709ce4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dee9 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143105.772717:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861022976:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143105.772780:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143105.809409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.817051:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.819159:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858072576 00000100:00100000:0.0:1746143105.819163:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858072576 00002000:00100000:0.0:1746143105.819181:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009b59ad80 x1830962858072576/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:256/0 lens 488/0 e 0 to 0 dl 1746143116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143105.819189:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59ad80 with x1830962858072576 ext(3145728->4194303) 00002000:00010000:0.0:1746143105.819192:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59ad80 00000100:00100000:0.0:1746143105.819553:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5293 00000100:00100000:0.0:1746143105.819559:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858072576:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143105.849852:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.849924:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.863118:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.880643:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.880711:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.910796:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.913785:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.922717:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.929186:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.951377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.951416:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.951441:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.951480:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143105.951508:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858074496 00000100:00100000:0.0:1746143105.951514:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858074496 00002000:00100000:0.0:1746143105.951549:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009f4fc380 x1830962858074496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:256/0 lens 488/0 e 0 to 0 dl 1746143116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143105.951558:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830962858074496 ext(3145728->4194303) 00002000:00010000:0.0:1746143105.951564:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fc380 00000100:00100000:0.0:1746143105.951932:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858074752 00000100:00100000:0.0:1746143105.951936:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858074752 00002000:00100000:0.0:1746143105.951954:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009f4ff480 x1830962858074752/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:256/0 lens 488/0 e 0 to 0 dl 1746143116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143105.951962:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff480 with x1830962858074752 ext(2097152->3145727) 00002000:00010000:0.0:1746143105.951965:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ff480 00000100:00100000:0.0:1746143105.951982:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5296 00000100:00100000:0.0:1746143105.951989:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858074368:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143106.036553:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.043783:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861023744:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143106.047122:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.048484:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858075648 00000100:00100000:0.0:1746143106.048489:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858075648 00010000:00010000:0.0:1746143106.048506:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a275c00/0x25aee876ca709d2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df2f expref: 21 pid: 20836 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143106.048530:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858075904 00000100:00100000:0.0:1746143106.048532:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858075904 00010000:00010000:0.0:1746143106.048549:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5d0a00/0x25aee876ca709d15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df1a expref: 39 pid: 8449 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143106.048562:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5732 00000100:00100000:0.0:1746143106.048568:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858075648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143106.048575:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143106.048585:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a275c00/0x25aee876ca709d2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df2f expref: 21 pid: 20836 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143106.048595:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a275c00/0x25aee876ca709d2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df2f expref: 21 pid: 20836 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143106.048608:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a275c00/0x25aee876ca709d2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df2f expref: 21 pid: 20836 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143106.048620:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143106.048661:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858075648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 93us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.048667:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5732 00000100:00100000:0.0:1746143106.048679:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5733 00000100:00100000:0.0:1746143106.048697:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1970:x1830962858075904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143106.048704:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143106.048713:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5d0a00/0x25aee876ca709d15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df1a expref: 39 pid: 8449 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143106.048722:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5d0a00/0x25aee876ca709d15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df1a expref: 39 pid: 8449 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143106.048733:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5d0a00/0x25aee876ca709d15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df1a expref: 39 pid: 8449 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143106.048742:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.048744:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.048750:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdcfc00/0x25aee876ca709d31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df3d expref: 25 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.048757:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdcfc00/0x25aee876ca709d31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df3d expref: 25 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.048784:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdcfc00/0x25aee876ca709d31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df3d expref: 25 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143106.048796:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861024128:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143106.048851:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00080000:0.0:1746143106.048874:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143106.055135:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.062167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.064648:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.064694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.065633:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10961 00000100:00100000:0.0:1746143106.075250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.075360:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.077973:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.083613:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.086018:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.103748:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.104020:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.110731:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.115769:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.119229:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.119374:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.119641:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.120833:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.122273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.122484:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.122534:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.134369:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.144064:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858079616 00000100:00100000:0.0:1746143106.144075:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858079616 00002000:00100000:0.0:1746143106.144124:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3915776->3919871) req@ffff88009b599180 x1830962858079616/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:257/0 lens 488/0 e 0 to 0 dl 1746143117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143106.144146:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599180 with x1830962858079616 ext(3915776->3919871) 00002000:00010000:0.0:1746143106.144152:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b599180 00000100:00100000:0.0:1746143106.144188:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5304 00000100:00100000:0.0:1746143106.144198:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1969:x1830962858079616:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143106.144388:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1969:x1830962858079616:12345-192.168.201.28@tcp:3:cat.0 Request processed in 190us (456us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143106.144395:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5304 00002000:00100000:0.0:1746143106.144402:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3915776->3919871) req@ffff88009b599180 x1830962858079616/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:257/0 lens 488/4536 e 0 to 0 dl 1746143117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143106.144410:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599180 with x1830962858079616 ext(3915776->3919871) 00002000:00010000:0.0:1746143106.144413:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b599180 00000100:00100000:0.0:1746143106.158238:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.166011:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.190155:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.203249:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.203297:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.203778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.204337:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5306 00000100:00100000:0.0:1746143106.204343:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1968:x1830962858080256:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143106.236105:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.275646:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.286844:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.295978:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.296300:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143106.297132:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4800/0x25aee876ca709d85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297140:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4800/0x25aee876ca709d85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:0.0:1746143106.297193:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143106.297199:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143106.297218:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4800/0x25aee876ca709d85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297228:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4800/0x25aee876ca709d85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297239:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4400/0x25aee876ca709d77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297245:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4400/0x25aee876ca709d77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297252:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4400/0x25aee876ca709d77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297257:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a51b4400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143106.297261:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4400/0x25aee876ca709d77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297267:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4400/0x25aee876ca709d77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297276:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143106.297278:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143106.297282:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4400/0x25aee876ca709d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297295:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4400/0x25aee876ca709d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297313:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4600/0x25aee876ca709d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297318:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4600/0x25aee876ca709d7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297322:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4600/0x25aee876ca709d7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297327:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a51b4600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143106.297329:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4600/0x25aee876ca709d7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297334:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4600/0x25aee876ca709d7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297341:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c1ae000) 00010000:00010000:0.0:1746143106.297343:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143106.297345:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4600/0x25aee876ca709d7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297349:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4600/0x25aee876ca709d7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.297383:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4200/0x25aee876ca709d70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df75 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.297395:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b4800/0x25aee876ca709d85 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df75 expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.297411:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009b91ac00) 00010000:00010000:0.0:1746143106.297413:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143106.297415:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51b4800, rc 0) 00000100:00100000:0.0:1746143106.297441:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30268:x1830962858081152:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 21504us (21809us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.297448:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7882 00000100:00100000:0.0:1746143106.300775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.311183:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.318166:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.325760:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.329231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.333950:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.339077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.339121:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.339163:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.343326:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 10975 00000100:00100000:0.0:1746143106.343336:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858083712:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143106.343588:0:8449:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.343602:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdcf400/0x25aee876ca709cd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dedb expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.343610:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba92e00/0x25aee876ca709d93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df83 expref: 10 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143106.343634:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a6c00/0x25aee876ca709d00 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164defe expref: 39 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143106.343639:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.343641:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.343643:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.343662:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54a6c00/0x25aee876ca709d00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164defe expref: 39 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143106.343672:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a6c00/0x25aee876ca709d00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164defe expref: 39 pid: 20836 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143106.343696:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861027328:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143106.366346:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.366385:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.366409:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.366426:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.366448:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.366688:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.366714:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858084480 00000100:00100000:0.0:1746143106.366923:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858084480 00010000:00010000:0.0:1746143106.366957:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4c00/0x25aee876ca709d8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df7c expref: 11 pid: 8449 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143106.366996:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858084864 00000100:00100000:0.0:1746143106.366998:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858084864 00010000:00010000:0.0:1746143106.367008:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090cefc00/0x25aee876ca709bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dddf expref: 40 pid: 8449 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746143106.367016:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858084352 00000100:00100000:0.0:1746143106.367018:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858084352 00010000:00010000:0.0:1746143106.367025:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdcfa00/0x25aee876ca709ccf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ded4 expref: 21 pid: 8449 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746143106.367055:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858084736 00000100:00100000:0.0:1746143106.367057:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858084736 00010000:00010000:0.0:1746143106.367065:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a6a00/0x25aee876ca709cf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164def7 expref: 29 pid: 10061 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143106.367071:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858084992 00000100:00100000:0.0:1746143106.367073:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858084992 00010000:00010000:0.0:1746143106.367080:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba92800/0x25aee876ca709da1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df8a expref: 11 pid: 20836 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143106.367086:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858084608 00000100:00100000:0.0:1746143106.367088:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858084608 00010000:00010000:0.0:1746143106.367094:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba92600/0x25aee876ca709d9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df91 expref: 12 pid: 20836 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143106.367103:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5742 00000100:00100000:0.0:1746143106.367109:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858084480:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143106.367128:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143106.367151:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4c00/0x25aee876ca709d8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df7c expref: 12 pid: 8449 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.367162:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4c00/0x25aee876ca709d8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df7c expref: 12 pid: 8449 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.368260:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4c00/0x25aee876ca709d8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164df7c expref: 12 pid: 8449 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.368285:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143106.368301:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858084480:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1192us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.368307:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5742 00000100:00100000:0.0:1746143106.368436:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858085120 00000100:00100000:0.0:1746143106.368439:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858085120 00010000:00010000:0.0:1746143106.368449:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea7a400/0x25aee876ca709c19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164de1e expref: 28 pid: 8449 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746143106.369607:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861027328:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143106.371669:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858085760 00000100:00100000:0.0:1746143106.371674:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858085760 00010000:00010000:0.0:1746143106.371699:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e550400/0x25aee876ca7099db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc18 expref: 7 pid: 8450 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143106.371725:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5752 00000100:00100000:0.0:1746143106.371730:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858085760:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143106.371748:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143106.371760:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e550400/0x25aee876ca7099db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc18 expref: 7 pid: 8450 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.371768:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e550400/0x25aee876ca7099db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc18 expref: 7 pid: 8450 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.371782:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e550400/0x25aee876ca7099db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dc18 expref: 7 pid: 8450 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.372313:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143106.375570:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.375614:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.379591:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.381279:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143106.382028:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.382054:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.382068:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.382074:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.382088:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.382094:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094053800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143106.384635:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.384661:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.384693:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.384701:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094053800/0x25aee876ca709e03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143106.389112:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.394563:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.394607:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.394629:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.394667:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.394708:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858087040 00000100:00100000:0.0:1746143106.394715:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858087040 00000100:00100000:0.0:1746143106.394755:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858087296 00000100:00100000:0.0:1746143106.394757:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858087296 00000100:00100000:0.0:1746143106.394774:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3281 00000100:00100000:0.0:1746143106.394782:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:7717:x1830962858087040:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143106.394980:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:7717:x1830962858087040:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 200us (429us total) trans 8589942066 rc 0/0 00000100:00100000:0.0:1746143106.394986:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3281 00000100:00100000:0.0:1746143106.394995:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3282 00000100:00100000:0.0:1746143106.394999:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:15437:x1830962858087296:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143106.395093:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:15437:x1830962858087296:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 93us (425us total) trans 8589942067 rc 0/0 00000100:00100000:0.0:1746143106.395099:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3282 00000100:00100000:0.0:1746143106.398051:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.398086:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.398106:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.398119:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.398952:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143106.444116:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143106.444918:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10984 00000100:00100000:0.0:1746143106.445310:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3302:x1830962861029760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143106.445635:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143106.445638:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143106.445639:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143106.445641:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143106.445643:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143106.445673:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861029760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 367us (2970us total) trans 21474839775 rc 0/0 00000100:00100000:0.0:1746143106.446687:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10984 00000100:00100000:0.0:1746143106.446699:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861030144 00000100:00100000:0.0:1746143106.446709:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861030144 00000100:00100000:0.0:1746143106.446726:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10991 00000100:00100000:0.0:1746143106.446730:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3301:x1830962861030144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.448441:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861030144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1709us (2118us total) trans 17179872541 rc 0/0 00000100:00100000:0.0:1746143106.448448:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10991 00000100:00100000:0.0:1746143106.448764:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143106.448786:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143106.448799:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858088064 00000100:00100000:0.0:1746143106.448802:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858088064 00000100:00100000:0.0:1746143106.449356:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7887 00000100:00100000:0.0:1746143106.449363:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30268:x1830962858088064:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143106.449379:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143106.449396:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094052c00/0x25aee876ca709e18 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164dfb4 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.449446:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094052c00/0x25aee876ca709e18 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dfb4 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.449459:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094052c00/0x25aee876ca709e18 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dfb4 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.449521:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009b91ac00) 00010000:00010000:0.0:1746143106.449524:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143106.449528:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094052c00, rc 0) 00000100:00100000:0.0:1746143106.449566:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30268:x1830962858088064:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 203us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.449571:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7887 00000100:00100000:0.0:1746143106.453622:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.466317:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.466349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.466372:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.467363:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.467939:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.467979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.488824:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858089344 00000100:00100000:0.0:1746143106.488835:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858089344 00000100:00100000:0.0:1746143106.488897:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858089472 00000100:00100000:0.0:1746143106.488900:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858089472 00000100:00100000:0.0:1746143106.488912:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858089856 00000100:00100000:0.0:1746143106.488914:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858089856 00000100:00100000:0.0:1746143106.488933:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5309 00000100:00100000:0.0:1746143106.488940:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858089344:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143106.488976:0:21521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094053e00/0x25aee876ca709e57 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.488990:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.488992:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.488997:0:21521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094053e00/0x25aee876ca709e57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.489010:0:21521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094053e00/0x25aee876ca709e57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143106.495088:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.495139:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.496397:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5315 00000100:00100000:0.0:1746143106.496406:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858090752:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143106.496433:0:31806:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094053c00/0x25aee876ca709e81 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.496442:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.496443:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.496447:0:31806:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094053c00/0x25aee876ca709e81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.496457:0:31806:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094053c00/0x25aee876ca709e81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143106.502605:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.503308:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5316 00000100:00100000:0.0:1746143106.503322:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858091008:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143106.503359:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.503373:0:21520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.503375:0:21520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.503381:0:21520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.503394:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.558206:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.558223:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.558241:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.558249:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094053a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143106.558253:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.558260:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.558278:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.558284:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094053a00/0x25aee876ca709e88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143106.565065:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.567173:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.574306:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.578118:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.582530:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.585598:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.591956:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858092032 00000100:00100000:0.0:1746143106.591998:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858092032 00010000:00010000:0.0:1746143106.592025:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba92a00/0x25aee876ca709e3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dfd0 expref: 9 pid: 8169 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143106.592099:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5767 00000100:00100000:0.0:1746143106.592107:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858092032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143106.592121:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143106.592147:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba92a00/0x25aee876ca709e3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dfd0 expref: 9 pid: 8169 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.592158:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba92a00/0x25aee876ca709e3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dfd0 expref: 9 pid: 8169 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.592182:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba92a00/0x25aee876ca709e3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dfd0 expref: 9 pid: 8169 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143106.592205:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.592207:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143106.592213:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca709ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dffa expref: 8 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.592221:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca709ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dffa expref: 8 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.592253:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca709ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164dffa expref: 8 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143106.592265:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861031808:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143106.592332:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b24979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143106.599958:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.603957:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.607011:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.610018:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.613005:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.621070:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.622602:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.622632:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.622652:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.622666:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.622721:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.629259:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.637074:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.675585:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.675613:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858094080 00000100:00100000:0.0:1746143106.675620:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858094080 00000100:00100000:0.0:1746143106.675654:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7890 00000100:00100000:0.0:1746143106.675661:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:30268:x1830962858094080:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143106.675698:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143106.675717:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9800/0x25aee876ca709ec7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e016 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.675990:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9800/0x25aee876ca709ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e016 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.676005:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9800/0x25aee876ca709ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e016 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.676022:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143106.676054:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143106.676058:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc9800, rc 0) 00000100:00100000:0.0:1746143106.676101:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30268:x1830962858094080:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 440us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.676108:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7890 00000004:00080000:0.0:1746143106.676200:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1e9180/2, rc 0, transno 17179872549 00000100:00100000:0.0:1746143106.676206:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861032960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143106.676217:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8aa00/2, rc 0, transno 17179872550 00000100:00100000:0.0:1746143106.676219:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861033472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143106.676231:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e036300/2, rc 0, transno 21474839783 00000100:00100000:0.0:1746143106.676235:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861033984:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143106.676244:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aece00/2, rc 0, transno 21474839789 00000100:00100000:0.0:1746143106.676247:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861034496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143106.676256:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e034380/2, rc 0, transno 21474839784 00000100:00100000:0.0:1746143106.676259:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861033856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143106.676266:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e037b80/2, rc 0, transno 21474839782 00000100:00100000:0.0:1746143106.676269:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861034368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143106.676277:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1e8700/2, rc 0, transno 17179872547 00000100:00100000:0.0:1746143106.676279:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861032832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143106.676286:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8a300/2, rc 0, transno 17179872548 00000100:00100000:0.0:1746143106.676288:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861033344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.683309:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.732284:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.736702:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.743742:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858095360 00000100:00100000:0.0:1746143106.743747:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858095360 00000100:00100000:0.0:1746143106.743772:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11031 00000100:00100000:0.0:1746143106.743778:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30279:x1830962858095360:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143106.743787:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143106.743798:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5dc8800/0x25aee876ca709f22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e039 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.743816:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143106.743820:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5dc8800/0x25aee876ca709f22 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e039 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.743831:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5dc8800/0x25aee876ca709f22 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e039 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.743841:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc8800, rc 0) 00000100:00100000:0.0:1746143106.743874:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30279:x1830962858095360:12345-192.168.201.28@tcp:101:cat.0 Request processed in 97us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.743881:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11031 00000100:00100000:0.0:1746143106.750758:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861035008:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143106.750793:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7de00/0x25aee876ca709f14 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e02b expref: 28 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.750811:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7de00, rc 0) 00000100:00100000:0.0:1746143106.750943:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:30280:x1830962858094976:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10200us (10546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.750954:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11030 00000100:00100000:0.0:1746143106.753687:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5773 00000100:00100000:0.0:1746143106.753697:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858095616:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143106.753707:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143106.753714:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca709f06 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e024 expref: 10 pid: 17079 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143106.753723:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca709f06 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e024 expref: 10 pid: 17079 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143106.753737:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca709f06 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e024 expref: 10 pid: 17079 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143106.753752:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143106.753756:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdcfa00/0x25aee876ca709f29 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.753763:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdcfa00/0x25aee876ca709f29 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.753768:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143106.753791:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858095616:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 97us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.753798:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5773 00000100:00100000:0.0:1746143106.754963:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858095872 00000100:00100000:0.0:1746143106.754968:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858095872 00000100:00100000:0.0:1746143106.754995:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7894 00000100:00100000:0.0:1746143106.755001:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30278:x1830962858095872:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143106.755023:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143106.755063:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8e00/0x25aee876ca709f30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e040 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.755156:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9000/0x25aee876ca709f37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143106.755168:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9000/0x25aee876ca709f37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143106.755177:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9000/0x25aee876ca709f37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143106.755188:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143106.755307:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8e00/0x25aee876ca709f30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e040 expref: 202 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.755320:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9000/0x25aee876ca709f37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e040 expref: 201 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.755329:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143106.755332:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1746143106.755334:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdcfa00/0x25aee876ca709f29 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.755341:0:14794:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdcfa00/0x25aee876ca709f29 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.755346:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdcfa00/0x25aee876ca709f29 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143106.755365:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc9000, rc 0) 00000100:00100000:0.0:1746143106.755395:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30278:x1830962858095872:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 394us (1214us total) trans 8589942074 rc 0/0 00000100:00100000:0.0:1746143106.755410:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7894 00000100:00100000:0.0:1746143106.757610:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.758124:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.772232:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.781837:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.789235:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.804377:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.811105:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.811162:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.818145:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.819236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.831114:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.831144:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858097792 00000100:00100000:0.0:1746143106.831152:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858097792 00000100:00100000:0.0:1746143106.831195:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7898 00000100:00100000:0.0:1746143106.831202:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30279:x1830962858097792:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143106.831226:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143106.831243:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca709f76 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e06a expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.831300:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca709f61 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143106.831309:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca709f76 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e06a expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.831327:0:17079:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca709f61 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143106.831346:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca709f76 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e06a expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.831359:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143106.831361:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143106.831364:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca709f76 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e06a expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.831371:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093244600, rc 0) 00000100:00100000:0.0:1746143106.831412:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30279:x1830962858097792:12345-192.168.201.28@tcp:101:cat.0 Request processed in 210us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.831417:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7898 00010000:00010000:0.0:1746143106.935545:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca709f61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e055 expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.935559:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143106.935562:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143106.935566:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca709f76 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e06a expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.935577:0:14794:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca709f76 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e06a expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.935583:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca709f76 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e06a expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.935589:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b5200/0x25aee876ca709f7d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e071 expref: 200 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.935605:0:14794:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b5200/0x25aee876ca709f7d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e071 expref: 200 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.935611:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b5200/0x25aee876ca709f7d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e071 expref: 200 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.935640:0:14794:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51b5200/0x25aee876ca709f7d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e071 expref: 200 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143106.935653:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a249c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861036416:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143106.935763:0:14794:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca709f76 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e06a expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143106.935772:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a24a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861037312:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143106.935793:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a492cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143106.935806:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861036672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.935843:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143106.935865:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861037184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.935877:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143106.935891:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143106.935894:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861036160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.935905:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143106.935913:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861036800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.935922:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143106.936066:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861036672 00000100:00100000:0.0:1746143106.936073:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861036672 00000100:00100000:0.0:1746143106.936101:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861037184 00000100:00100000:0.0:1746143106.936102:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861037184 00000100:00100000:0.0:1746143106.936111:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861036160 00000100:00100000:0.0:1746143106.936112:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861036160 00000100:00100000:0.0:1746143106.936119:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861036800 00000100:00100000:0.0:1746143106.936121:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861036800 00000100:00100000:0.0:1746143106.936132:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11034 00000100:00100000:0.0:1746143106.936138:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3301:x1830962861036672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.936576:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3301:x1830962861036672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (546us total) trans 17179872555 rc 0/0 00000100:00100000:0.0:1746143106.936583:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11034 00000100:00100000:0.0:1746143106.936598:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11035 00000100:00100000:0.0:1746143106.936602:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3301:x1830962861037184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.936711:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3301:x1830962861037184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (833us total) trans 17179872556 rc 0/0 00000100:00100000:0.0:1746143106.936716:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11035 00000100:00100000:0.0:1746143106.936726:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11036 00000100:00100000:0.0:1746143106.936730:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3301:x1830962861036160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143106.936807:0:21048:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143106.936810:0:21048:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143105 -> 1746143105 00002000:00010000:0.0:1746143106.936812:0:21048:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143104 -> 1746143104 00002000:00010000:0.0:1746143106.936814:0:21048:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143105 -> 1746143105 00002000:00010000:0.0:1746143106.936816:0:21048:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143106.936831:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3301:x1830962861036160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (925us total) trans 17179872557 rc 0/0 00000100:00100000:0.0:1746143106.936843:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11036 00000100:00100000:0.0:1746143106.936854:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11037 00000100:00100000:0.0:1746143106.936859:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3301:x1830962861036800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.936944:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3301:x1830962861036800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1020us total) trans 17179872558 rc 0/0 00000100:00100000:0.0:1746143106.936950:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11037 00000100:00100000:0.0:1746143106.936960:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861036544 00000100:00100000:0.0:1746143106.936963:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861036544 00000100:00100000:0.0:1746143106.936979:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11038 00000100:00100000:0.0:1746143106.936983:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3300:x1830962861036544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143106.937084:0:21048:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143106.937087:0:21048:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143105 -> 1746143105 00002000:00010000:0.0:1746143106.937089:0:21048:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143104 -> 1746143104 00002000:00010000:0.0:1746143106.937091:0:21048:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143105 -> 1746143105 00002000:00010000:0.0:1746143106.937092:0:21048:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746143106.937114:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3300:x1830962861036544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (158us total) trans 17179872559 rc 0/0 00000100:00100000:0.0:1746143106.937119:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11038 00000004:00080000:0.0:1746143106.937173:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090f21880/2, rc 0, transno 17179872557 00000100:00100000:0.0:1746143106.937177:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861036160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143106.937184:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090f20e00/2, rc 0, transno 17179872558 00000100:00100000:0.0:1746143106.937187:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861036800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143106.937192:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090f23800/2, rc 0, transno 17179872555 00000100:00100000:0.0:1746143106.937194:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861036672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143106.937208:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090f21180/2, rc 0, transno 17179872556 00000100:00100000:0.0:1746143106.937210:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861037184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.937224:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861036288 00000100:00100000:0.0:1746143106.937226:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861036288 00000100:00100000:0.0:1746143106.937240:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861036928 00000100:00100000:0.0:1746143106.937242:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861036928 00000100:00100000:0.0:1746143106.937251:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11040 00000100:00100000:0.0:1746143106.937255:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3299:x1830962861036288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143106.937345:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143106.937348:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143105 -> 1746143105 00002000:00010000:0.0:1746143106.937350:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143104 -> 1746143104 00002000:00010000:0.0:1746143106.937351:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143105 -> 1746143105 00002000:00010000:0.0:1746143106.937353:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143106.937377:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3299:x1830962861036288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (216us total) trans 17179872561 rc 0/0 00000100:00100000:0.0:1746143106.937382:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11040 00000100:00100000:0.0:1746143106.937392:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11041 00000100:00100000:0.0:1746143106.937397:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3299:x1830962861036928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.937481:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3299:x1830962861036928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (300us total) trans 17179872562 rc 0/0 00000100:00100000:0.0:1746143106.937486:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11041 00000004:00080000:0.0:1746143106.937510:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090f20a80/2, rc 0, transno 17179872561 00000100:00100000:0.0:1746143106.937514:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861036288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143106.937520:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090f21c00/2, rc 0, transno 17179872562 00000100:00100000:0.0:1746143106.937522:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861036928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143106.945931:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.945958:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.945992:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143106.946299:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3285 00000100:00100000:0.0:1746143106.946309:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30280:x1830962858098048:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:0.0:1746143106.946433:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30280:x1830962858098048:12345-192.168.201.28@tcp:49:cat.0 Request processed in 126us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.946440:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3285 00000100:00100000:0.0:1746143106.946648:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858098304 00000100:00100000:0.0:1746143106.946651:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858098304 00000100:00100000:0.0:1746143106.947467:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7900 00000100:00100000:0.0:1746143106.947473:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30275:x1830962858098304:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143106.947484:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143106.947502:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba91e00/0x25aee876ca709f84 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e078 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.947546:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba91e00/0x25aee876ca709f84 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e078 expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.947559:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba91e00/0x25aee876ca709f84 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e078 expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.947576:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143106.947579:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143106.947582:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba91e00, rc 0) 00000100:00100000:0.0:1746143106.947602:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30275:x1830962858098304:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 129us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143106.947616:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7900 00000100:00100000:0.0:1746143106.947708:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a249c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861036416:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143106.947718:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a24a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861037312:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143106.947747:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7c200/0x25aee876ca709f5a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e055 expref: 200 pid: 14794 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143106.947759:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca709f61 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e055 expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143106.947775:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7d800, rc 0) 00000100:00100000:0.0:1746143106.947794:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30278:x1830962858097024:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 158184us (158570us total) trans 8589942076 rc 0/0 00000100:00100000:0.0:1746143106.947800:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7897 00000100:00100000:0.0:1746143106.975956:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143107.007394:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143107.013799:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143107.024836:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5321 00000100:00100000:0.0:1746143107.024844:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1969:x1830962858100736:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143107.042515:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.059248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.059314:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.063994:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.066726:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.069186:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.076320:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.076371:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.079880:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.086921:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.086972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.100387:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.106097:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.127993:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.142164:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.147860:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.150517:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.166959:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.182540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.186341:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.189356:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.201304:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858105728 00000100:00100000:0.0:1746143107.201310:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858105728 00002000:00100000:0.0:1746143107.201340:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008fe7b100 x1830962858105728/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:258/0 lens 488/0 e 0 to 0 dl 1746143118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143107.201351:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b100 with x1830962858105728 ext(3145728->4194303) 00010000:00010000:0.0:1746143107.201357:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a6d400/0x25aee876ca709ffb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0d3 expref: 32 pid: 10061 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143107.201367:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a6d400/0x25aee876ca709ffb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0d3 expref: 32 pid: 10061 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746143107.201373:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe7b100 00000100:00100000:0.0:1746143107.201387:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858105856 00000100:00100000:0.0:1746143107.201626:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858105856 00002000:00100000:0.0:1746143107.201640:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008fe7a300 x1830962858105856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:258/0 lens 488/0 e 0 to 0 dl 1746143118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143107.201648:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7a300 with x1830962858105856 ext(3145728->4194303) 00002000:00010000:0.0:1746143107.201652:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7a300 00000100:00100000:0.0:1746143107.201672:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1774 00000100:00100000:0.0:1746143107.201678:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858105728:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143107.202950:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5329 00000100:00100000:0.0:1746143107.202959:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858105856:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143107.225252:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858105728:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23568us (27165us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143107.227065:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1774 00002000:00100000:0.0:1746143107.227084:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008fe7b100 x1830962858105728/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:258/0 lens 488/440 e 0 to 0 dl 1746143118 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143107.227095:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b100 with x1830962858105728 ext(3145728->4194303) 00010000:00010000:0.0:1746143107.227107:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a6d400/0x25aee876ca709ffb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0d3 expref: 32 pid: 10061 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143107.227120:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a6d400/0x25aee876ca709ffb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0d3 expref: 32 pid: 10061 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746143107.227128:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe7b100 00000100:00100000:0.0:1746143107.239553:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.239632:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.244990:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.246909:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.296207:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861041664 00000100:00100000:0.0:1746143107.296214:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861041664 00000100:00100000:0.0:1746143107.296251:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861042176 00000100:00100000:0.0:1746143107.296252:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861042176 00000100:00100000:0.0:1746143107.296262:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861041792 00000100:00100000:0.0:1746143107.296264:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861041792 00000100:00100000:0.0:1746143107.296278:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1746143107.296283:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830962861041664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143107.296325:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830962861041664:12345-0@lo:400:kworker.0 Request processed in 41us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143107.296331:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1746143107.296342:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1746143107.296346:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830962861042176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143107.296365:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830962861042176:12345-0@lo:400:kworker.0 Request processed in 19us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143107.296369:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1746143107.296377:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1746143107.296381:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830962861041792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143107.296398:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830962861041792:12345-0@lo:400:kworker.0 Request processed in 18us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143107.296403:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:0.0:1746143107.296418:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143107.299942:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.301102:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.343108:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143107.343122:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861042944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143107.343181:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143107.343228:0:25353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861042944 00000100:00100000:0.0:1746143107.343231:0:25353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861042944 00000100:00100000:0.0:1746143107.343256:0:25353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1746143107.343261:0:25353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861042944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143107.343277:0:25353:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 388956160 pending 0 free 3851419648 avail 3827302400 00000100:00100000:0.0:1746143107.343308:0:25353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861042944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143107.343313:0:25353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1746143107.343352:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861042944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143107.395723:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.397730:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.400967:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.425525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.425608:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.425631:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.444268:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.451790:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858115072 00000100:00100000:0.0:1746143107.451800:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858115072 00000100:00100000:0.0:1746143107.452576:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858115200 00000100:00100000:0.0:1746143107.452580:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858115200 00000100:00100000:0.0:1746143107.452631:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11084 00000100:00100000:0.0:1746143107.452639:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30293:x1830962858115072:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143107.452654:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143107.452681:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70a128 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e197 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.452718:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b42fb000/0x25aee876ca709fa7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e09b expref: 26 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.452727:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f28e00/0x25aee876ca70a08e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e13c expref: 10 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.452734:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b4ca00/0x25aee876ca709fae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0a2 expref: 31 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.452764:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143107.452767:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143107.452770:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70a128 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e197 expref: 26 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.452813:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b4ca00/0x25aee876ca709fae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0a2 expref: 31 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.452824:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b4ca00/0x25aee876ca709fae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0a2 expref: 31 pid: 754 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143107.452836:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861044352:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143107.452903:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f28e00/0x25aee876ca70a08e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e13c expref: 10 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.452911:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f28e00/0x25aee876ca70a08e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e13c expref: 10 pid: 8169 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746143107.452924:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861044480:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143107.452945:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b42fb000/0x25aee876ca709fa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e09b expref: 26 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.452952:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b42fb000/0x25aee876ca709fa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e09b expref: 26 pid: 754 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143107.452959:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861044608:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143107.452972:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143107.456265:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.456289:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858115328 00000100:00100000:0.0:1746143107.456295:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858115328 00000100:00100000:0.0:1746143107.456323:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11086 00000100:00100000:0.0:1746143107.456329:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858115328:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143107.456342:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143107.456354:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800949ee600/0x25aee876ca70a136 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e1a5 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143107.456392:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861044864:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143107.456457:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143107.460593:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861044352:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143107.460735:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861044480:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143107.460745:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861044608:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143107.460783:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70a128 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e197 expref: 26 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.460799:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009494a800, rc 0) 00000100:00100000:0.0:1746143107.460856:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30293:x1830962858115072:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8216us (9106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143107.460865:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11084 00000100:00100000:0.0:1746143107.462125:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858115584 00000100:00100000:0.0:1746143107.462132:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858115584 00010000:00010000:0.0:1746143107.462157:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b4ca00/0x25aee876ca709fae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0a2 expref: 32 pid: 754 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143107.462178:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858115456 00000100:00100000:0.0:1746143107.462180:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858115456 00010000:00010000:0.0:1746143107.462188:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135f28e00/0x25aee876ca70a08e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e13c expref: 11 pid: 8169 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746143107.462376:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861044864:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143107.462398:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800949ee600/0x25aee876ca70a136 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1a5 expref: 9 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.462409:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800949ee600/0x25aee876ca70a136 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1a5 expref: 9 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.462423:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949ee600, rc 0) 00000100:00100000:0.0:1746143107.462969:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1968:x1830962858115328:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6638us (6707us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143107.462987:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11086 00010000:00010000:0.0:1746143107.464052:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143107.468337:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.472621:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.474295:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.474321:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.475585:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858116224 00000100:00100000:0.0:1746143107.475593:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858116224 00000100:00100000:0.0:1746143107.477168:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7908 00000100:00100000:0.0:1746143107.477179:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:30298:x1830962858116224:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143107.477200:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143107.477215:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ef400/0x25aee876ca70a13d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e1ac expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.477299:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477311:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477319:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477329:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477335:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477341:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477603:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee400/0x25aee876ca70a152 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477611:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee400/0x25aee876ca70a152 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477617:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee400/0x25aee876ca70a152 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:0.0:1746143107.477625:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143107.477706:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477713:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477719:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477724:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800949ee000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143107.477727:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477733:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477960:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143107.477962:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143107.477967:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.477972:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee000/0x25aee876ca70a144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.478002:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.478007:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.478012:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.478016:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800949eec00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143107.478019:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.478024:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.478047:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5dcf200) 00010000:00010000:0.0:1746143107.478049:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143107.478051:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.478056:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949eec00/0x25aee876ca70a14b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143107.478086:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ef400/0x25aee876ca70a13d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1ac expref: 207 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.478096:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ee400/0x25aee876ca70a152 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1ac expref: 206 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.478103:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143107.478108:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143107.478110:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949ee400, rc 0) 00000100:00100000:0.0:1746143107.478143:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:30298:x1830962858116224:12345-192.168.201.28@tcp:101:cat.0 Request processed in 968us (3851us total) trans 8589942088 rc 0/0 00000100:00100000:0.0:1746143107.478150:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7908 00000100:00100000:0.0:1746143107.487656:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.492288:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.497987:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.498074:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.506423:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.506454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.506472:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.506491:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.506834:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5799 00000100:00100000:0.0:1746143107.506842:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858117760:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143107.506854:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143107.506873:0:9869:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 5623 -> 6155 00010000:00010000:0.0:1746143107.506878:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70a16e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1ba expref: 14 pid: 4758 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143107.506886:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70a16e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1ba expref: 14 pid: 4758 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143107.506899:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70a16e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1ba expref: 14 pid: 4758 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143107.506912:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143107.506941:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1968:x1830962858117760:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 101us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143107.506946:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5799 00000100:00100000:0.0:1746143107.506957:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5801 00000100:00100000:0.0:1746143107.506961:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858117632:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143107.506967:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143107.506973:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800949efa00/0x25aee876ca70a0a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e143 expref: 7 pid: 8450 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143107.506980:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800949efa00/0x25aee876ca70a0a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e143 expref: 7 pid: 8450 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143107.506989:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800949efa00/0x25aee876ca70a0a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e143 expref: 7 pid: 8450 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143107.506996:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143107.507007:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858117632:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 45us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143107.507012:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5801 00000100:00100000:0.0:1746143107.520721:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.520772:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.520797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.520842:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.520880:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.525014:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5339 00000100:00100000:0.0:1746143107.525048:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858118400:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143107.537640:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.560592:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.570540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.570636:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.576297:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.576581:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.589772:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5806 00000100:00100000:0.0:1746143107.589779:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858120576:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143107.589785:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143107.591608:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b42fa200/0x25aee876ca709fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0be expref: 20 pid: 4758 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143107.591617:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b42fa200/0x25aee876ca709fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0be expref: 20 pid: 4758 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143107.591630:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b42fa200/0x25aee876ca709fca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0be expref: 20 pid: 4758 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143107.591642:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143107.591644:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143107.591651:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f391e00/0x25aee876ca70a198 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1dd expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.591670:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f391e00/0x25aee876ca70a198 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1dd expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143107.602146:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.602301:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.613048:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.623257:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.626597:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.627298:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.635380:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.676913:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.676969:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.677010:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858122624 00000100:00100000:0.0:1746143107.677019:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858122624 00002000:00100000:0.0:1746143107.677080:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880091948a80 x1830962858122624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:258/0 lens 488/0 e 0 to 0 dl 1746143118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143107.677091:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948a80 with x1830962858122624 ext(0->1048575) 00002000:00010000:0.0:1746143107.677097:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948a80 00000100:00100000:0.0:1746143107.677124:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5345 00000100:00100000:0.0:1746143107.677132:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858122624:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143107.682687:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.690840:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.713347:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.713605:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.713631:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.713675:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.713728:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858123264 00000100:00100000:0.0:1746143107.713937:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858123264 00002000:00100000:0.0:1746143107.713990:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880091948000 x1830962858123264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:258/0 lens 488/0 e 0 to 0 dl 1746143118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143107.714001:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948000 with x1830962858123264 ext(2097152->3145727) 00002000:00010000:0.0:1746143107.714011:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948000 00000100:00100000:0.0:1746143107.714823:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858123648 00000100:00100000:0.0:1746143107.714827:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858123648 00002000:00100000:0.0:1746143107.714841:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2125824->3174399) req@ffff880091949880 x1830962858123648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:258/0 lens 488/0 e 0 to 0 dl 1746143118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143107.714847:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949880 with x1830962858123648 ext(2125824->3174399) 00002000:00010000:0.0:1746143107.714850:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091949880 00000100:00100000:0.0:1746143107.714870:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5346 00000100:00100000:0.0:1746143107.714877:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858123392:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143107.717177:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.749240:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.777466:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.796421:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.805784:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.813752:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.816721:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.837332:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.846116:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.853261:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.861721:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.867814:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.868061:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.869683:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.871446:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.912223:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.914964:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.935228:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.969500:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.976725:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.977310:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.977354:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858128000 00000100:00100000:0.0:1746143107.977357:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858128000 00002000:00100000:0.0:1746143107.977389:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2125823) req@ffff8800919dc000 x1830962858128000/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:258/0 lens 488/0 e 0 to 0 dl 1746143118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143107.977415:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dc000 with x1830962858128000 ext(2097152->2125823) 00010000:00010000:0.0:1746143107.977424:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f391e00/0x25aee876ca70a198 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1dd expref: 22 pid: 4758 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143107.977436:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f391e00/0x25aee876ca70a198 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1dd expref: 22 pid: 4758 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746143107.977443:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919dc000 00000100:00100000:0.0:1746143107.977713:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1784 00000100:00100000:0.0:1746143107.977718:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858128000:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143107.978644:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.978690:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.980849:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.984960:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.985012:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143107.985060:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858128640 00000100:00100000:0.0:1746143107.985063:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858128640 00000100:00100000:0.0:1746143107.985087:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11106 00000100:00100000:0.0:1746143107.985092:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858128640:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143107.985118:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143107.985130:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc64000/0x25aee876ca70a286 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e25b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143107.986221:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861049088:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143107.986264:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944af240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143107.989007:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858128768 00000100:00100000:0.0:1746143107.989013:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858128768 00000100:00100000:0.0:1746143107.989281:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858128896 00000100:00100000:0.0:1746143107.989285:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858128896 00000100:00100000:0.0:1746143107.989304:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11107 00000100:00100000:0.0:1746143107.989310:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858128768:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143107.989323:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143107.989546:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0c6200/0x25aee876ca70a28d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e262 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143107.989566:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143107.989568:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143107.989576:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0c6200/0x25aee876ca70a28d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e262 expref: 26 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.989591:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0c6200/0x25aee876ca70a28d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e262 expref: 26 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.989601:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c6200, rc 0) 00000100:00100000:0.0:1746143107.989627:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858128768:12345-192.168.201.28@tcp:101:cat.0 Request processed in 317us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143107.989644:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11107 00000100:00100000:0.0:1746143107.989667:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11108 00000100:00100000:0.0:1746143107.989672:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858128896:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143107.989679:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143107.989684:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7a00/0x25aee876ca70a294 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e269 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143107.989718:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861049216:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143107.989962:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944afd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143107.991899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:0.0:1746143107.993637:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143105 -> 1746143106 00002000:00010000:0.0:1746143107.993640:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143104 -> 1746143106 00002000:00010000:0.0:1746143107.993643:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143105 -> 1746143106 00000100:00100000:0.0:1746143107.993663:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861049088:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143107.993688:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc64000/0x25aee876ca70a286 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e25b expref: 17 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.993702:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc64000/0x25aee876ca70a286 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e25b expref: 17 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.993717:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc64000, rc 0) 00000100:00100000:0.0:1746143107.993923:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858128640:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8828us (8908us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143107.993930:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11106 00000100:00100000:0.0:1746143107.994062:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861049216:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143107.994094:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7a00/0x25aee876ca70a294 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e269 expref: 26 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.994105:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7a00/0x25aee876ca70a294 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e269 expref: 26 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143107.994113:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c7a00, rc 0) 00000100:00100000:0.0:1746143107.994138:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858128896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4464us (5189us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143107.994144:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11108 00000100:00100000:0.0:1746143108.005410:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.005494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143108.007206:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143108.011448:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858129536 00000100:00100000:0.0:1746143108.011457:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858129536 00000100:00100000:0.0:1746143108.012497:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.016464:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.017351:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.017400:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.017928:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.022276:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.023115:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858130816 00000100:00100000:0.0:1746143108.023121:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858130816 00000100:00100000:0.0:1746143108.023157:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11111 00000100:00100000:0.0:1746143108.023163:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30310:x1830962858130816:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143108.023174:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.023190:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0c6800/0x25aee876ca70a2a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e27e expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.023220:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094235200/0x25aee876ca70a29b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e270 expref: 12 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.023227:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143108.023229:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143108.023232:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0c6800/0x25aee876ca70a2a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e27e expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.023261:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094235200/0x25aee876ca70a29b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e270 expref: 12 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.023272:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094235200/0x25aee876ca70a29b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e270 expref: 12 pid: 8169 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143108.023283:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861049984:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143108.024268:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944afd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143108.039631:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.059482:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.061243:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.077434:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.087996:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.092960:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.098104:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.098150:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.101122:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.117585:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.130616:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.130675:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.131794:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.140858:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.144194:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.146952:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.153248:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861051008:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143108.153271:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143108.153314:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858134528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8937us (9125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.153326:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5820 00000100:00100000:0.0:1746143108.156910:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.156938:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858135296 00000100:00100000:0.0:1746143108.156945:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858135296 00002000:00100000:0.0:1746143108.156984:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1699840->1703935) req@ffff880090f23100 x1830962858135296/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:259/0 lens 488/0 e 0 to 0 dl 1746143119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143108.156994:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23100 with x1830962858135296 ext(1699840->1703935) 00002000:00010000:0.0:1746143108.157000:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f23100 00000100:00100000:0.0:1746143108.157020:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5365 00000100:00100000:0.0:1746143108.157027:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858135296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143108.157179:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858135296:12345-192.168.201.28@tcp:3:cat.0 Request processed in 152us (479us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143108.157185:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5365 00002000:00100000:0.0:1746143108.157191:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1699840->1703935) req@ffff880090f23100 x1830962858135296/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:259/0 lens 488/4536 e 0 to 0 dl 1746143119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143108.157209:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23100 with x1830962858135296 ext(1699840->1703935) 00002000:00010000:0.0:1746143108.157212:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f23100 00000100:00100000:0.0:1746143108.176153:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.193477:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.195871:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.201138:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.204979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.205042:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.213761:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.218316:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.221144:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.224592:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.227876:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.227912:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.235116:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.242814:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.242885:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.242897:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858138496 00000100:00100000:0.0:1746143108.242901:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858138496 00000100:00100000:0.0:1746143108.242926:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858138752 00000100:00100000:0.0:1746143108.242928:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858138752 00000100:00100000:0.0:1746143108.242941:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11130 00000100:00100000:0.0:1746143108.242947:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858138496:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143108.242964:0:10061:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7be00/0x25aee876ca70a382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.242976:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f390200/0x25aee876ca70a191 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1d6 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.243002:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70a304 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e2cb expref: 10 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.243009:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70a1d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1f9 expref: 16 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.243016:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.243017:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.243019:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7be00/0x25aee876ca70a382 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.243056:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70a1d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1f9 expref: 16 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.243063:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70a1d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1f9 expref: 16 pid: 8449 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746143108.243072:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861053056:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143108.243112:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70a304 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e2cb expref: 10 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.243121:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70a304 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e2cb expref: 10 pid: 8169 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746143108.243128:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861053440:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143108.243158:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f390200/0x25aee876ca70a191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1d6 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.243165:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f390200/0x25aee876ca70a191 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e1d6 expref: 16 pid: 4758 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143108.243173:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861053696:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143108.243306:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944af240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143108.253023:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.255286:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.255380:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.256426:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.257442:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.257453:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858139392 00000100:00100000:0.0:1746143108.257456:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858139392 00010000:00010000:0.0:1746143108.257471:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135f29000/0x25aee876ca70a03a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3833856->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0f6 expref: 16 pid: 4758 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143108.257486:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5826 00000100:00100000:0.0:1746143108.257491:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858139392:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143108.257497:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143108.257507:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135f29000/0x25aee876ca70a03a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3833856->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0f6 expref: 16 pid: 4758 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.257516:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135f29000/0x25aee876ca70a03a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3833856->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0f6 expref: 16 pid: 4758 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.257539:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f29000/0x25aee876ca70a03a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3833856->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e0f6 expref: 16 pid: 4758 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.257551:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143108.257566:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858139392:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 76us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.257572:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5826 00000100:00100000:0.0:1746143108.257594:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.257602:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858139648 00000100:00100000:0.0:1746143108.257604:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858139648 00010000:00010000:0.0:1746143108.257612:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70a1e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e20e expref: 15 pid: 22204 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143108.257625:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5827 00000100:00100000:0.0:1746143108.257629:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858139648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143108.257634:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143108.257641:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70a1e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e20e expref: 15 pid: 22204 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.257661:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70a1e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e20e expref: 15 pid: 22204 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.257671:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70a1e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e20e expref: 15 pid: 22204 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.257689:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143108.258907:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858139648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1276us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.258913:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5827 00000100:00100000:0.0:1746143108.265574:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.265610:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.265677:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.288941:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.289600:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5838 00000100:00100000:0.0:1746143108.289610:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858140928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143108.289624:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143108.289660:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c044c00/0x25aee876ca70a2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e2a1 expref: 27 pid: 4758 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.289673:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c044c00/0x25aee876ca70a2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e2a1 expref: 27 pid: 4758 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.289698:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c044c00/0x25aee876ca70a2cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e2a1 expref: 27 pid: 4758 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.290201:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.290204:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.290210:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70a36d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.290234:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70a36d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.290272:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143108.290391:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858140928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 782us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.290399:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5838 00000100:00100000:0.0:1746143108.296278:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.303521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.307250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143108.308297:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6a00/0x25aee876ca70a390 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143108.308306:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6a00/0x25aee876ca70a390 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000040:00080000:0.0:1746143108.310026:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2242, 88 off190000 00000004:00080000:0.0:1746143108.310167:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890150134288ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311203:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2275, 88 off192640 00000004:00080000:0.0:1746143108.311210:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 890151178589ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143108.311233:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2276, 88 off192728 00000004:00080000:0.0:1746143108.311236:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 890151204492ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143108.311246:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2243, 88 off190088 00000004:00080000:0.0:1746143108.311248:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890151216779ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311407:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2244, 88 off190176 00000004:00080000:0.0:1746143108.311411:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890151379649ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311420:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2277, 88 off192816 00000004:00080000:0.0:1746143108.311432:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 890151400932ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143108.311572:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2278, 88 off192904 00000004:00080000:0.0:1746143108.311577:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 890151545243ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143108.311583:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2279, 88 off192992 00000004:00080000:0.0:1746143108.311587:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 890151555179ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143108.311594:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2245, 88 off190264 00000004:00080000:0.0:1746143108.311596:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890151564953ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311605:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2280, 88 off193080 00000004:00080000:0.0:1746143108.311608:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 890151576213ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143108.311614:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2246, 88 off190352 00000004:00080000:0.0:1746143108.311616:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890151584961ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311622:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2281, 88 off193168 00000004:00080000:0.0:1746143108.311626:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 890151594956ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143108.311633:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2247, 88 off190440 00000004:00080000:0.0:1746143108.311636:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890151604501ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311643:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2248, 88 off190528 00000004:00080000:0.0:1746143108.311657:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890151625891ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311666:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2249, 88 off190616 00000004:00080000:0.0:1746143108.311669:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890151637694ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311676:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2250, 88 off190704 00000004:00080000:0.0:1746143108.311678:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 890151646346ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143108.311684:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2282, 88 off193256 00000004:00080000:0.0:1746143108.311687:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 890151655636ns, next at 860119223596ns, rc = 0 00000001:00080000:0.0:1746143108.338843:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942103 is committed 00000004:00080000:0.0:1746143108.338849:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1701 committed 00000004:00080000:0.0:1746143108.338856:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1674 committed 00000004:00080000:0.0:1746143108.338861:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1673 committed 00000004:00080000:0.0:1746143108.338868:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1672 committed 00000004:00080000:0.0:1746143108.338869:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1671 committed 00000004:00080000:0.0:1746143108.338871:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1700 committed 00000004:00080000:0.0:1746143108.338873:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1670 committed 00000004:00080000:0.0:1746143108.338875:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1699 committed 00000004:00080000:0.0:1746143108.338876:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1669 committed 00000004:00080000:0.0:1746143108.338878:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1698 committed 00000004:00080000:0.0:1746143108.338880:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1697 committed 00000004:00080000:0.0:1746143108.338882:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1696 committed 00000004:00080000:0.0:1746143108.338883:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1668 committed 00000004:00080000:0.0:1746143108.338885:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1667 committed 00000004:00080000:0.0:1746143108.338887:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1695 committed 00000004:00080000:0.0:1746143108.338888:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1694 committed 00000004:00080000:0.0:1746143108.338890:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1666 committed 00000001:00080000:0.0:1746143108.338897:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942088 is committed 00000001:00080000:0.0:1746143108.338902:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942091 is committed 00000001:00080000:0.0:1746143108.338906:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942089 is committed 00000001:00080000:0.0:1746143108.338915:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942100 is committed 00000001:00080000:0.0:1746143108.338939:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942098 is committed 00000100:00100000:0.0:1746143108.339195:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861054848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.339237:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.339276:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861055360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.339295:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.339313:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143108.339317:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861054976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.339330:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.339341:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861055488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.339351:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.339374:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861054848 00000100:00100000:0.0:1746143108.339386:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861054848 00000100:00100000:0.0:1746143108.339419:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861055360 00000100:00100000:0.0:1746143108.339421:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861055360 00000100:00100000:0.0:1746143108.339431:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861054976 00000100:00100000:0.0:1746143108.339432:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861054976 00000100:00100000:0.0:1746143108.339442:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861055488 00000100:00100000:0.0:1746143108.339443:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861055488 00000100:00100000:0.0:1746143108.339453:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11132 00000100:00100000:0.0:1746143108.339459:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3301:x1830962861054848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.339613:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3301:x1830962861054848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (375us total) trans 17179872569 rc 0/0 00000100:00100000:0.0:1746143108.339619:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11132 00000100:00100000:0.0:1746143108.339629:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11133 00000100:00100000:0.0:1746143108.339633:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3301:x1830962861055360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.339727:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3301:x1830962861055360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (430us total) trans 17179872570 rc 0/0 00000100:00100000:0.0:1746143108.339733:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11133 00000100:00100000:0.0:1746143108.339743:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11134 00000100:00100000:0.0:1746143108.339748:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3301:x1830962861054976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.339832:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3301:x1830962861054976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (499us total) trans 17179872571 rc 0/0 00000100:00100000:0.0:1746143108.339837:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11134 00000100:00100000:0.0:1746143108.339847:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11135 00000100:00100000:0.0:1746143108.339852:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3301:x1830962861055488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.339926:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3301:x1830962861055488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (572us total) trans 17179872572 rc 0/0 00000100:00100000:0.0:1746143108.339931:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11135 00000004:00080000:0.0:1746143108.339979:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aef480/2, rc 0, transno 17179872571 00000100:00100000:0.0:1746143108.339985:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861054976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143108.339992:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aefb80/2, rc 0, transno 17179872572 00000100:00100000:0.0:1746143108.339995:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861055488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143108.340001:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aed500/2, rc 0, transno 17179872569 00000100:00100000:0.0:1746143108.340003:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861054848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143108.340008:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aeea00/2, rc 0, transno 17179872570 00000100:00100000:0.0:1746143108.340011:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861055360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.342878:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861056000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.342903:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143108.344140:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ad59500/2, rc 0, transno 21474839811 00000100:00100000:0.0:1746143108.344145:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861056000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.344152:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861056512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.344171:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143108.344381:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ad58a80/2, rc 0, transno 21474839814 00000100:00100000:0.0:1746143108.344386:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861056512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.345807:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861056640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.345830:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143108.346020:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dea00/2, rc 0, transno 21474839815 00000100:00100000:0.0:1746143108.346025:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861056640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.347519:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858142080 00000100:00100000:0.0:1746143108.347522:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858142080 00000100:00100000:0.0:1746143108.347547:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7920 00000100:00100000:0.0:1746143108.347553:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30319:x1830962858142080:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143108.347570:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.347582:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7b200/0x25aee876ca70a39e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e30a expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.347636:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a800/0x25aee876ca70a3a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143108.347657:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a800/0x25aee876ca70a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143108.347666:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a800/0x25aee876ca70a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143108.347687:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143108.347691:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143108.347702:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a800/0x25aee876ca70a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143108.347722:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7b200/0x25aee876ca70a39e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e30a expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.347734:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a800/0x25aee876ca70a3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e30a expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.347741:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143108.347743:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143108.347745:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a800, rc 0) 00000100:00100000:0.0:1746143108.347783:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30319:x1830962858142080:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 229us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.347789:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7920 00000100:00100000:0.0:1746143108.352721:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858142208 00000100:00100000:0.0:1746143108.352737:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858142208 00000100:00100000:0.0:1746143108.352770:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858142336 00000100:00100000:0.0:1746143108.352771:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858142336 00000100:00100000:0.0:1746143108.352782:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858142464 00000100:00100000:0.0:1746143108.352783:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858142464 00000100:00100000:0.0:1746143108.352793:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858142592 00000100:00100000:0.0:1746143108.352794:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858142592 00000100:00100000:0.0:1746143108.352806:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11149 00000100:00100000:0.0:1746143108.352814:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858142208:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143108.352828:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.352844:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b000/0x25aee876ca70a3ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e311 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143108.352866:0:22204:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x68140782, atime: 0x68140780, ctime: 0x68140782, blocks: 0x793 00010000:00010000:0.0:1746143108.352881:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.352883:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.352890:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b000/0x25aee876ca70a3ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e311 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.352904:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b000/0x25aee876ca70a3ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e311 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.352914:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7b000, rc 0) 00000100:00100000:0.0:1746143108.352954:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858142208:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 141us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.352960:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11149 00000100:00100000:0.0:1746143108.352976:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11150 00000100:00100000:0.0:1746143108.352981:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858142336:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143108.352994:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.353003:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba7be00/0x25aee876ca70a3b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e318 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143108.353016:0:22204:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x68140783, atime: 0x68140783, ctime: 0x68140783, blocks: 0x81f 00010000:00010000:0.0:1746143108.353025:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.353026:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.353055:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7be00/0x25aee876ca70a3b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e318 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.353066:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7be00/0x25aee876ca70a3b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e318 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.353073:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7be00, rc 0) 00000100:00100000:0.0:1746143108.353089:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858142336:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 109us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.353095:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11150 00000100:00100000:0.0:1746143108.353105:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11151 00000100:00100000:0.0:1746143108.353109:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858142464:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143108.353114:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.353122:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba7aa00/0x25aee876ca70a3ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e31f expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143108.353131:0:22204:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x68140783, atime: 0x68140782, ctime: 0x68140783, blocks: 0x821 00010000:00010000:0.0:1746143108.353138:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.353140:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.353148:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7aa00/0x25aee876ca70a3ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e31f expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.353157:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7aa00/0x25aee876ca70a3ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e31f expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.353164:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7aa00, rc 0) 00000100:00100000:0.0:1746143108.353178:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858142464:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 69us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.353183:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11151 00000100:00100000:0.0:1746143108.353193:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11152 00000100:00100000:0.0:1746143108.353198:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858142592:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143108.353203:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.353209:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70a3c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e326 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143108.353219:0:22204:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x68140782, atime: 0x68140780, ctime: 0x68140782, blocks: 0x821 00010000:00010000:0.0:1746143108.353225:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.353226:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.353229:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70a3c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e326 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.353236:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70a3c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e326 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.353242:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7b600, rc 0) 00000100:00100000:0.0:1746143108.353254:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858142592:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 57us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.353263:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11152 00000100:00100000:0.0:1746143108.367953:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.372598:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.380235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.389812:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.389856:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.389886:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.389913:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.389941:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858144384 00000100:00100000:0.0:1746143108.389950:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858144384 00000100:00100000:0.0:1746143108.390000:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858143744 00000100:00100000:0.0:1746143108.390002:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858143744 00000100:00100000:0.0:1746143108.390016:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858144512 00000100:00100000:0.0:1746143108.390018:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858144512 00000100:00100000:0.0:1746143108.390027:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858144000 00000100:00100000:0.0:1746143108.390053:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858144000 00000100:00100000:0.0:1746143108.390069:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5370 00000100:00100000:0.0:1746143108.390076:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858144384:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143108.390111:0:31430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092a7d600/0x25aee876ca70a3f2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.390125:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.390127:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.390132:0:31430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a7d600/0x25aee876ca70a3f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.390145:0:31430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7d600/0x25aee876ca70a3f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143108.447091:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.463220:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.463261:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.463289:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.463324:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.463664:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11160 00000100:00100000:0.0:1746143108.463671:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858145536:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:0.0:1746143108.463747:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:0.0:1746143108.463749:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143106 -> 1746143107 00002000:00010000:0.0:1746143108.463751:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143105 -> 1746143107 00002000:00010000:0.0:1746143108.463753:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143106 -> 1746143107 00002000:00010000:0.0:1746143108.463755:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:0.0:1746143108.464231:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858145536:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 560us (906us total) trans 21474839818 rc 0/0 00000100:00100000:0.0:1746143108.464235:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11160 00000100:00100000:0.0:1746143108.466959:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.473213:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.513204:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861058176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.513232:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.513264:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861058688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.513280:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.513581:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143108.513587:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861058048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.513604:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.513629:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861058560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.513661:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.513682:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861058176 00000100:00100000:0.0:1746143108.513685:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861058176 00000100:00100000:0.0:1746143108.513703:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861058688 00000100:00100000:0.0:1746143108.513705:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861058688 00000100:00100000:0.0:1746143108.513713:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861058048 00000100:00100000:0.0:1746143108.513715:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861058048 00000100:00100000:0.0:1746143108.513723:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861058560 00000100:00100000:0.0:1746143108.513725:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861058560 00000100:00100000:0.0:1746143108.513734:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11174 00000100:00100000:0.0:1746143108.513739:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861058176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143108.513856:0:4756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:0.0:1746143108.513859:0:4756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.513861:0:4756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.513862:0:4756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.513864:0:4756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:0.0:1746143108.513887:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3302:x1830962861058176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (655us total) trans 21474839824 rc 0/0 00000100:00100000:0.0:1746143108.513893:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11174 00000100:00100000:0.0:1746143108.513904:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11175 00000100:00100000:0.0:1746143108.513908:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861058688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143108.513969:0:4756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143108.513971:0:4756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143108.513973:0:4756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143108.513974:0:4756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143108.513976:0:4756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143108.513994:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3302:x1830962861058688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (713us total) trans 21474839825 rc 0/0 00000100:00100000:0.0:1746143108.514005:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11175 00000100:00100000:0.0:1746143108.514015:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11176 00000100:00100000:0.0:1746143108.514019:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861058048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143108.514103:0:4756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143108.514105:0:4756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.514107:0:4756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.514109:0:4756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.514110:0:4756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143108.514129:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3302:x1830962861058048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (524us total) trans 21474839826 rc 0/0 00000100:00100000:0.0:1746143108.514134:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11176 00000100:00100000:0.0:1746143108.514143:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11177 00000100:00100000:0.0:1746143108.514147:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861058560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.514220:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3302:x1830962861058560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (557us total) trans 21474839827 rc 0/0 00000100:00100000:0.0:1746143108.514225:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11177 00000004:00080000:0.0:1746143108.514540:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919df100/2, rc 0, transno 21474839826 00000100:00100000:0.0:1746143108.514544:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861058048:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143108.514553:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dd880/2, rc 0, transno 21474839827 00000100:00100000:0.0:1746143108.514556:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861058560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143108.514561:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919df480/2, rc 0, transno 21474839824 00000100:00100000:0.0:1746143108.514564:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861058176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143108.514570:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aece00/2, rc 0, transno 21474839825 00000100:00100000:0.0:1746143108.514577:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861058688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.519975:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.526781:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.564261:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.568746:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.571730:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.576982:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.577082:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.577118:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.577437:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5846 00000100:00100000:0.0:1746143108.577454:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1968:x1830962858147840:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143108.577470:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143108.577481:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a400/0x25aee876ca70a45b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e349 expref: 199 pid: 14795 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.577496:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a400/0x25aee876ca70a45b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e349 expref: 199 pid: 14795 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.577515:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a400/0x25aee876ca70a45b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e349 expref: 199 pid: 14795 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.577545:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143108.577550:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9600/0x25aee876ca70a477 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.577558:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9600/0x25aee876ca70a477 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.577564:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9600/0x25aee876ca70a477 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.577594:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143108.577634:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1968:x1830962858147840:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 187us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.577657:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5846 00000100:00100000:0.0:1746143108.578375:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.578734:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.585810:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.585860:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.593267:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858148736 00000100:00100000:0.0:1746143108.593278:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858148736 00002000:00100000:0.0:1746143108.593324:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092997800 x1830962858148736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:259/0 lens 488/0 e 0 to 0 dl 1746143119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143108.593335:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092997800 with x1830962858148736 ext(0->1048575) 00002000:00010000:0.0:1746143108.593340:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092997800 00000100:00100000:0.0:1746143108.593795:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5374 00000100:00100000:0.0:1746143108.593801:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858148736:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143108.604758:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.609121:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.613313:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.618563:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858149632 00000100:00100000:0.0:1746143108.618574:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858149632 00010000:00010000:0.0:1746143108.618613:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135e9a200/0x25aee876ca70a4a8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e365 expref: 201 pid: 1037 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143108.618654:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858149760 00000100:00100000:0.0:1746143108.618657:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858149760 00010000:00010000:0.0:1746143108.618682:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8600/0x25aee876ca70a4af lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e373 expref: 202 pid: 1037 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143108.618711:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5851 00000100:00100000:0.0:1746143108.618720:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1968:x1830962858149760:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143108.618731:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143108.618736:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8600/0x25aee876ca70a4af lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e373 expref: 202 pid: 1037 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.618759:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8600/0x25aee876ca70a4af lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e373 expref: 202 pid: 1037 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.618828:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143108.619076:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9600/0x25aee876ca70a4c4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143108.619086:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9600/0x25aee876ca70a4c4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143108.619093:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9600/0x25aee876ca70a4c4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143108.619110:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143108.619157:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1968:x1830962858149760:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 438us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.619165:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5851 00000100:00100000:0.0:1746143108.632792:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.639113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.641337:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.641357:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858150272 00000100:00100000:0.0:1746143108.641366:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858150272 00000100:00100000:0.0:1746143108.641394:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7932 00000100:00100000:0.0:1746143108.641401:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30328:x1830962858150272:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143108.641411:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.641421:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70a4d9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e396 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.641462:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70a4d9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e396 expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.641471:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70a4d9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e396 expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.641480:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143108.641482:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143108.641485:0:14795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba21400/0x25aee876ca70a4d2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e38f expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.641491:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb3800, rc 0) 00000100:00100000:0.0:1746143108.641519:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30328:x1830962858150272:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 119us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.641524:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7932 00000100:00100000:0.0:1746143108.655745:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861060224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.655789:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.655811:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861060736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.655830:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861060352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.655846:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.655873:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861060864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.656091:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.656118:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861061376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.656132:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.656144:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861061888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.656158:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.656181:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861061376 00000100:00100000:0.0:1746143108.656184:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861061376 00000100:00100000:0.0:1746143108.656196:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861061888 00000100:00100000:0.0:1746143108.656198:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861061888 00000100:00100000:0.0:1746143108.656205:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11184 00000100:00100000:0.0:1746143108.656210:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3300:x1830962861060992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.656308:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3300:x1830962861060992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (484us total) trans 21474839830 rc 0/0 00000100:00100000:0.0:1746143108.656314:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11184 00000100:00100000:0.0:1746143108.656326:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11187 00000100:00100000:0.0:1746143108.656330:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3299:x1830962861061376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143108.656590:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143108.656593:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.656594:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.656596:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.656598:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143108.656620:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3299:x1830962861061376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 289us (485us total) trans 17179872588 rc 0/0 00000100:00100000:0.0:1746143108.656625:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11187 00000100:00100000:0.0:1746143108.656655:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.656676:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861061248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.656692:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.656702:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861061760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.656714:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143108.656743:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe79f80/2, rc 0, transno 21474839829 00000100:00100000:0.0:1746143108.656959:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861060224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143108.656964:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143108.656969:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861061120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.656985:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.656994:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861061632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.657006:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.657019:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143108.657027:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861062016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.657062:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143108.657082:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe79880/2, rc 0, transno 21474839828 00000100:00100000:0.0:1746143108.657085:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861060480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143108.657091:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800942c4e00/2, rc 0, transno 21474839830 00000100:00100000:0.0:1746143108.657094:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861060992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143108.657108:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7aa00/2, rc 0, transno 21474839831 00000100:00100000:0.0:1746143108.657111:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861060352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143108.657116:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800942c5c00/2, rc 0, transno 21474839833 00000100:00100000:0.0:1746143108.657118:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861060864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143108.657123:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc8700/2, rc 0, transno 17179872588 00000100:00100000:0.0:1746143108.657126:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861061376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143108.657140:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090f23480/2, rc 0, transno 17179872589 00000100:00100000:0.0:1746143108.657143:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861061888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143108.657153:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861061120 00000100:00100000:0.0:1746143108.657155:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861061120 00000100:00100000:0.0:1746143108.659876:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11198 00000100:00100000:0.0:1746143108.659886:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3302:x1830962861061120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143108.660008:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143108.660011:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.660014:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.660015:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143107 -> 1746143107 00002000:00010000:0.0:1746143108.660017:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143108.660333:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3302:x1830962861061120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 447us (3343us total) trans 17179872595 rc 0/0 00000100:00100000:0.0:1746143108.660340:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11198 00000100:00100000:0.0:1746143108.664367:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858150528 00000100:00100000:0.0:1746143108.664373:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858150528 00000100:00100000:0.0:1746143108.664406:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3305 00000100:00100000:0.0:1746143108.664413:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5213850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30331:x1830962858150528:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:0.0:1746143108.664713:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5213850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30331:x1830962858150528:12345-192.168.201.28@tcp:49:cat.0 Request processed in 299us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.664723:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3305 00000100:00100000:0.0:1746143108.664948:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858150784 00000100:00100000:0.0:1746143108.664952:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858150784 00000100:00100000:0.0:1746143108.664972:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7933 00000100:00100000:0.0:1746143108.664977:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:30332:x1830962858150784:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143108.664996:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.665008:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e18400/0x25aee876ca70a4e7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e3a4 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.665059:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e18400/0x25aee876ca70a4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3a4 expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.665070:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e18400/0x25aee876ca70a4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3a4 expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.665082:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143108.665084:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143108.665087:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e18400, rc 0) 00000100:00100000:0.0:1746143108.665105:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30332:x1830962858150784:12345-192.168.201.28@tcp:101:cat.0 Request processed in 127us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.665110:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7933 00000100:00100000:0.0:1746143108.671444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.672928:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858151040 00000100:00100000:0.0:1746143108.672932:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858151040 00000100:00100000:0.0:1746143108.672974:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 592 00000100:00100000:0.0:1746143108.672980:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1970:x1830962858151040:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143108.672990:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143108.673007:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e18400/0x25aee876ca70a4e7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3a4 expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.673020:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143108.673024:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143108.673084:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:1970:x1830962858151040:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 103us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.673091:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 592 00000100:00100000:0.0:1746143108.678069:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.680160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.680196:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.681202:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.686167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.697899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.702218:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858151808:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 20219us (21015us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143108.702228:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5377 00002000:00100000:0.0:1746143108.702239:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008e80f480 x1830962858151808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:259/0 lens 488/440 e 0 to 0 dl 1746143119 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143108.702248:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f480 with x1830962858151808 ext(1048576->2097151) 00002000:00010000:0.0:1746143108.702253:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80f480 00000100:00100000:0.0:1746143108.712990:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.713086:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.713113:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.716363:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.717608:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.726428:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.730118:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.736420:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858152960:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20742us (23326us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143108.736431:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5381 00002000:00100000:0.0:1746143108.736447:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008fe7b480 x1830962858152960/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:259/0 lens 488/440 e 0 to 0 dl 1746143119 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143108.736456:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b480 with x1830962858152960 ext(1048576->2097151) 00002000:00010000:0.0:1746143108.736461:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7b480 00000100:00100000:0.0:1746143108.748972:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.749027:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.752404:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.755236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.767234:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.785862:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.801221:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.805610:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.816213:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.820290:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.832953:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.836945:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.840963:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.843427:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.862384:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.865756:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.866824:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.869874:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.869925:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.869951:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.869980:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.876068:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.877026:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.877091:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.877110:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.877124:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858158464 00000100:00100000:0.0:1746143108.877127:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858158464 00002000:00100000:0.0:1746143108.877144:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5840000 x1830962858158464/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:259/0 lens 488/0 e 0 to 0 dl 1746143119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143108.877156:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840000 with x1830962858158464 ext(3145728->4194303) 00002000:00010000:0.0:1746143108.877160:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840000 00000100:00100000:0.0:1746143108.877173:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5390 00000100:00100000:0.0:1746143108.877178:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858158464:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143108.881099:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.885582:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.885609:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858159232 00000100:00100000:0.0:1746143108.885615:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858159232 00000100:00100000:0.0:1746143108.885673:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7936 00000100:00100000:0.0:1746143108.885681:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30337:x1830962858159232:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143108.885706:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.885724:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70a588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e422 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.885827:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.885839:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.885849:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.885869:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.885874:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.885879:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.885982:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43ac00/0x25aee876ca70a59d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.885990:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43ac00/0x25aee876ca70a59d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.885995:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43ac00/0x25aee876ca70a59d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:0.0:1746143108.886004:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143108.886102:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886109:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886115:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886120:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b43b000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143108.886124:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886131:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886146:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143108.886149:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143108.886152:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886157:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70a58f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886172:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886178:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886182:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886187:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b43a600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143108.886189:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886194:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886200:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800931f2700) 00010000:00010000:0.0:1746143108.886202:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143108.886204:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886209:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43a600/0x25aee876ca70a596 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143108.886242:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70a588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e422 expref: 12 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.886259:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43ac00/0x25aee876ca70a59d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e422 expref: 11 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.886266:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143108.886268:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143108.886270:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b43ac00, rc 0) 00000100:00100000:0.0:1746143108.886303:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30337:x1830962858159232:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 623us (731us total) trans 8589942115 rc 0/0 00000100:00100000:0.0:1746143108.886309:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7936 00000100:00100000:0.0:1746143108.907013:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.911812:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.913915:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.920395:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.920442:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.922759:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.923712:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.933771:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.941304:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.952859:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858161280 00000100:00100000:0.0:1746143108.952867:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858161280 00010000:00010000:0.0:1746143108.952908:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7be00/0x25aee876ca70a3b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e318 expref: 11 pid: 22204 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746143108.952931:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858161152 00000100:00100000:0.0:1746143108.952933:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858161152 00010000:00010000:0.0:1746143108.952943:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff27600/0x25aee876ca70a4e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e39d expref: 29 pid: 754 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143108.952977:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858161408 00000100:00100000:0.0:1746143108.952980:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858161408 00010000:00010000:0.0:1746143108.952990:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe83a00/0x25aee876ca70a4cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e388 expref: 14 pid: 8169 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143108.953005:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5860 00000100:00100000:0.0:1746143108.953010:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858161152:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143108.953018:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143108.953029:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff27600/0x25aee876ca70a4e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e39d expref: 29 pid: 754 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.953064:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff27600/0x25aee876ca70a4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e39d expref: 29 pid: 754 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.953083:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff27600/0x25aee876ca70a4e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e39d expref: 29 pid: 754 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.953099:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143108.953117:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858161152:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 106us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143108.953122:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5860 00000100:00100000:0.0:1746143108.953134:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5861 00000100:00100000:0.0:1746143108.953139:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858161408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143108.953145:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143108.953158:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe83a00/0x25aee876ca70a4cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e388 expref: 13 pid: 8169 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.953167:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe83a00/0x25aee876ca70a4cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e388 expref: 13 pid: 8169 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.953177:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe83a00/0x25aee876ca70a4cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e388 expref: 13 pid: 8169 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143108.953185:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.953187:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143108.953192:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70a5ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e43e expref: 12 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.953199:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70a5ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e43e expref: 12 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143108.953225:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70a5ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e43e expref: 12 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143108.953237:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861064832:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143108.953278:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143108.954098:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858161536 00000100:00100000:0.0:1746143108.954102:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858161536 00000100:00100000:0.0:1746143108.954130:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11216 00000100:00100000:0.0:1746143108.954135:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858161536:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143108.954146:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143108.954162:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094256c00/0x25aee876ca70a5d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e445 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143108.954187:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861064960:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143108.954234:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143108.955937:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.956927:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861064960:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143108.956955:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094256c00/0x25aee876ca70a5d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e445 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.956966:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094256c00/0x25aee876ca70a5d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e445 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143108.956976:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094256c00, rc 0) 00000100:00100000:0.0:1746143108.957009:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858161536:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2873us (2984us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143108.957015:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11216 00000100:00100000:0.0:1746143108.958704:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.960630:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.964862:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.966207:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.971689:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.973713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.981925:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.982331:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.983623:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.991329:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.997149:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143108.998090:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.049282:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.053205:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.056274:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.057101:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.067498:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.071197:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.195144:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.200979:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.202299:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.244955:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.253797:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.254093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.258995:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.259135:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.259166:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858166528 00000100:00100000:0.0:1746143109.259170:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858166528 00000100:00100000:0.0:1746143109.259190:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11222 00000100:00100000:0.0:1746143109.259196:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858166528:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143109.259205:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143109.259215:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094256600/0x25aee876ca70a67d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e48b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143109.259247:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861066752:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143109.260239:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143109.263118:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861066752:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143109.263157:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094256600/0x25aee876ca70a67d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e48b expref: 12 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143109.263170:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094256600/0x25aee876ca70a67d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e48b expref: 12 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143109.263199:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094256600, rc 0) 00000100:00100000:0.0:1746143109.263223:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858166528:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4027us (4089us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143109.263229:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11222 00000100:00100000:0.0:1746143109.277151:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.279613:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861067136:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143109.279637:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143109.280302:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858167040:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11377us (11865us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143109.280313:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5872 00000100:00100000:0.0:1746143109.283432:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858168064 00000100:00100000:0.0:1746143109.283439:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858168064 00002000:00100000:0.0:1746143109.283468:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1970175) req@ffff8800942c7100 x1830962858168064/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:260/0 lens 488/0 e 0 to 0 dl 1746143120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143109.283477:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7100 with x1830962858168064 ext(1048576->1970175) 00002000:00010000:0.0:1746143109.283481:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c7100 00000100:00100000:0.0:1746143109.283495:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858168320 00000100:00100000:0.0:1746143109.283497:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858168320 00002000:00100000:0.0:1746143109.283507:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1232896->2097151) req@ffff8800942c4000 x1830962858168320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:260/0 lens 488/0 e 0 to 0 dl 1746143120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143109.283524:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4000 with x1830962858168320 ext(1232896->2097151) 00002000:00010000:0.0:1746143109.283527:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c4000 00000100:00100000:0.0:1746143109.283540:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5401 00000100:00100000:0.0:1746143109.283546:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858168064:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143109.291205:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.293488:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.308804:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.328864:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:0.0:1746143109.341192:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143107 -> 1746143108 00000100:00100000:0.0:1746143109.341216:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861067776:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143109.341242:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd19a00/0x25aee876ca70a6c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4ae expref: 20 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143109.341257:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd19a00/0x25aee876ca70a6c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4ae expref: 20 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143109.341291:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd19a00, rc 0) 00000100:00100000:0.0:1746143109.341330:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858169344:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5447us (6525us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143109.341340:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11227 00000100:00100000:0.0:1746143109.350749:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.352661:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.357290:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.365411:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.369995:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858169984:12345-192.168.201.28@tcp:4:cat.0 Request processed in 4417us (4585us total) trans 17179872597 rc 0/0 00000100:00100000:0.0:1746143109.370006:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1794 00002000:00100000:0.0:1746143109.370016:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1970176->2097151) req@ffff880092a72d80 x1830962858169984/t17179872597(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:260/0 lens 488/448 e 0 to 0 dl 1746143120 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143109.370026:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72d80 with x1830962858169984 ext(1970176->2097151) 00010000:00010000:0.0:1746143109.370050:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70a5ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e43e expref: 14 pid: 8169 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.370061:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70a5ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e43e expref: 14 pid: 8169 timeout: 991 lvb_type: 0 00002000:00010000:0.0:1746143109.370068:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a72d80 00000100:00100000:0.0:1746143109.375514:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.375580:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.375870:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5873 00000100:00100000:0.0:1746143109.375878:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858170112:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143109.375892:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143109.375910:0:7112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143107 -> 1746143108 00010000:00010000:0.0:1746143109.375917:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70a5ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e43e expref: 14 pid: 8169 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.375928:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70a5ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e43e expref: 14 pid: 8169 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.375952:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70a5ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e43e expref: 14 pid: 8169 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.376836:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143109.376839:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143109.376846:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132051000/0x25aee876ca70a6d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4c3 expref: 29 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143109.376856:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132051000/0x25aee876ca70a6d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4c3 expref: 29 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143109.376878:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132051000/0x25aee876ca70a6d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4c3 expref: 29 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143109.376887:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e037480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861068288:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143109.376926:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143109.379715:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861068160:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143109.379734:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143109.379776:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858170240:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3643us (4194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143109.379786:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5874 00000100:00100000:0.0:1746143109.387773:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858170496 00000100:00100000:0.0:1746143109.387781:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858170496 00002000:00100000:0.0:1746143109.387822:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800942c5880 x1830962858170496/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:260/0 lens 488/0 e 0 to 0 dl 1746143120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143109.387834:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5880 with x1830962858170496 ext(2097152->3145727) 00002000:00010000:0.0:1746143109.387838:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c5880 00000100:00100000:0.0:1746143109.387852:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858170752 00000100:00100000:0.0:1746143109.387862:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858170752 00002000:00100000:0.0:1746143109.387875:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800942c6300 x1830962858170752/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:260/0 lens 488/0 e 0 to 0 dl 1746143120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143109.387882:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6300 with x1830962858170752 ext(1048576->2097151) 00002000:00010000:0.0:1746143109.387885:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c6300 00000100:00100000:0.0:1746143109.387910:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5405 00000100:00100000:0.0:1746143109.387916:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858170496:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143109.421855:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.428152:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.429771:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.437550:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858171264 00000100:00100000:0.0:1746143109.437558:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858171264 00002000:00100000:0.0:1746143109.437597:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1232895) req@ffff8800942c5500 x1830962858171264/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:260/0 lens 488/0 e 0 to 0 dl 1746143120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143109.437606:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5500 with x1830962858171264 ext(1048576->1232895) 00010000:00010000:0.0:1746143109.437615:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009490a400/0x25aee876ca70a5ea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e45a expref: 13 pid: 8450 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.437636:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009490a400/0x25aee876ca70a5ea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e45a expref: 13 pid: 8450 timeout: 991 lvb_type: 0 00002000:00010000:0.0:1746143109.437644:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c5500 00000100:00100000:0.0:1746143109.437663:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1796 00000100:00100000:0.0:1746143109.437670:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858171264:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143109.455063:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.455155:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.455170:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.455187:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858171648 00000100:00100000:0.0:1746143109.455194:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858171648 00010000:00010000:0.0:1746143109.455225:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70a511 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3ce expref: 20 pid: 754 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746143109.455245:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858171776 00000100:00100000:0.0:1746143109.455247:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858171776 00010000:00010000:0.0:1746143109.455256:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70a3c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e326 expref: 10 pid: 22204 timeout: 991 lvb_type: 1 00000100:00100000:0.0:1746143109.455269:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5875 00000100:00100000:0.0:1746143109.455276:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e037480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858171648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143109.455287:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143109.455307:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70a511 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3ce expref: 20 pid: 754 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.455317:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70a511 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3ce expref: 20 pid: 754 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.455335:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70a511 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3ce expref: 20 pid: 754 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.455351:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143109.455386:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e037480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858171648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 105us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143109.455391:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5875 00000100:00100000:0.0:1746143109.455433:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.455461:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.456645:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858171520 00000100:00100000:0.0:1746143109.456649:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858171520 00010000:00010000:0.0:1746143109.456663:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009490b000/0x25aee876ca70a676 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e484 expref: 19 pid: 8450 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746143109.456680:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5877 00000100:00100000:0.0:1746143109.456684:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858172160:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143109.456691:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143109.456699:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba21c00/0x25aee876ca70a518 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3d5 expref: 21 pid: 8448 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.456708:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba21c00/0x25aee876ca70a518 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3d5 expref: 21 pid: 8448 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.456719:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba21c00/0x25aee876ca70a518 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e3d5 expref: 21 pid: 8448 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143109.456728:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143109.456730:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143109.456959:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132050000/0x25aee876ca70a6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4d8 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143109.456967:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132050000/0x25aee876ca70a6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4d8 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143109.456998:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132050000/0x25aee876ca70a6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4d8 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143109.457015:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861069056:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143109.457270:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143109.460850:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861069312:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143109.460863:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143109.460888:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858172288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2432us (3708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143109.460895:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5879 00000100:00100000:0.0:1746143109.461217:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858172672 00000100:00100000:0.0:1746143109.461221:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858172672 00000100:00100000:0.0:1746143109.461251:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 595 00000100:00100000:0.0:1746143109.461256:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:1969:x1830962858172672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143109.461265:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143109.461280:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f8bc00/0x25aee876ca70a702 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4df expref: 208 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143109.461293:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143109.461296:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143109.461315:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1969:x1830962858172672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 58us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143109.461321:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 595 00000100:00100000:0.0:1746143109.464599:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.464679:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.466572:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.466599:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.476310:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.488214:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.488287:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.500106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.501890:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.502080:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.502102:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.502135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:0.0:1746143109.507125:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143107 -> 1746143108 00000100:00100000:0.0:1746143109.507138:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861070208:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143109.507157:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b42fb600/0x25aee876ca70a725 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4fb expref: 16 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143109.507167:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b42fb600/0x25aee876ca70a725 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e4fb expref: 16 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143109.507184:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b42fb600, rc 0) 00000100:00100000:0.0:1746143109.507206:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858174720:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5227us (5316us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143109.507212:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11236 00000100:00100000:0.0:1746143109.515708:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.516989:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.530427:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.532656:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.534204:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.545578:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.545852:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.547707:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.553804:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.553893:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.570775:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.570815:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.571134:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.571259:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5417 00000100:00100000:0.0:1746143109.571265:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858178304:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143109.575356:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.576578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.576619:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.592650:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858178048:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21435us (21829us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143109.592659:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5415 00002000:00100000:0.0:1746143109.592668:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880092a7b480 x1830962858178048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:260/0 lens 488/440 e 0 to 0 dl 1746143120 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143109.592676:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a7b480 with x1830962858178048 ext(3145728->4194303) 00002000:00010000:0.0:1746143109.592681:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a7b480 00000100:00100000:0.0:1746143109.599964:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858178944 00000100:00100000:0.0:1746143109.599972:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858178944 00000100:00100000:0.0:1746143109.600110:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11245 00000100:00100000:0.0:1746143109.600118:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858178944:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143109.600133:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143109.600146:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70a764 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e53a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143109.600261:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861071104:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143109.600338:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143109.609976:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.617397:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.643165:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.738692:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.745700:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.745751:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.756120:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.761977:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.764928:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.773399:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.776159:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.783506:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.784544:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.799813:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.804011:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.809375:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.813682:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.821574:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.824236:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.836889:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.841514:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.843283:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.860245:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.860296:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.880446:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.891617:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.899019:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.902173:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.907048:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.918049:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.928986:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.933628:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.945852:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.945884:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.948227:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.949967:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.951734:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3320 00000100:00100000:0.0:1746143109.951970:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:30377:x1830962858186624:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:0.0:1746143109.952129:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:30377:x1830962858186624:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 161us (3905us total) trans 8589942138 rc 0/0 00000100:00100000:0.0:1746143109.952135:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3320 00000100:00100000:0.0:1746143109.983160:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.983204:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143109.985770:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858186112:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39458us (39924us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143109.985779:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5428 00002000:00100000:0.0:1746143109.985789:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880091980000 x1830962858186112/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:260/0 lens 488/440 e 0 to 0 dl 1746143120 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143109.985797:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980000 with x1830962858186112 ext(2097152->3145727) 00002000:00010000:0.0:1746143109.985801:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091980000 00000100:00100000:0.0:1746143109.996279:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.002113:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.015772:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.032213:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.060132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143110.061472:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143110.075734:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143110.075916:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143110.082111:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.084701:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.084735:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.086815:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861072640:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143110.086823:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861072768:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143110.086829:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5840380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861072896:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143110.086855:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba21600/0x25aee876ca70a875 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [774144->1048575] (req 774144->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e5a3 expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.086866:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba21600, rc 0) 00000100:00100000:0.0:1746143110.086883:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30377:x1830962858188288:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10912us (11157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143110.086890:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11254 00000100:00080000:0.0:1746143110.087313:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143110.088128:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.092495:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.092522:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.096348:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.102019:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143110.102673:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143110.107447:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.108588:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.111021:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.113259:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.122404:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.136985:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143110.138465:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143110.141448:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.144847:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.153133:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.154377:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.154407:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.154421:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858191232 00000100:00100000:0.0:1746143110.154425:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858191232 00000100:00100000:0.0:1746143110.154450:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858191360 00000100:00100000:0.0:1746143110.154453:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858191360 00000100:00100000:0.0:1746143110.154464:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11258 00000100:00100000:0.0:1746143110.154469:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858191232:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143110.154478:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143110.154488:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70a8ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e5c6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143110.154531:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f358000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861074176:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143110.154557:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450f00 going to sleep for 11 seconds 00000100:00080000:0.0:1746143110.154568:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143110.154905:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.154939:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.155146:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.172429:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.178511:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143110.179693:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6798c00/0x25aee876ca70a8d7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143110.179700:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6798c00/0x25aee876ca70a8d7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:0.0:1746143110.179718:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143110.180027:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6798400/0x25aee876ca70a8d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e5e9 expref: 11 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.180080:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6798c00/0x25aee876ca70a8d7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e5e9 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.180086:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143110.180088:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143110.180090:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6798c00, rc 0) 00000100:00100000:0.0:1746143110.180118:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30383:x1830962858192000:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7439us (7697us total) trans 8589942144 rc 0/0 00000100:00100000:0.0:1746143110.180125:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7952 00000100:00100000:0.0:1746143110.182580:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.193275:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.200656:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.201851:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.201911:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.202491:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858192640 00000100:00100000:0.0:1746143110.202503:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858192640 00000100:00100000:0.0:1746143110.202528:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858192768 00000100:00100000:0.0:1746143110.202530:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858192768 00000100:00100000:0.0:1746143110.202544:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11264 00000100:00100000:0.0:1746143110.202549:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858192640:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143110.202558:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143110.202569:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba20e00/0x25aee876ca70a8fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e5fe expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143110.202597:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861074816:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143110.204750:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143110.210791:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.223175:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.223263:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.223894:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.225686:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1805 00000100:00100000:0.0:1746143110.225694:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858194304:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143110.240481:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858194304:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 14786us (16585us total) trans 21474839843 rc 0/0 00000100:00100000:0.0:1746143110.240489:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1805 00002000:00100000:0.0:1746143110.240495:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fc:0x0] (774144->1048575) req@ffff88009f35b100 x1830962858194304/t21474839843(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:261/0 lens 488/448 e 0 to 0 dl 1746143121 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143110.240503:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35b100 with x1830962858194304 ext(774144->1048575) 00010000:00010000:0.0:1746143110.240509:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba21600/0x25aee876ca70a875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e5a3 expref: 22 pid: 8169 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.240529:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba21600/0x25aee876ca70a875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e5a3 expref: 22 pid: 8169 timeout: 992 lvb_type: 0 00002000:00010000:0.0:1746143110.240536:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f35b100 00010000:00010000:0.0:1746143110.246717:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.246727:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.246748:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.246755:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.246762:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.246767:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c044000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143110.246771:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.246778:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.246801:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.246807:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70a932 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143110.247087:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858193152:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 30648us (30944us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143110.247095:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11269 00000100:00100000:0.0:1746143110.249154:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143110.249639:0:754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.249647:0:754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.249662:0:754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.249668:0:754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.249674:0:754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.249680:0:754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e30ce00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143110.249689:0:754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.249695:0:754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.249704:0:754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.249710:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e30ce00/0x25aee876ca70a924 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143110.249760:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858193536:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 33771us (34077us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143110.249767:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11267 00000100:00100000:0.0:1746143110.251807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.254988:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.257821:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858196224 00000100:00100000:0.0:1746143110.257825:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858196224 00010000:00010000:0.0:1746143110.258023:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43ac00/0x25aee876ca70a59d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e422 expref: 23 pid: 14795 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746143110.258059:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858196480 00000100:00100000:0.0:1746143110.258061:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858196480 00010000:00010000:0.0:1746143110.258068:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba21400/0x25aee876ca70a4d2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e38f expref: 24 pid: 14794 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746143110.258077:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858196352 00000100:00100000:0.0:1746143110.258079:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858196352 00010000:00010000:0.0:1746143110.258093:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70a4d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e396 expref: 214 pid: 14795 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746143110.258109:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5913 00000100:00100000:0.0:1746143110.258114:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858196224:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143110.258123:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143110.258126:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43ac00/0x25aee876ca70a59d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e422 expref: 24 pid: 14795 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258135:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43ac00/0x25aee876ca70a59d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e422 expref: 24 pid: 14795 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258148:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43ac00/0x25aee876ca70a59d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e422 expref: 24 pid: 14795 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258157:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143110.258161:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044a00/0x25aee876ca70a947 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143110.258167:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143110.258190:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858196224:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 76us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143110.258195:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5913 00000100:00100000:0.0:1746143110.258206:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5914 00000100:00100000:0.0:1746143110.258210:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858196480:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143110.258214:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143110.258218:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba21400/0x25aee876ca70a4d2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e38f expref: 22 pid: 14794 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258232:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba21400/0x25aee876ca70a4d2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e38f expref: 22 pid: 14794 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258240:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba21400/0x25aee876ca70a4d2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e38f expref: 22 pid: 14794 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258247:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143110.258250:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044a00/0x25aee876ca70a947 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143110.258255:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143110.258266:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858196480:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 56us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143110.258271:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5914 00000100:00100000:0.0:1746143110.258278:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5915 00000100:00100000:0.0:1746143110.258282:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:1969:x1830962858196352:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143110.258287:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143110.258289:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70a4d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e396 expref: 214 pid: 14795 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258296:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70a4d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e396 expref: 214 pid: 14795 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258303:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70a4d9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e396 expref: 214 pid: 14795 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.258309:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531b00) 00010000:00010000:0.0:1746143110.258315:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044a00/0x25aee876ca70a947 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143110.258319:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143110.258329:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:1969:x1830962858196352:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 47us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143110.258333:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5915 00000100:00100000:0.0:1746143110.286602:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861077376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.286660:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143110.286684:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861077888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.286699:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143110.286710:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861078400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.286723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143110.286731:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861078912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.286742:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143110.286755:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746143110.286760:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861077504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.286771:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143110.286781:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861078016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.286791:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143110.286799:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861078528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.286810:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143110.286819:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861079040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.286830:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143110.286850:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861077376 00000100:00100000:0.0:1746143110.286861:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861077376 00000100:00100000:0.0:1746143110.286894:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861077888 00000100:00100000:0.0:1746143110.286895:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861077888 00000100:00100000:0.0:1746143110.286904:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861078400 00000100:00100000:0.0:1746143110.286905:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861078400 00000100:00100000:0.0:1746143110.286915:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861078912 00000100:00100000:0.0:1746143110.286916:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861078912 00000100:00100000:0.0:1746143110.286924:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861077504 00000100:00100000:0.0:1746143110.286925:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861077504 00000100:00100000:0.0:1746143110.286931:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861078016 00000100:00100000:0.0:1746143110.286932:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861078016 00000100:00100000:0.0:1746143110.286936:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861078528 00000100:00100000:0.0:1746143110.286938:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861078528 00000100:00100000:0.0:1746143110.286943:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861079040 00000100:00100000:0.0:1746143110.286944:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861079040 00000100:00100000:0.0:1746143110.286952:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11272 00000100:00100000:0.0:1746143110.286958:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3299:x1830962861077376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.287130:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3299:x1830962861077376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (470us total) trans 17179872603 rc 0/0 00000100:00100000:0.0:1746143110.287136:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11272 00000100:00100000:0.0:1746143110.287148:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11273 00000100:00100000:0.0:1746143110.287153:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3299:x1830962861077888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.287228:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3299:x1830962861077888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (527us total) trans 17179872604 rc 0/0 00000100:00100000:0.0:1746143110.287232:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11273 00000100:00100000:0.0:1746143110.287241:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11274 00000100:00100000:0.0:1746143110.287244:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3299:x1830962861078400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.287336:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3299:x1830962861078400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (611us total) trans 21474839845 rc 0/0 00000100:00100000:0.0:1746143110.287348:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11274 00000100:00100000:0.0:1746143110.287357:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11275 00000100:00100000:0.0:1746143110.287361:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3299:x1830962861078912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.287433:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3299:x1830962861078912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (688us total) trans 21474839846 rc 0/0 00000100:00100000:0.0:1746143110.287438:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11275 00000100:00100000:0.0:1746143110.287447:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11276 00000100:00100000:0.0:1746143110.287450:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3299:x1830962861077504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.287525:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3299:x1830962861077504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (752us total) trans 17179872605 rc 0/0 00000100:00100000:0.0:1746143110.287530:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11276 00000100:00100000:0.0:1746143110.287539:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11277 00000100:00100000:0.0:1746143110.287543:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3299:x1830962861078016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.287626:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3299:x1830962861078016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (819us total) trans 17179872606 rc 0/0 00000100:00100000:0.0:1746143110.287632:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11277 00000100:00100000:0.0:1746143110.287640:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11278 00000100:00100000:0.0:1746143110.287644:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3299:x1830962861078528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.287716:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3299:x1830962861078528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (904us total) trans 21474839847 rc 0/0 00000100:00100000:0.0:1746143110.287721:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11278 00000100:00100000:0.0:1746143110.287732:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11279 00000100:00100000:0.0:1746143110.287736:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3299:x1830962861079040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143110.287806:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143110.287809:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143110.287811:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143110.287813:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143110.287814:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143110.287862:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3299:x1830962861079040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (1030us total) trans 21474839848 rc 0/0 00000100:00100000:0.0:1746143110.287867:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11279 00000100:00080000:0.0:1746143110.287887:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143110.287890:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746143110.287917:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5841180/2, rc 0, transno 17179872605 00000100:00100000:0.0:1746143110.287923:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861077504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143110.287930:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092a7b100/2, rc 0, transno 17179872606 00000100:00100000:0.0:1746143110.287933:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861078016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143110.287940:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e80fb80/2, rc 0, transno 21474839847 00000100:00100000:0.0:1746143110.287948:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861078528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143110.287955:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e80d180/2, rc 0, transno 21474839848 00000100:00100000:0.0:1746143110.287958:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861079040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143110.287964:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5843100/2, rc 0, transno 17179872603 00000100:00100000:0.0:1746143110.287966:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861077376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143110.287972:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1e8700/2, rc 0, transno 17179872604 00000100:00100000:0.0:1746143110.287974:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861077888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143110.287980:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a531b800/2, rc 0, transno 21474839845 00000100:00100000:0.0:1746143110.287982:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861078400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143110.287997:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e80c380/2, rc 0, transno 21474839846 00000100:00100000:0.0:1746143110.288000:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861078912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.291898:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.298982:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.306341:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.309270:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.309367:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.309449:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.309466:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.309656:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.328173:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.329081:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.331951:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.331982:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.331997:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.332020:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.332060:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858198528 00000100:00100000:0.0:1746143110.332066:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858198528 00000100:00100000:0.0:1746143110.332096:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858198656 00000100:00100000:0.0:1746143110.332098:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858198656 00000100:00100000:0.0:1746143110.332115:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858198912 00000100:00100000:0.0:1746143110.332117:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858198912 00000100:00100000:0.0:1746143110.332129:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858199168 00000100:00100000:0.0:1746143110.332131:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858199168 00000100:00100000:0.0:1746143110.332143:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5436 00000100:00100000:0.0:1746143110.332149:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858198528:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143110.332167:0:31432:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ba20800/0x25aee876ca70a99b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.332185:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143110.332187:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143110.332191:0:31432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba20800/0x25aee876ca70a99b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.332200:0:31432:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba20800/0x25aee876ca70a99b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143110.343702:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.345370:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.346125:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5441 00000100:00100000:0.0:1746143110.346132:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:1968:x1830962858199680:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143110.346152:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cb78c00/0x25aee876ca70a9be lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.346160:0:21520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143110.346161:0:21520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143110.346166:0:21520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb78c00/0x25aee876ca70a9be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.346175:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb78c00/0x25aee876ca70a9be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143110.431585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.436472:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.440543:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.447372:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.450787:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.453258:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.455482:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.461205:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.469320:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.472323:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.483673:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.496202:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.500646:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.500686:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.500713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.500728:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.500741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.500955:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.506125:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.510026:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.541144:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861081472 00000100:00100000:0.0:1746143110.541149:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861081472 00000100:00100000:0.0:1746143110.541174:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11309 00000100:00100000:0.0:1746143110.541180:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3302:x1830962861081472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143110.541278:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143110.541281:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143109 -> 1746143109 00002000:00010000:0.0:1746143110.541282:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143108 -> 1746143108 00002000:00010000:0.0:1746143110.541284:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143109 -> 1746143109 00002000:00010000:0.0:1746143110.541286:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143110.541313:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3302:x1830962861081472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (191us total) trans 17179872615 rc 0/0 00000100:00100000:0.0:1746143110.541328:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11309 00000100:00100000:0.0:1746143110.542934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.542961:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861081344 00000100:00100000:0.0:1746143110.542965:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861081344 00000100:00100000:0.0:1746143110.542994:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861081984 00000100:00100000:0.0:1746143110.542997:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861081984 00000100:00100000:0.0:1746143110.543006:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861082496 00000100:00100000:0.0:1746143110.543008:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861082496 00000100:00100000:0.0:1746143110.543021:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861083008 00000100:00100000:0.0:1746143110.543023:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861083008 00000100:00100000:0.0:1746143110.543049:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861081856 00000100:00100000:0.0:1746143110.543051:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861081856 00000100:00100000:0.0:1746143110.543059:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861082880 00000100:00100000:0.0:1746143110.543061:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861082880 00000100:00100000:0.0:1746143110.543072:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11310 00000100:00100000:0.0:1746143110.543077:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3301:x1830962861081344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.543132:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11312 00000100:00100000:0.0:1746143110.543137:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3302:x1830962861082496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.545554:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3302:x1830962861082496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2415us (2747us total) trans 21474839859 rc 0/0 00000100:00100000:0.0:1746143110.545561:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11312 00000100:00100000:0.0:1746143110.545575:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11316 00000100:00100000:0.0:1746143110.545582:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3301:x1830962861082880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143110.545673:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143110.545676:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143110.545678:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143110.545679:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143110.545689:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143110.545718:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3301:x1830962861082880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (2737us total) trans 21474839861 rc 0/0 00000100:00100000:0.0:1746143110.545724:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11316 00000100:00100000:0.0:1746143110.545734:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861082240 00000100:00100000:0.0:1746143110.545738:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861082240 00000100:00100000:0.0:1746143110.545752:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11317 00000100:00100000:0.0:1746143110.545991:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3300:x1830962861081728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143110.546108:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3300:x1830962861081728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (3098us total) trans 17179872618 rc 0/0 00000100:00100000:0.0:1746143110.546114:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11317 00000100:00100000:0.0:1746143110.546127:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11319 00000100:00100000:0.0:1746143110.546132:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3300:x1830962861082752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.546213:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3300:x1830962861082752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (460us total) trans 21474839862 rc 0/0 00000100:00100000:0.0:1746143110.546219:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11319 00002000:00010000:0.0:1746143110.546291:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143110.546293:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143109 -> 1746143109 00002000:00010000:0.0:1746143110.546295:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143108 -> 1746143108 00002000:00010000:0.0:1746143110.546297:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143109 -> 1746143109 00002000:00010000:0.0:1746143110.546299:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143110.546321:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3301:x1830962861081344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3244us (4034us total) trans 17179872619 rc 0/0 00000100:00100000:0.0:1746143110.546326:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11310 00000100:00100000:0.0:1746143110.555119:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.591889:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.597106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.599327:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.605672:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.606544:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858204160 00000100:00100000:0.0:1746143110.606548:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858204160 00000100:00100000:0.0:1746143110.606573:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7963 00000100:00100000:0.0:1746143110.606579:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30396:x1830962858204160:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143110.606591:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143110.606602:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136768600/0x25aee876ca70aa66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e698 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.606684:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136768800/0x25aee876ca70aa6d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143110.606695:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136768800/0x25aee876ca70aa6d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143110.606705:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136768800/0x25aee876ca70aa6d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143110.606714:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143110.606826:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136768600/0x25aee876ca70aa66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e698 expref: 202 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.606843:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136768800/0x25aee876ca70aa6d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e698 expref: 201 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.606850:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143110.606852:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746143110.606855:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136768800, rc 0) 00000100:00100000:0.0:1746143110.606901:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30396:x1830962858204160:12345-192.168.201.28@tcp:101:cat.0 Request processed in 322us (452us total) trans 8589942153 rc 0/0 00000100:00100000:0.0:1746143110.606908:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7963 00000100:00100000:0.0:1746143110.611000:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.611070:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.625815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.639777:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.639820:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.640840:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858204672:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14679us (15032us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143110.640848:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5442 00002000:00100000:0.0:1746143110.640855:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009314d180 x1830962858204672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:261/0 lens 488/440 e 0 to 0 dl 1746143121 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143110.640864:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314d180 with x1830962858204672 ext(0->1048575) 00002000:00010000:0.0:1746143110.640868:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314d180 00000100:00100000:0.0:1746143110.671877:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858205824 00000100:00100000:0.0:1746143110.671885:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858205824 00010000:00010000:0.0:1746143110.671912:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9e00/0x25aee876ca70a9d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e652 expref: 14 pid: 22204 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746143110.671932:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5928 00000100:00100000:0.0:1746143110.671939:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858205824:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143110.671948:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143110.671967:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9e00/0x25aee876ca70a9d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e652 expref: 14 pid: 22204 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.671988:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9e00/0x25aee876ca70a9d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e652 expref: 14 pid: 22204 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.672005:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9e00/0x25aee876ca70a9d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e652 expref: 14 pid: 22204 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143110.672021:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143110.672023:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143110.672028:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5377800/0x25aee876ca70aa90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6ad expref: 32 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.672057:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5377800/0x25aee876ca70aa90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6ad expref: 32 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143110.672086:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5377800/0x25aee876ca70aa90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6ad expref: 32 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143110.672098:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861084032:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143110.672153:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093e409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143110.681248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.682006:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.690459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.701191:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861086208 00000100:00100000:0.0:1746143110.701196:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861086208 00000100:00100000:0.0:1746143110.701342:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11343 00000100:00100000:0.0:1746143110.701348:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3302:x1830962861086080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143110.701459:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3302:x1830962861086080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (297us total) trans 21474839873 rc 0/0 00000100:00100000:0.0:1746143110.701465:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11343 00000100:00100000:0.0:1746143110.706807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.707073:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.722805:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.730570:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.734184:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858207232 00000100:00100000:0.0:1746143110.734192:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858207232 00002000:00100000:0.0:1746143110.734231:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093b58e00 x1830962858207232/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:261/0 lens 488/0 e 0 to 0 dl 1746143121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143110.734242:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58e00 with x1830962858207232 ext(1048576->2097151) 00002000:00010000:0.0:1746143110.734247:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b58e00 00000100:00100000:0.0:1746143110.734279:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5445 00000100:00100000:0.0:1746143110.734287:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858207232:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143110.749687:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.766807:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.766866:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.770281:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.774597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.787092:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.787123:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.787354:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.797598:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.806066:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.814917:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.821544:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.821584:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.830538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.837455:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.840525:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.855305:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.856766:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.858510:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.864364:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861088000:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143110.864382:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143110.864434:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858211200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7145us (7667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143110.864443:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5933 00000100:00100000:0.0:1746143110.866260:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.875368:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.884681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.887001:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.887060:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.887085:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.887545:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5455 00000100:00100000:0.0:1746143110.887550:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858212480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143110.911478:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.917989:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.918726:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.933176:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.950073:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.953228:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.953258:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.953270:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.953298:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143110.953326:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858213760 00000100:00100000:0.0:1746143110.953331:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858213760 00002000:00100000:0.0:1746143110.953359:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009314ce00 x1830962858213760/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:261/0 lens 488/0 e 0 to 0 dl 1746143121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143110.953368:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314ce00 with x1830962858213760 ext(2097152->3145727) 00002000:00010000:0.0:1746143110.953372:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314ce00 00000100:00100000:0.0:1746143110.953383:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858214016 00000100:00100000:0.0:1746143110.953385:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858214016 00002000:00100000:0.0:1746143110.953393:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009314c700 x1830962858214016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:261/0 lens 488/0 e 0 to 0 dl 1746143121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143110.953399:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c700 with x1830962858214016 ext(3145728->4194303) 00002000:00010000:0.0:1746143110.953402:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314c700 00000100:00100000:0.0:1746143110.953407:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858214400 00000100:00100000:0.0:1746143110.953409:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858214400 00002000:00100000:0.0:1746143110.953416:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009314e300 x1830962858214400/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:261/0 lens 488/0 e 0 to 0 dl 1746143121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143110.953423:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314e300 with x1830962858214400 ext(3145728->4194303) 00002000:00010000:0.0:1746143110.953425:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314e300 00000100:00100000:0.0:1746143110.953430:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858214272 00000100:00100000:0.0:1746143110.953431:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858214272 00002000:00100000:0.0:1746143110.953438:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094515180 x1830962858214272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:261/0 lens 488/0 e 0 to 0 dl 1746143121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143110.953443:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515180 with x1830962858214272 ext(2097152->3145727) 00002000:00010000:0.0:1746143110.953452:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094515180 00000100:00100000:0.0:1746143110.953467:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5458 00000100:00100000:0.0:1746143110.953474:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858213760:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143110.956126:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5460 00000100:00100000:0.0:1746143110.956133:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858214400:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143111.001423:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.015798:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.022787:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.027420:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.052406:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.067011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.084718:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.117919:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.130306:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.133236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.136644:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.154725:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.166658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.229343:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.232764:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.236435:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.242742:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.263986:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.270681:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.293565:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.306022:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.308090:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.312336:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.329392:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.329430:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.329456:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.329471:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.329488:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858220416 00000100:00100000:0.0:1746143111.329494:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858220416 00000100:00100000:0.0:1746143111.329528:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858220544 00000100:00100000:0.0:1746143111.329530:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858220544 00000100:00100000:0.0:1746143111.329541:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858220672 00000100:00100000:0.0:1746143111.329542:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858220672 00000100:00100000:0.0:1746143111.329551:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858220800 00000100:00100000:0.0:1746143111.329553:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858220800 00000100:00100000:0.0:1746143111.329566:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11363 00000100:00100000:0.0:1746143111.329573:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1970:x1830962858220416:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143111.329587:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.329614:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cb8800/0x25aee876ca70abb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e76a expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.329633:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.329635:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.329642:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099cb8800/0x25aee876ca70abb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e76a expref: 13 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.329658:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099cb8800/0x25aee876ca70abb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e76a expref: 13 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.329669:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cb8800, rc 0) 00000100:00100000:0.0:1746143111.329716:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858220416:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 143us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.329723:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11363 00000100:00100000:0.0:1746143111.329739:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11364 00000100:00100000:0.0:1746143111.329744:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858220544:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143111.329751:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.329760:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cb8000/0x25aee876ca70abbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e771 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.329772:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.329773:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.329777:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cb8000/0x25aee876ca70abbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e771 expref: 13 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.329787:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cb8000/0x25aee876ca70abbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e771 expref: 13 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.329795:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cb8000, rc 0) 00000100:00100000:0.0:1746143111.329811:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1971:x1830962858220544:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 67us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.329816:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11364 00000100:00100000:0.0:1746143111.329826:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11365 00000100:00100000:0.0:1746143111.329831:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858220672:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143111.329836:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.329843:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cb8200/0x25aee876ca70abc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e778 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.329863:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.329864:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.329869:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cb8200/0x25aee876ca70abc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e778 expref: 13 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.329877:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cb8200/0x25aee876ca70abc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e778 expref: 13 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.329884:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cb8200, rc 0) 00000100:00100000:0.0:1746143111.329900:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1971:x1830962858220672:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 69us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.329906:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11365 00000100:00100000:0.0:1746143111.329917:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11366 00000100:00100000:0.0:1746143111.329922:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1970:x1830962858220800:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143111.329927:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.329933:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cb9e00/0x25aee876ca70abcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e77f expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143111.329964:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861090048:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143111.330024:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143111.330068:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.330082:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858220928 00000100:00100000:0.0:1746143111.330085:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858220928 00000100:00100000:0.0:1746143111.330100:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11367 00000100:00100000:0.0:1746143111.330105:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1970:x1830962858220928:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143111.330118:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.330125:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cb9600/0x25aee876ca70abd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e786 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.330135:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.330136:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.330141:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099cb9600/0x25aee876ca70abd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e786 expref: 15 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.330149:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099cb9600/0x25aee876ca70abd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e786 expref: 15 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.330156:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cb9600, rc 0) 00000100:00100000:0.0:1746143111.330170:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1970:x1830962858220928:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 66us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.330175:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11367 00000100:00100000:0.0:1746143111.330227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.330241:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858221056 00000100:00100000:0.0:1746143111.330243:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858221056 00000100:00100000:0.0:1746143111.330258:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11368 00000100:00100000:0.0:1746143111.330262:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858221056:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143111.330268:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.330274:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cb9200/0x25aee876ca70abd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e78d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143111.330295:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861090176:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143111.330315:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143111.335297:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861090176:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143111.335327:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cb9200/0x25aee876ca70abd9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e78d expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.335341:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cb9200/0x25aee876ca70abd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e78d expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.335569:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cb9200, rc 0) 00000100:00100000:0.0:1746143111.337158:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858221056:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 6893us (6929us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143111.337164:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11368 00000100:00100000:0.0:1746143111.341429:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.349717:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.350625:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861090688:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143111.350635:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143111.351325:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858221440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2612us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.351333:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5940 00000100:00100000:0.0:1746143111.354705:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.363964:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.369838:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.370113:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.385210:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.392609:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.394066:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858223616 00000100:00100000:0.0:1746143111.394073:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858223616 00002000:00100000:0.0:1746143111.394121:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880136beb480 x1830962858223616/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.394131:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beb480 with x1830962858223616 ext(1048576->2097151) 00002000:00010000:0.0:1746143111.394137:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136beb480 00000100:00100000:0.0:1746143111.394156:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5472 00000100:00100000:0.0:1746143111.394163:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858223616:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143111.423980:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1811 00000100:00100000:0.0:1746143111.423994:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1968:x1830962858224640:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143111.425518:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.427439:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5945 00000100:00100000:0.0:1746143111.433585:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.434079:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858225536 00000100:00100000:1.0:1746143111.434086:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858225536 00010000:00010000:1.0:1746143111.434120:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099cb8800/0x25aee876ca70abb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e76a expref: 16 pid: 8169 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746143111.434158:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5947 00000100:00100000:1.0:1746143111.434165:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:1971:x1830962858225536:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143111.434182:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143111.434205:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099cb8800/0x25aee876ca70abb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e76a expref: 16 pid: 8169 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143111.434215:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099cb8800/0x25aee876ca70abb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e76a expref: 16 pid: 8169 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143111.434236:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cb8800/0x25aee876ca70abb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e76a expref: 16 pid: 8169 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143111.434253:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143111.434299:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1971:x1830962858225536:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 134us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.434306:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5947 00000100:00100000:0.0:1746143111.437562:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.437616:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.437647:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.437672:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.437695:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858225792 00000100:00100000:0.0:1746143111.437702:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858225792 00010000:00010000:0.0:1746143111.437735:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094444a00/0x25aee876ca70ab70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e747 expref: 31 pid: 8448 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.437762:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858226048 00000100:00100000:0.0:1746143111.437972:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858226048 00010000:00010000:0.0:1746143111.437987:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099cb9600/0x25aee876ca70abd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e786 expref: 15 pid: 8449 timeout: 993 lvb_type: 1 00000100:00100000:0.0:1746143111.438002:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858226560 00000100:00100000:0.0:1746143111.438004:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858226560 00010000:00010000:0.0:1746143111.438061:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e30da00/0x25aee876ca70aaba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6d7 expref: 25 pid: 10061 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.438077:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5949 00000100:00100000:0.0:1746143111.438084:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1969:x1830962858226048:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143111.438096:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143111.438112:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099cb9600/0x25aee876ca70abd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e786 expref: 15 pid: 8449 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746143111.438122:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099cb9600/0x25aee876ca70abd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e786 expref: 15 pid: 8449 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746143111.438140:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cb9600/0x25aee876ca70abd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e786 expref: 15 pid: 8449 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746143111.438156:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143111.438412:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5950 00000100:00100000:1.0:1746143111.438421:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858226432:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143111.438431:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143111.438666:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5377000/0x25aee876ca70aa9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6bb expref: 25 pid: 4756 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143111.438682:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5377000/0x25aee876ca70aa9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6bb expref: 25 pid: 4756 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143111.438696:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5377000/0x25aee876ca70aa9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6bb expref: 25 pid: 4756 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143111.438706:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143111.441084:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858226048:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2993us (3428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.441095:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5949 00000100:00100000:0.0:1746143111.441167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.442691:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.443929:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858226432:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5302us (6105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.443938:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5950 00000100:00100000:0.0:1746143111.444680:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.445128:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858224640:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21137us (21601us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143111.445137:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1811 00002000:00100000:1.0:1746143111.445149:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88012b800e00 x1830962858224640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 488/440 e 0 to 0 dl 1746143122 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143111.445159:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800e00 with x1830962858224640 ext(2097152->3145727) 00010000:00010000:1.0:1746143111.445169:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cd5400/0x25aee876ca70aaf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e70f expref: 27 pid: 21048 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143111.445180:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cd5400/0x25aee876ca70aaf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e70f expref: 27 pid: 21048 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143111.445187:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b800e00 00000100:00100000:1.0:1746143111.449331:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858227072 00000100:00100000:1.0:1746143111.449340:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858227072 00010000:00010000:1.0:1746143111.449371:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090494a00/0x25aee876ca70ac11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7b0 expref: 25 pid: 8450 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.449402:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858227200 00000100:00100000:0.0:1746143111.449410:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858227200 00000100:00100000:1.0:1746143111.449624:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5958 00000100:00100000:1.0:1746143111.449634:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858227072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143111.449636:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858227328 00000100:00100000:0.0:1746143111.449638:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858227328 00010000:00010000:1.0:1746143111.449647:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143111.449649:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858227456 00000100:00100000:0.0:1746143111.449650:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858227456 00010000:00010000:1.0:1746143111.449667:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090494a00/0x25aee876ca70ac11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7b0 expref: 26 pid: 8450 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.449670:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858227584 00000100:00100000:0.0:1746143111.449673:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858227584 00010000:00010000:1.0:1746143111.449679:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090494a00/0x25aee876ca70ac11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7b0 expref: 27 pid: 8450 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.449683:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858227712 00000100:00100000:0.0:1746143111.449685:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858227712 00000100:00100000:0.0:1746143111.449696:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11379 00010000:00010000:1.0:1746143111.449701:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090494a00/0x25aee876ca70ac11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7b0 expref: 27 pid: 8450 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.449703:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858227200:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143111.449715:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.449717:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.449719:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.449723:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.449729:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be9f600/0x25aee876ca70ac5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e7c5 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.449732:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143111.449745:0:8448:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x68140785, atime: 0x68140784, ctime: 0x68140785, blocks: 0x81f 00010000:00010000:1.0:1746143111.449753:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143111.449756:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.449758:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.449763:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be9f600/0x25aee876ca70ac5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7c5 expref: 37 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.449775:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be9f600/0x25aee876ca70ac5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7c5 expref: 38 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.449783:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be9f600, rc 0) 00000100:00100000:0.0:1746143111.449816:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858227200:12345-192.168.201.28@tcp:101:cat.0 Request processed in 114us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.449823:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11379 00000100:00100000:0.0:1746143111.449836:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11381 00000100:00100000:0.0:1746143111.449842:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858227456:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143111.449848:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.449857:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be9e600/0x25aee876ca70ac6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e7d3 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.449898:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be9e600/0x25aee876ca70ac6c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7d3 expref: 28 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.449907:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be9e600/0x25aee876ca70ac6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7d3 expref: 27 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.449920:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be9e600, rc 0) 00000100:00100000:0.0:1746143111.449941:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858227456:12345-192.168.201.28@tcp:101:cat.0 Request processed in 99us (736us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143111.449947:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11381 00000100:00100000:1.0:1746143111.452027:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858227072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2390us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.452054:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5958 00010000:00010000:1.0:1746143111.452086:0:22204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.452094:0:22204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.452119:0:22204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.452127:0:22204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.452135:0:22204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.452142:0:22204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012caa5c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143111.452146:0:22204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.452154:0:22204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.452169:0:22204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.452176:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa5c00/0x25aee876ca70ac34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143111.452232:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858224128:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 32713us (33453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.452240:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11373 00000100:00100000:1.0:1746143111.458268:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858225152:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31735us (32743us total) trans 0 rc 335872/335872 00000100:00100000:1.0:1746143111.458281:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1813 00002000:00100000:1.0:1746143111.458292:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3858432->4194303) req@ffff88009b120e00 x1830962858225152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 488/440 e 0 to 0 dl 1746143122 ref 1 fl Complete:H/200/0 rc 335872/335872 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143111.458301:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b120e00 with x1830962858225152 ext(3858432->4194303) 00010000:00010000:1.0:1746143111.458311:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cd5800/0x25aee876ca70ab62 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->3018751) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e739 expref: 20 pid: 21048 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143111.458324:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cd5800/0x25aee876ca70ab62 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->3018751) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e739 expref: 20 pid: 21048 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143111.458330:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b120e00 00010000:00010000:0.0:1746143111.474397:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143111.477627:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.481692:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.488938:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.489123:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858229120 00000100:00100000:1.0:1746143111.489134:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858229120 00002000:00100000:1.0:1746143111.489176:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009b123100 x1830962858229120/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143111.489187:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b123100 with x1830962858229120 ext(2097152->3145727) 00002000:00010000:1.0:1746143111.489193:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b123100 00000100:00100000:1.0:1746143111.489222:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5474 00000100:00100000:1.0:1746143111.489230:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858229120:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143111.503051:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858229632 00000100:00100000:0.0:1746143111.503060:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858229632 00000100:00100000:0.0:1746143111.503100:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3335 00000100:00100000:0.0:1746143111.503106:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30414:x1830962858229632:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:0.0:1746143111.503276:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30414:x1830962858229632:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 170us (1278us total) trans 8589942168 rc 0/0 00000100:00100000:0.0:1746143111.503282:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3335 00000100:00100000:0.0:1746143111.512316:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.514681:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.514725:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.520296:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11387 00000100:00100000:1.0:1746143111.520312:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30410:x1830962858230016:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143111.520328:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.520340:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70acb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e7fd expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.520359:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.520361:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.520366:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70acb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7fd expref: 27 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.520376:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70acb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7fd expref: 27 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.520383:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011b000, rc 0) 00000100:00100000:1.0:1746143111.520433:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:30410:x1830962858230016:12345-192.168.201.28@tcp:101:cat.0 Request processed in 128us (5708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.520437:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11387 00000100:00100000:0.0:1746143111.521631:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.533746:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.539739:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.539987:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.541208:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.541228:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858231040 00000100:00100000:0.0:1746143111.541231:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858231040 00002000:00100000:0.0:1746143111.541256:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009b122680 x1830962858231040/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.541264:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b122680 with x1830962858231040 ext(3145728->4194303) 00002000:00010000:0.0:1746143111.541268:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b122680 00000100:00100000:0.0:1746143111.541285:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858231296 00000100:00100000:0.0:1746143111.541288:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858231296 00002000:00100000:0.0:1746143111.541298:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009b121f80 x1830962858231296/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.541304:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b121f80 with x1830962858231296 ext(3145728->4194303) 00002000:00010000:0.0:1746143111.541307:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b121f80 00000100:00100000:0.0:1746143111.541315:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5476 00000100:00100000:0.0:1746143111.541320:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1968:x1830962858231040:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143111.548558:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.553200:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858231680 00000100:00100000:0.0:1746143111.553207:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858231680 00010000:00010000:0.0:1746143111.553239:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134a10400/0x25aee876ca70ac65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7cc expref: 41 pid: 8169 timeout: 993 lvb_type: 1 00000100:00100000:0.0:1746143111.553267:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5962 00000100:00100000:0.0:1746143111.553273:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+41:1969:x1830962858231680:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143111.553288:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143111.553315:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134a10400/0x25aee876ca70ac65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7cc expref: 41 pid: 8169 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746143111.553327:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134a10400/0x25aee876ca70ac65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7cc expref: 41 pid: 8169 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746143111.553350:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a10400/0x25aee876ca70ac65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7cc expref: 41 pid: 8169 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746143111.553366:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.553368:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.553375:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.553383:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.553408:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 19 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143111.553418:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861093632:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143111.553467:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143111.566028:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.570202:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861093632:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143111.570226:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143111.570276:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858231680:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 17001us (17133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.570286:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5962 00000100:00100000:1.0:1746143111.573713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.573831:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858232192 00000100:00100000:0.0:1746143111.573840:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858232192 00002000:00100000:0.0:1746143111.573884:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1204224->1208319) req@ffff880092a71180 x1830962858232192/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.573894:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71180 with x1830962858232192 ext(1204224->1208319) 00002000:00010000:0.0:1746143111.573909:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a71180 00000100:00100000:0.0:1746143111.573938:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5480 00000100:00100000:0.0:1746143111.573945:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858232192:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143111.574160:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858232192:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 214us (458us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143111.574166:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5480 00002000:00100000:0.0:1746143111.574172:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1204224->1208319) req@ffff880092a71180 x1830962858232192/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 488/4536 e 0 to 0 dl 1746143122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.574178:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71180 with x1830962858232192 ext(1204224->1208319) 00002000:00010000:0.0:1746143111.574181:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a71180 00000100:00100000:1.0:1746143111.584762:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1968:x1830962858231040:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43428us (44761us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143111.584777:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5476 00002000:00100000:1.0:1746143111.584791:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009b122680 x1830962858231040/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/440 e 0 to 0 dl 1746143122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143111.584800:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b122680 with x1830962858231040 ext(3145728->4194303) 00002000:00010000:1.0:1746143111.584806:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b122680 00000100:00100000:0.0:1746143111.600212:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.606932:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.606970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.607299:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11390 00000100:00100000:0.0:1746143111.607306:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858232704:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143111.607314:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.607326:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135db3800/0x25aee876ca70acf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e820 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143111.607348:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x68140786, atime: 0x68140784, ctime: 0x68140786, blocks: 0x821 00010000:00010000:0.0:1746143111.607358:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.607360:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.607368:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135db3800/0x25aee876ca70acf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e820 expref: 26 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.607598:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135db3800/0x25aee876ca70acf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e820 expref: 26 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.607608:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135db3800, rc 0) 00000100:00100000:0.0:1746143111.607630:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858232704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 325us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.607636:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11390 00000100:00100000:0.0:1746143111.612829:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.613095:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.613127:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858232832 00000100:00100000:1.0:1746143111.613135:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858232832 00000100:00100000:0.0:1746143111.613139:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.613153:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858233088 00000100:00100000:0.0:1746143111.613157:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858233088 00000100:00100000:1.0:1746143111.613172:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858232960 00000100:00100000:1.0:1746143111.613174:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858232960 00000100:00100000:0.0:1746143111.613186:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11391 00000100:00100000:1.0:1746143111.613192:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11392 00000100:00100000:0.0:1746143111.613193:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858232832:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143111.613198:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858233088:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143111.613358:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11393 00000100:00100000:1.0:1746143111.613365:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858232960:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143111.613377:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.613394:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bbf8c00/0x25aee876ca70acf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e82e expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.613660:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.613663:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.613665:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.613671:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135db3400/0x25aee876ca70acff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e827 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.613673:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbf8c00/0x25aee876ca70acf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e82e expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.613685:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.613686:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.613688:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bbf8c00/0x25aee876ca70acf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e82e expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.613699:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbf8c00, rc 0) 00010000:00010000:0.0:1746143111.613766:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135db3400/0x25aee876ca70acff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e827 expref: 29 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.613778:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135db3400/0x25aee876ca70acff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e827 expref: 29 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.613797:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135db3400, rc 0) 00000100:00100000:1.0:1746143111.614108:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858232960:12345-192.168.201.28@tcp:101:cat.0 Request processed in 742us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.614114:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858232832:12345-192.168.201.28@tcp:101:cat.0 Request processed in 920us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.614115:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11393 00000100:00100000:0.0:1746143111.614121:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11391 00010000:00010000:1.0:1746143111.614137:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.614144:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbf8e00/0x25aee876ca70ad06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e835 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.614155:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.614157:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.614162:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbf8e00/0x25aee876ca70ad06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e835 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143111.614169:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143111.614171:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbf8e00/0x25aee876ca70ad06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e835 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.614177:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbf8e00, rc 0) 00000100:00100000:1.0:1746143111.614777:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858233088:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1579us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.614782:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11392 00000100:00100000:0.0:1746143111.619388:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.622669:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858233856 00000100:00100000:0.0:1746143111.622678:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858233856 00002000:00100000:0.0:1746143111.622715:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009a24b480 x1830962858233856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.622724:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24b480 with x1830962858233856 ext(4194304->5210111) 00002000:00010000:0.0:1746143111.622729:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a24b480 00000100:00100000:0.0:1746143111.622746:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5483 00000100:00100000:0.0:1746143111.622752:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858233856:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143111.655382:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.655598:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858233984 00000100:00100000:1.0:1746143111.655608:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858233984 00000100:00100000:1.0:1746143111.656243:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11394 00000100:00100000:1.0:1746143111.656252:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858233984:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143111.656274:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.656292:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090495c00/0x25aee876ca70ad0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e83c expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143111.656533:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861093888:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143111.656639:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143111.658184:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861093888:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143111.658207:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090495c00/0x25aee876ca70ad0d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e83c expref: 37 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.658217:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090495c00/0x25aee876ca70ad0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e83c expref: 37 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.658622:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090495c00, rc 0) 00000100:00100000:1.0:1746143111.658658:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858233984:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2407us (3285us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143111.658664:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11394 00000100:00100000:0.0:1746143111.663850:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.663918:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858234112 00000100:00100000:1.0:1746143111.663927:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858234112 00000100:00100000:1.0:1746143111.663976:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11395 00000100:00100000:1.0:1746143111.663984:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1968:x1830962858234112:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143111.664003:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.664021:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090495a00/0x25aee876ca70ad14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e843 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143111.664092:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861094016:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143111.665269:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143111.667670:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861094016:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143111.667701:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090495a00/0x25aee876ca70ad14 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e843 expref: 37 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.667723:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090495a00/0x25aee876ca70ad14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e843 expref: 37 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.667877:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090495a00, rc 0) 00000100:00100000:1.0:1746143111.668137:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1968:x1830962858234112:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4152us (4294us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143111.668146:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11395 00000100:00100000:1.0:1746143111.710145:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858234240 00000100:00100000:1.0:1746143111.710155:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858234240 00000100:00100000:1.0:1746143111.710204:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11396 00000100:00100000:1.0:1746143111.710212:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30417:x1830962858234240:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143111.710229:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.710246:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090495400/0x25aee876ca70ad1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e84a expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.710279:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130ade000/0x25aee876ca70ac57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7be expref: 27 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.710288:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135db3400/0x25aee876ca70acff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e827 expref: 28 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.710294:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.710296:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.710299:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090495400/0x25aee876ca70ad1b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [974848->1048575] (req 974848->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e84a expref: 27 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.710345:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135db3400/0x25aee876ca70acff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e827 expref: 28 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.710356:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135db3400/0x25aee876ca70acff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e827 expref: 28 pid: 4756 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746143111.710368:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861094144:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143111.710463:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130ade000/0x25aee876ca70ac57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7be expref: 27 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.710471:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130ade000/0x25aee876ca70ac57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7be expref: 27 pid: 26949 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746143111.710478:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861094272:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143111.710497:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143111.713742:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.713950:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861094144:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143111.713960:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861094272:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143111.714471:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090495400/0x25aee876ca70ad1b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [974848->1048575] (req 974848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e84a expref: 28 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.714486:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090495400, rc 0) 00000100:00100000:0.0:1746143111.714827:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.715065:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30417:x1830962858234240:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4496us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.715076:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11396 00000100:00100000:0.0:1746143111.721159:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.721257:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858234880 00000100:00100000:1.0:1746143111.721263:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858234880 00000100:00100000:1.0:1746143111.721296:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11397 00000100:00100000:1.0:1746143111.721302:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:30417:x1830962858234880:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143111.721317:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.721335:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e851 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.721364:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be9f600/0x25aee876ca70ac5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7c5 expref: 37 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.721372:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bbf8c00/0x25aee876ca70acf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e82e expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.721378:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.721380:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143111.721383:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->1900543] (req 1048576->1900543) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 37 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.721412:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bbf8c00/0x25aee876ca70acf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e82e expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.721424:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bbf8c00/0x25aee876ca70acf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e82e expref: 19 pid: 22204 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746143111.721436:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861094528:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143111.721932:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be9f600/0x25aee876ca70ac5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7c5 expref: 37 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.721940:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be9f600/0x25aee876ca70ac5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7c5 expref: 37 pid: 8448 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746143111.721948:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861094656:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143111.721965:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143111.724324:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861094528:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143111.724334:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861094656:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143111.724360:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->1900543] (req 1048576->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 37 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.724374:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090494e00, rc 0) 00000100:00100000:1.0:1746143111.725552:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:30417:x1830962858234880:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4247us (4395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143111.725560:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11397 00000100:00100000:0.0:1746143111.735398:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.739243:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.794006:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.794072:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858235776 00000100:00100000:1.0:1746143111.794081:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858235776 00000100:00100000:1.0:1746143111.794137:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11398 00000100:00100000:1.0:1746143111.794145:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858235776:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143111.794165:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.794183:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090494600/0x25aee876ca70ad29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e858 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143111.794243:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861094912:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143111.794337:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143111.795182:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:1.0:1746143111.799257:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143109 -> 1746143110 00002000:00010000:1.0:1746143111.799264:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143108 -> 1746143110 00002000:00010000:1.0:1746143111.799266:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143109 -> 1746143110 00000100:00100000:1.0:1746143111.799290:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861094912:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143111.799320:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090494600/0x25aee876ca70ad29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e858 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.799334:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090494600/0x25aee876ca70ad29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e858 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143111.799361:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090494600, rc 0) 00000100:00100000:1.0:1746143111.799397:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858235776:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5252us (5400us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143111.799405:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11398 00000100:00100000:1.0:1746143111.805759:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.810550:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.818001:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.835724:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.843813:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861095296:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143111.843837:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143111.845152:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858236288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 26364us (27323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.845165:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5967 00000100:00100000:0.0:1746143111.861178:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.863028:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858236800 00000100:00100000:0.0:1746143111.863159:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858236800 00000100:00100000:0.0:1746143111.863203:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7978 00000100:00100000:0.0:1746143111.863212:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30429:x1830962858236800:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143111.863243:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.863261:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b400/0x25aee876ca70ad3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e86d expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.863355:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.863369:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130adee00/0x25aee876ca70acd5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e80b expref: 17 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.863377:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.863404:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130adee00/0x25aee876ca70acd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e80b expref: 17 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.863414:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130adee00/0x25aee876ca70acd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e80b expref: 17 pid: 1037 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.863429:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861095424:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143111.863498:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143111.870760:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861095424:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143111.870983:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143111.880546:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.880599:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.880638:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858236928 00000100:00100000:0.0:1746143111.880647:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858236928 00010000:00010000:0.0:1746143111.880686:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130adee00/0x25aee876ca70acd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e80b expref: 18 pid: 1037 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.880717:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5968 00000100:00100000:0.0:1746143111.880725:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858236928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143111.882332:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143111.882343:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130adee00/0x25aee876ca70acd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e80b expref: 18 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143111.882355:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130adee00/0x25aee876ca70acd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e80b expref: 18 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143111.882374:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130adee00/0x25aee876ca70acd5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e80b expref: 18 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143111.882387:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143111.882396:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.882404:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.882410:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.882513:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143111.882530:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.882537:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143111.882556:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143111.882699:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b400/0x25aee876ca70ad3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e86d expref: 19 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.882710:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e86d expref: 18 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.882717:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143111.882719:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143111.882721:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011b600, rc 0) 00000100:00100000:0.0:1746143111.882747:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30429:x1830962858236800:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 19536us (21580us total) trans 8589942173 rc 0/0 00000100:00100000:0.0:1746143111.882754:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7978 00000100:00100000:0.0:1746143111.884450:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861095552:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143111.884473:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130adf600/0x25aee876ca70ad4c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e874 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.884491:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130adf600, rc 0) 00000100:00100000:0.0:1746143111.884515:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30427:x1830962858237056:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3105us (3915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.884522:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11401 00000100:00100000:0.0:1746143111.884577:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858236928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3852us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.884599:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5968 00000100:00100000:0.0:1746143111.887736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.887958:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858237184 00000100:00100000:0.0:1746143111.887965:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858237184 00002000:00100000:0.0:1746143111.888004:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1900543) req@ffff88009fb55500 x1830962858237184/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.888013:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb55500 with x1830962858237184 ext(1048576->1900543) 00010000:00010000:0.0:1746143111.888022:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 36 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143111.888050:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 36 pid: 8169 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143111.888057:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb55500 00000100:00100000:0.0:1746143111.888076:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1815 00000100:00100000:0.0:1746143111.888083:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858237184:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143111.925769:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858237184:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 37674us (38027us total) trans 17179872632 rc 0/0 00000100:00100000:0.0:1746143111.925793:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1815 00002000:00100000:0.0:1746143111.925805:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1900543) req@ffff88009fb55500 x1830962858237184/t17179872632(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/448 e 0 to 0 dl 1746143122 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.925815:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb55500 with x1830962858237184 ext(1048576->1900543) 00010000:00010000:0.0:1746143111.925827:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 38 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143111.925844:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 38 pid: 8169 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143111.925851:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb55500 00000100:00100000:0.0:1746143111.940988:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.941025:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858237440 00000100:00100000:0.0:1746143111.941048:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858237440 00000100:00100000:0.0:1746143111.941092:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7979 00000100:00100000:0.0:1746143111.941100:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:30432:x1830962858237440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143111.941125:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.941143:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013011be00/0x25aee876ca70ad5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e87b expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.941258:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941272:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941283:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941303:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941309:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941314:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941423:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941431:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941436:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143111.941445:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143111.941533:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941540:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941546:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941552:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c1eca00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143111.941557:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941563:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941579:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143111.941595:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143111.941600:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941605:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1eca00/0x25aee876ca70ad61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941620:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941624:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941629:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941634:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c1ec000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143111.941636:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941641:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941647:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009494d800) 00010000:00010000:0.0:1746143111.941649:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143111.941651:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941656:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec000/0x25aee876ca70ad68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143111.941693:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013011be00/0x25aee876ca70ad5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 210 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.941710:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 209 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.941716:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143111.941718:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143111.941721:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1ec800, rc 0) 00000100:00100000:0.0:1746143111.941772:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:30432:x1830962858237440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 673us (795us total) trans 8589942174 rc 0/0 00000100:00100000:0.0:1746143111.941779:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7979 00000100:00100000:1.0:1746143111.943733:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.943770:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858237568 00000100:00100000:0.0:1746143111.943780:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858237568 00010000:00010000:0.0:1746143111.943816:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 38 pid: 8169 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143111.943848:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5969 00000100:00100000:0.0:1746143111.943857:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1970:x1830962858237568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143111.943869:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143111.943887:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 38 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143111.943899:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1900543) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 38 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143111.943919:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70ad22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1900543) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e851 expref: 38 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143111.943945:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.943947:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.943953:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130adf600/0x25aee876ca70ad4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e874 expref: 19 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.943961:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130adf600/0x25aee876ca70ad4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e874 expref: 19 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.943993:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130adf600/0x25aee876ca70ad4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e874 expref: 19 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143111.944006:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861095680:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143111.944105:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143111.945222:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.945307:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858237824 00000100:00100000:0.0:1746143111.945312:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858237824 00000100:00100000:0.0:1746143111.945348:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3339 00000100:00100000:0.0:1746143111.945354:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:30432:x1830962858237824:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143111.945515:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:30432:x1830962858237824:12345-192.168.201.28@tcp:35:cat.0 Request processed in 159us (294us total) trans 8589942175 rc 0/0 00000100:00100000:0.0:1746143111.945526:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3339 00000100:00100000:0.0:1746143111.946758:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.946781:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858237952 00000100:00100000:0.0:1746143111.946785:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858237952 00000100:00100000:0.0:1746143111.947454:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11402 00000100:00100000:0.0:1746143111.947468:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858237952:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143111.947481:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.947498:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70ad7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e882 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.947517:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.947519:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.947527:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70ad7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e882 expref: 28 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.947541:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70ad7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e882 expref: 28 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.947552:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fb5e00, rc 0) 00000100:00100000:0.0:1746143111.947605:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858237952:12345-192.168.201.28@tcp:101:cat.0 Request processed in 139us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.947612:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11402 00000100:00100000:0.0:1746143111.947690:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.947735:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.947748:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858238080 00000100:00100000:0.0:1746143111.947752:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858238080 00000100:00100000:0.0:1746143111.947806:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858238208 00000100:00100000:0.0:1746143111.947809:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858238208 00000100:00100000:0.0:1746143111.947823:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11403 00000100:00100000:0.0:1746143111.947828:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1970:x1830962858238080:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143111.947836:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.947844:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ce8a00/0x25aee876ca70ad84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e889 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143111.947866:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.947867:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143111.947872:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ce8a00/0x25aee876ca70ad84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e889 expref: 40 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.947881:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ce8a00/0x25aee876ca70ad84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e889 expref: 40 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.947888:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ce8a00, rc 0) 00000100:00100000:0.0:1746143111.947907:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:1970:x1830962858238080:12345-192.168.201.28@tcp:101:cat.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.947912:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11403 00000100:00100000:0.0:1746143111.947925:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11404 00000100:00100000:0.0:1746143111.947929:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1971:x1830962858238208:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143111.947935:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143111.947940:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ce9400/0x25aee876ca70ad8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e890 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143111.947973:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bae8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861095808:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143111.948016:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143111.949354:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861095680:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143111.949379:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143111.949627:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:1970:x1830962858237568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5769us (5897us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143111.949637:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5969 00000100:00100000:0.0:1746143111.956199:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bae8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861095808:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143111.956240:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ce9400/0x25aee876ca70ad8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e890 expref: 39 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.956256:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ce9400/0x25aee876ca70ad8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e890 expref: 39 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143111.956268:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ce9400, rc 0) 00000100:00100000:0.0:1746143111.956316:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1971:x1830962858238208:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8383us (8578us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143111.956324:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11404 00000100:00100000:0.0:1746143111.979208:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.979235:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.979251:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.979266:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.979300:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143111.979326:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858239104 00000100:00100000:0.0:1746143111.979336:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858239104 00002000:00100000:0.0:1746143111.979382:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012bae8a80 x1830962858239104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.979392:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae8a80 with x1830962858239104 ext(1048576->2097151) 00002000:00010000:0.0:1746143111.979399:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bae8a80 00000100:00100000:0.0:1746143111.979415:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858238976 00000100:00100000:0.0:1746143111.979418:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858238976 00002000:00100000:0.0:1746143111.979429:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012bae8e00 x1830962858238976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.979446:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae8e00 with x1830962858238976 ext(1048576->2097151) 00002000:00010000:0.0:1746143111.979449:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bae8e00 00000100:00100000:0.0:1746143111.979465:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858239232 00000100:00100000:0.0:1746143111.979468:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858239232 00002000:00100000:0.0:1746143111.979480:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88012bae9180 x1830962858239232/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.979486:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae9180 with x1830962858239232 ext(0->1048575) 00002000:00010000:0.0:1746143111.979489:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bae9180 00000100:00100000:0.0:1746143111.979497:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858239488 00000100:00100000:0.0:1746143111.979499:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858239488 00002000:00100000:0.0:1746143111.979507:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012bae9500 x1830962858239488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 504/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.979513:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae9500 with x1830962858239488 ext(1048576->2097151) 00002000:00010000:0.0:1746143111.979515:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bae9500 00000100:00100000:0.0:1746143111.979523:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858239744 00000100:00100000:0.0:1746143111.979525:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858239744 00002000:00100000:0.0:1746143111.979535:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88012bae9880 x1830962858239744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 488/0 e 0 to 0 dl 1746143122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143111.979540:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae9880 with x1830962858239744 ext(1048576->2097151) 00002000:00010000:0.0:1746143111.979543:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bae9880 00000100:00100000:0.0:1746143111.979554:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5487 00000100:00100000:0.0:1746143111.979561:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1970:x1830962858239104:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143111.987736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143111.987765:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858238464 00000100:00100000:1.0:1746143111.987773:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858238464 00000100:00100000:1.0:1746143111.987813:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7980 00000100:00100000:1.0:1746143111.987820:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:30434:x1830962858238464:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143111.987845:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143111.987865:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090495400/0x25aee876ca70ad92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e897 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.987968:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.987981:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.987991:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988002:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988007:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988012:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988124:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090494800/0x25aee876ca70ada7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988131:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090494800/0x25aee876ca70ada7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988136:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090494800/0x25aee876ca70ada7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143111.988145:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143111.988229:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988235:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988242:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988247:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090495200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143111.988251:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988257:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988269:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143111.988271:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143111.988275:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988280:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70ad99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988290:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988296:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988300:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988305:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090494600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143111.988307:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988312:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988322:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e924100) 00010000:00010000:1.0:1746143111.988324:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143111.988326:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988330:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090494600/0x25aee876ca70ada0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143111.988579:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090495400/0x25aee876ca70ad92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e897 expref: 213 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.988600:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090494800/0x25aee876ca70ada7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e897 expref: 212 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143111.988606:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143111.988607:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143111.988610:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090494800, rc 0) 00000100:00100000:1.0:1746143111.988655:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:30434:x1830962858238464:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 834us (930us total) trans 8589942176 rc 0/0 00000100:00100000:1.0:1746143111.988660:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7980 00000100:00100000:0.0:1746143111.988881:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5490 00000100:00100000:0.0:1746143111.988892:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858239488:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143111.990754:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5491 00000100:00100000:0.0:1746143111.990763:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1970:x1830962858239744:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143112.024979:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.025012:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858239872 00000100:00100000:0.0:1746143112.025021:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858239872 00000100:00100000:0.0:1746143112.025096:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 602 00000100:00100000:0.0:1746143112.025106:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:1971:x1830962858239872:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143112.025119:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143112.025144:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090494800/0x25aee876ca70ada7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e897 expref: 212 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.025160:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143112.025165:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143112.025202:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:1971:x1830962858239872:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143112.025209:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 602 00000100:00080000:0.0:1746143112.025229:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143112.040751:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962858239488:12345-192.168.201.28@tcp:3:cat.0 Request processed in 51847us (61469us total) trans 0 rc 925696/925696 00000100:00100000:0.0:1746143112.040765:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5490 00002000:00100000:0.0:1746143112.040778:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012bae9500 x1830962858239488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 504/440 e 0 to 0 dl 1746143122 ref 1 fl Complete:/200/0 rc 925696/925696 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.040788:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae9500 with x1830962858239488 ext(1048576->2097151) 00002000:00010000:0.0:1746143112.040794:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bae9500 00000100:00100000:0.0:1746143112.058376:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858240000 00000100:00100000:0.0:1746143112.058390:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858240000 00000100:00100000:0.0:1746143112.058434:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11405 00000100:00100000:0.0:1746143112.058441:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:30434:x1830962858240000:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143112.058456:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143112.058473:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e89e expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.058501:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130ade200/0x25aee876ca70acab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7f6 expref: 29 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.058509:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70acb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7fd expref: 30 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.058514:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143112.058516:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143112.058518:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3301376->3674111] (req 3301376->3674111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 29 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.058544:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70acb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7fd expref: 30 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.058554:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70acb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7fd expref: 30 pid: 8169 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143112.058564:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bae9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861095936:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143112.058654:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130ade200/0x25aee876ca70acab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7f6 expref: 29 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.059724:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1970:x1830962858239744:12345-192.168.201.28@tcp:3:cat.0 Request processed in 68959us (80419us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143112.059733:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5491 00002000:00100000:1.0:1746143112.059743:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88012bae9880 x1830962858239744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 488/440 e 0 to 0 dl 1746143122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.059750:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae9880 with x1830962858239744 ext(1048576->2097151) 00002000:00010000:1.0:1746143112.059755:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bae9880 00010000:00010000:0.0:1746143112.060738:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130ade200/0x25aee876ca70acab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7f6 expref: 29 pid: 754 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143112.060750:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861096064:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143112.060790:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b9869c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746143112.060804:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143112.061526:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.061895:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1970:x1830962858239104:12345-192.168.201.28@tcp:3:cat.0 Request processed in 82333us (82698us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143112.061904:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5487 00002000:00100000:0.0:1746143112.061913:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012bae8a80 x1830962858239104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:262/0 lens 488/440 e 0 to 0 dl 1746143122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.061921:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae8a80 with x1830962858239104 ext(1048576->2097151) 00002000:00010000:0.0:1746143112.061926:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bae8a80 00000100:00100000:1.0:1746143112.062661:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858240128 00000100:00100000:1.0:1746143112.062669:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858240128 00000100:00100000:1.0:1746143112.062721:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7981 00000100:00100000:1.0:1746143112.062727:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30435:x1830962858240128:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143112.062747:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.062765:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090495200/0x25aee876ca70adbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e8a5 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.062827:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090495400/0x25aee876ca70adc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.062840:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090495400/0x25aee876ca70adc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.062850:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090495400/0x25aee876ca70adc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.062862:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090494200/0x25aee876ca70adca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.062867:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090494200/0x25aee876ca70adca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.062872:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090494200/0x25aee876ca70adca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.062963:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.062971:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e86d expref: 16 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.062977:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.063005:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e86d expref: 16 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.063015:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e86d expref: 16 pid: 1037 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143112.063024:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a70380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861096192:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.063105:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.069760:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bae9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861095936:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.070143:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858238976:12345-192.168.201.28@tcp:3:cat.0 Request processed in 90413us (90904us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143112.070153:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5488 00002000:00100000:1.0:1746143112.070164:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012bae8e00 x1830962858238976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:262/0 lens 488/440 e 0 to 0 dl 1746143122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.070173:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae8e00 with x1830962858238976 ext(1048576->2097151) 00002000:00010000:1.0:1746143112.070179:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bae8e00 00000100:00100000:1.0:1746143112.076384:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861096064:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.076413:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3301376->3674111] (req 3301376->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 29 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.076431:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79b800, rc 0) 00000100:00100000:1.0:1746143112.076486:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30434:x1830962858240000:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 18044us (18201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.076495:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11405 00000100:00100000:0.0:1746143112.090177:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.090226:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.090256:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.090319:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.091314:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5972 00000100:00100000:1.0:1746143112.091538:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858240384:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.091546:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.091552:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e86d expref: 17 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.091561:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e86d expref: 17 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.091575:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013011b600/0x25aee876ca70ad45 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e86d expref: 17 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.091602:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143112.091608:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.091616:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.091621:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.091637:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.091659:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858240384:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 123us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.091664:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5972 00000100:00100000:1.0:1746143112.092248:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858240640 00000100:00100000:1.0:1746143112.092252:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858240640 00000100:00100000:1.0:1746143112.092280:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11406 00000100:00100000:1.0:1746143112.092285:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:30427:x1830962858240640:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143112.092301:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.092315:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e8ac expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.092333:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 27 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.092338:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.092340:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.092342:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 30 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.092359:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 27 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.092369:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 27 pid: 8169 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143112.092448:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861096448:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.093292:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.093713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.094019:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858240768 00000100:00100000:1.0:1746143112.094023:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858240768 00000100:00100000:0.0:1746143112.095209:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.096426:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11407 00000100:00100000:1.0:1746143112.096436:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30432:x1830962858240768:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143112.096451:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.096465:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e8b3 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.096494:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 7 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.096502:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.096504:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.096507:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8b3 expref: 21 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.096533:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 7 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.096544:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 7 pid: 754 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143112.096555:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861096576:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.096944:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.096963:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858241024 00000100:00100000:1.0:1746143112.096968:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858241024 00002000:00100000:1.0:1746143112.096998:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3301376->3305471) req@ffff88012baebb80 x1830962858241024/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.097007:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baebb80 with x1830962858241024 ext(3301376->3305471) 00010000:00010000:1.0:1746143112.097013:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.097022:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143112.097029:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012baebb80 00000100:00100000:1.0:1746143112.097058:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1816 00000100:00100000:1.0:1746143112.097064:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858241024:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143112.097343:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858241024:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 278us (2133us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143112.097350:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1816 00002000:00100000:1.0:1746143112.097356:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3301376->3305471) req@ffff88012baebb80 x1830962858241024/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/4536 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.097364:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baebb80 with x1830962858241024 ext(3301376->3305471) 00010000:00010000:1.0:1746143112.097368:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.097377:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143112.097383:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012baebb80 00000100:00100000:1.0:1746143112.097419:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861096448:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.097437:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 29 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.097449:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090494400, rc 0) 00000100:00100000:1.0:1746143112.100024:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:30427:x1830962858240640:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7726us (9695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.100051:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11406 00000100:00100000:1.0:1746143112.101883:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861096576:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.101916:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8b3 expref: 21 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.101934:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090495600, rc 0) 00000100:00100000:1.0:1746143112.101982:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30432:x1830962858240768:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5548us (8270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.101988:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11407 00000100:00100000:1.0:1746143112.102463:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858241152 00000100:00100000:1.0:1746143112.102475:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858241152 00000100:00100000:1.0:1746143112.102551:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11408 00000100:00100000:1.0:1746143112.102636:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858241152:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143112.102782:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.102806:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e8ba expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.103047:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.103049:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.103059:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 12 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.103074:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 12 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143112.103313:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858241920 00000100:00100000:0.0:1746143112.103318:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858241920 00002000:00100000:0.0:1746143112.103354:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1204224->1327103) req@ffff8800a5c46300 x1830962858241920/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.103485:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c46300 with x1830962858241920 ext(1204224->1327103) 00010000:00010000:0.0:1746143112.103493:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 8 pid: 754 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143112.103622:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 8 pid: 754 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143112.103629:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c46300 00010000:00010000:1.0:1746143112.103778:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be95000, rc 0) 00000100:00100000:1.0:1746143112.103812:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858241152:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 1253us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.103818:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11408 00000100:00100000:0.0:1746143112.103954:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1817 00000100:00100000:0.0:1746143112.103978:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1970:x1830962858241920:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143112.104046:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858241408 00000100:00100000:1.0:1746143112.104050:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858241408 00000100:00080000:1.0:1746143112.104184:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143112.104551:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858241280 00000100:00100000:1.0:1746143112.104555:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858241280 00000100:00100000:1.0:1746143112.104597:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858241792 00000100:00100000:1.0:1746143112.104600:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858241792 00000100:00100000:1.0:1746143112.104620:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11410 00000100:00100000:1.0:1746143112.104626:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858241664:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143112.104634:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.104643:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090495200/0x25aee876ca70adf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e8d6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.104673:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861096832:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143112.104719:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11411 00000100:00100000:1.0:1746143112.104731:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858241280:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143112.104737:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.104745:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e8c1 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.104756:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.104757:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.104938:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 9 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.104955:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 9 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.104963:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090494e00, rc 0) 00000100:00100000:1.0:1746143112.104981:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858241280:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 258us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.104986:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11411 00000100:00100000:1.0:1746143112.104999:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11413 00000100:00100000:1.0:1746143112.105004:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858241792:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143112.105009:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.105016:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090495e00/0x25aee876ca70ae09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e8dd expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.105026:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.105027:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.105049:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090495e00/0x25aee876ca70ae09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8dd expref: 9 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.105059:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090495e00/0x25aee876ca70ae09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8dd expref: 9 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.105067:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090495e00, rc 0) 00000100:00100000:1.0:1746143112.105087:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858241792:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 83us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.105092:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11413 00000100:00100000:1.0:1746143112.105120:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.119168:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.119603:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.119631:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858242304 00000100:00100000:0.0:1746143112.119640:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858242304 00002000:00100000:0.0:1746143112.119685:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3670016->3674111) req@ffff88012bae9f80 x1830962858242304/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.119696:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae9f80 with x1830962858242304 ext(3670016->3674111) 00010000:00010000:0.0:1746143112.119706:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143112.119720:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143112.119728:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bae9f80 00000100:00100000:0.0:1746143112.119750:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1818 00000100:00100000:0.0:1746143112.119763:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858242304:12345-192.168.201.28@tcp:3:multiop.0 00002000:00010000:1.0:1746143112.120019:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143109 -> 1746143110 00002000:00010000:1.0:1746143112.120024:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143109 -> 1746143110 00002000:00010000:1.0:1746143112.120025:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143109 -> 1746143110 00000100:00100000:1.0:1746143112.120052:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861096832:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143112.120088:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090495200/0x25aee876ca70adf4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8d6 expref: 14 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.120098:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090495200/0x25aee876ca70adf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8d6 expref: 14 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.120113:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090495200, rc 0) 00000100:00100000:0.0:1746143112.121285:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858242304:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1521us (1680us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143112.121293:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1818 00002000:00100000:0.0:1746143112.121299:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3670016->3674111) req@ffff88012bae9f80 x1830962858242304/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/4536 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.121308:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bae9f80 with x1830962858242304 ext(3670016->3674111) 00010000:00010000:0.0:1746143112.121313:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143112.121322:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143112.121327:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bae9f80 00000100:00100000:1.0:1746143112.121378:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858241664:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 16752us (18125us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143112.121384:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11410 00000100:00100000:1.0:1746143112.123749:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858241920:12345-192.168.201.28@tcp:4:cat.0 Request processed in 19784us (20527us total) trans 17179872633 rc 0/0 00000100:00100000:1.0:1746143112.123759:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1817 00002000:00100000:1.0:1746143112.123768:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1204224->1327103) req@ffff8800a5c46300 x1830962858241920/t17179872633(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:263/0 lens 488/448 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.123844:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c46300 with x1830962858241920 ext(1204224->1327103) 00010000:00010000:1.0:1746143112.123854:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 11 pid: 754 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.123864:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130ade400/0x25aee876ca70ace3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e812 expref: 11 pid: 754 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143112.123874:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c46300 00000100:00100000:0.0:1746143112.129686:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.129955:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.130572:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858242560 00000100:00100000:1.0:1746143112.130577:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858242560 00002000:00100000:1.0:1746143112.130620:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3301376->3674111) req@ffff88009fb57100 x1830962858242560/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.130631:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb57100 with x1830962858242560 ext(3301376->3674111) 00010000:00010000:1.0:1746143112.130640:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.130654:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 28 pid: 8169 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143112.130661:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb57100 00000100:00100000:1.0:1746143112.130676:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1819 00000100:00100000:1.0:1746143112.130681:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858242560:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143112.134185:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.134236:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.139361:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858242560:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 8668us (9394us total) trans 21474839879 rc 0/0 00000100:00100000:1.0:1746143112.139374:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1819 00002000:00100000:1.0:1746143112.139387:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3301376->3674111) req@ffff88009fb57100 x1830962858242560/t21474839879(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/448 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.139397:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb57100 with x1830962858242560 ext(3301376->3674111) 00010000:00010000:1.0:1746143112.139408:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 30 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.139426:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 30 pid: 8169 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143112.139432:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb57100 00000100:00100000:0.0:1746143112.155049:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.155471:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.155506:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.155544:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.155609:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858243328 00000100:00100000:1.0:1746143112.155613:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858243328 00010000:00010000:1.0:1746143112.155635:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8a5 expref: 13 pid: 1037 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143112.155659:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858243968 00000100:00100000:1.0:1746143112.155661:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858243968 00010000:00010000:1.0:1746143112.155670:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 31 pid: 8169 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143112.156169:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5974 00000100:00100000:1.0:1746143112.156176:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1971:x1830962858243328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.156185:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.156191:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8a5 expref: 13 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.156200:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8a5 expref: 13 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.156221:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090495000/0x25aee876ca70add1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8a5 expref: 13 pid: 1037 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.156238:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143112.156243:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130adec00/0x25aee876ca70ae1e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.156252:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130adec00/0x25aee876ca70ae1e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.156259:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130adec00/0x25aee876ca70ae1e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.156277:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.156304:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858243328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 129us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.156309:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5974 00000100:00100000:1.0:1746143112.156351:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5975 00000100:00100000:1.0:1746143112.156355:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858243968:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.156362:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143112.156376:0:9869:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143110 -> 1746143111 00002000:00010000:1.0:1746143112.156379:0:9869:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143110 -> 1746143111 00010000:00010000:1.0:1746143112.156384:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 31 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.156392:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 31 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.156404:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b800/0x25aee876ca70adb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->3674111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e89e expref: 31 pid: 8169 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.156414:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.156416:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.156422:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 28 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.156429:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 28 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.156681:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 28 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.156692:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861097344:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143112.156731:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.156765:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5492 00000100:00100000:1.0:1746143112.156771:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858243712:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143112.169352:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.169435:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861097344:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143112.169454:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.169497:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858243968:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13140us (13952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.169511:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5975 00000100:00100000:0.0:1746143112.179547:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.179628:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.180126:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858243840:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 24395us (24617us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143112.180135:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1820 00002000:00100000:1.0:1746143112.180142:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008eb20380 x1830962858243840/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/440 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.180149:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20380 with x1830962858243840 ext(1048576->2097151) 00010000:00010000:1.0:1746143112.180159:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8b3 expref: 21 pid: 10061 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143112.180174:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8b3 expref: 21 pid: 10061 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143112.180181:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008eb20380 00000100:00100000:1.0:1746143112.180200:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5494 00000100:00100000:1.0:1746143112.180207:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858244608:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143112.187818:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.196149:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1968:x1830962858244608:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 15930us (16508us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143112.196161:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5494 00002000:00100000:1.0:1746143112.196173:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008eb20e00 x1830962858244608/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:263/0 lens 488/440 e 0 to 0 dl 1746143123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.196183:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20e00 with x1830962858244608 ext(3145728->4194303) 00002000:00010000:1.0:1746143112.196190:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb20e00 00000100:00100000:0.0:1746143112.196862:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.201633:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858245248 00000100:00100000:1.0:1746143112.201643:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858245248 00010000:00010000:1.0:1746143112.201685:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8b3 expref: 21 pid: 10061 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.201716:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5976 00000100:00100000:1.0:1746143112.201724:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858245248:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.201739:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.201934:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8b3 expref: 21 pid: 10061 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.201946:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8b3 expref: 21 pid: 10061 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.201970:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090495600/0x25aee876ca70addf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8b3 expref: 21 pid: 10061 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.202001:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.202004:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.202011:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.202019:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.202063:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.202074:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861097472:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143112.202136:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.204309:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861097472:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143112.204328:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.204363:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858245248:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2640us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.204372:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5976 00000100:00100000:0.0:1746143112.205119:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.208232:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.208280:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.208339:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858245760 00000100:00100000:1.0:1746143112.208347:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858245760 00002000:00100000:1.0:1746143112.208388:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008eb21c00 x1830962858245760/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.208397:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21c00 with x1830962858245760 ext(2097152->3145727) 00002000:00010000:1.0:1746143112.208401:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21c00 00000100:00100000:1.0:1746143112.210749:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858246016 00000100:00100000:1.0:1746143112.210757:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858246016 00002000:00100000:1.0:1746143112.210786:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008eb21f80 x1830962858246016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.210795:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21f80 with x1830962858246016 ext(3145728->4194303) 00002000:00010000:1.0:1746143112.210800:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21f80 00000100:00100000:1.0:1746143112.210818:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5497 00000100:00100000:1.0:1746143112.210823:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858246016:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143112.220161:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.244660:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.246991:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858246656 00000100:00100000:1.0:1746143112.247004:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858246656 00010000:00010000:1.0:1746143112.247048:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbf8e00/0x25aee876ca70ad06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e835 expref: 32 pid: 8169 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143112.247079:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5977 00000100:00100000:1.0:1746143112.247085:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858246656:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.247095:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.247110:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bbf8e00/0x25aee876ca70ad06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e835 expref: 32 pid: 8169 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.247118:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bbf8e00/0x25aee876ca70ad06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e835 expref: 32 pid: 8169 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.247136:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbf8e00/0x25aee876ca70ad06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e835 expref: 32 pid: 8169 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.247151:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.247192:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858246656:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 108us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.247196:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5977 00000100:00100000:0.0:1746143112.247295:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.247341:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858246528 00000100:00100000:1.0:1746143112.247345:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858246528 00010000:00010000:1.0:1746143112.247356:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130adfe00/0x25aee876ca70ae02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8cf expref: 13 pid: 8450 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143112.247380:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5978 00000100:00100000:1.0:1746143112.247383:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858246528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.247388:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.247393:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130adfe00/0x25aee876ca70ae02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8cf expref: 13 pid: 8450 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.247398:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130adfe00/0x25aee876ca70ae02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8cf expref: 13 pid: 8450 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.247406:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130adfe00/0x25aee876ca70ae02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8cf expref: 13 pid: 8450 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.247411:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.247426:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858246528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.247430:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5978 00000100:00100000:0.0:1746143112.247937:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.247982:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858246784 00000100:00100000:1.0:1746143112.247986:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858246784 00010000:00010000:1.0:1746143112.248000:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135db3800/0x25aee876ca70acf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e820 expref: 32 pid: 4756 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143112.248027:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5979 00000100:00100000:1.0:1746143112.248048:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858246784:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.248056:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.248064:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135db3800/0x25aee876ca70acf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e820 expref: 32 pid: 4756 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.248073:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135db3800/0x25aee876ca70acf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e820 expref: 32 pid: 4756 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.248085:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135db3800/0x25aee876ca70acf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e820 expref: 32 pid: 4756 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.248093:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.248095:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.248100:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 30 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.248107:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 30 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.248143:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 30 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.248154:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861097984:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143112.248216:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.261130:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.261195:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861097984:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143112.261221:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143112.261267:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858246784:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13233us (13329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143112.261278:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5979 00000100:00100000:0.0:1746143112.271259:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.271291:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.271309:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.271742:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.271770:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858247168 00000100:00100000:0.0:1746143112.271778:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858247168 00000100:00100000:0.0:1746143112.271812:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858247296 00000100:00100000:0.0:1746143112.271814:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858247296 00000100:00100000:0.0:1746143112.271828:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11417 00000100:00100000:0.0:1746143112.271835:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858247168:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143112.271852:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143112.271868:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3c7800/0x25aee876ca70ae48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e907 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143112.271916:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861098112:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143112.271983:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.271999:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11418 00000100:00100000:0.0:1746143112.272004:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858247296:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143112.272011:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143112.272020:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7a00/0x25aee876ca70ae4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e90e expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143112.272055:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861098240:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143112.272073:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.272091:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858247552 00000100:00100000:0.0:1746143112.272094:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858247552 00000100:00100000:0.0:1746143112.272120:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7984 00000100:00100000:0.0:1746143112.272124:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:30439:x1830962858247552:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143112.272137:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143112.272149:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009358c200/0x25aee876ca70ae56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e915 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.272249:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.274837:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.274853:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.274871:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.274887:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.274893:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275683:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70ae6b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275694:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275701:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:0.0:1746143112.275712:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143112.275790:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275797:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275803:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275807:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f58000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143112.275811:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275817:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275826:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143112.275834:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143112.275838:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275843:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58000/0x25aee876ca70ae5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275864:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275869:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275873:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275877:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f58200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143112.275879:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275884:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275889:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009494d000) 00010000:00010000:0.0:1746143112.275891:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143112.275892:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275896:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70ae64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143112.275938:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009358c200/0x25aee876ca70ae56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e915 expref: 215 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.275958:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70ae6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e915 expref: 214 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.275964:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143112.275966:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143112.275968:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f59e00, rc 0) 00000100:00100000:0.0:1746143112.276021:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:30439:x1830962858247552:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3895us (4769us total) trans 8589942181 rc 0/0 00000100:00100000:0.0:1746143112.276831:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7984 00002000:00010000:0.0:1746143112.288344:0:21048:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143110 -> 1746143111 00002000:00010000:0.0:1746143112.288349:0:21048:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143108 -> 1746143111 00002000:00010000:0.0:1746143112.288352:0:21048:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143110 -> 1746143111 00002000:00010000:0.0:1746143112.288447:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143110 -> 1746143111 00002000:00010000:0.0:1746143112.288449:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143110 -> 1746143111 00002000:00010000:0.0:1746143112.288451:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143110 -> 1746143111 00000100:00100000:0.0:1746143112.288472:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861098112:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143112.288504:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3c7800/0x25aee876ca70ae48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e907 expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143112.288518:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3c7800/0x25aee876ca70ae48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e907 expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143112.288529:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3c7800, rc 0) 00000100:00100000:0.0:1746143112.288595:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858247168:12345-192.168.201.28@tcp:101:cat.0 Request processed in 16758us (17300us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143112.288614:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11417 00000100:00100000:0.0:1746143112.288659:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861098240:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143112.288677:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7a00/0x25aee876ca70ae4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e90e expref: 30 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143112.288688:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7a00/0x25aee876ca70ae4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e90e expref: 30 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143112.288696:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3c7a00, rc 0) 00000100:00100000:0.0:1746143112.288724:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858247296:12345-192.168.201.28@tcp:101:cat.0 Request processed in 16712us (17406us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143112.288731:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11418 00000100:00100000:0.0:1746143112.294777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.294812:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858247936 00000100:00100000:0.0:1746143112.294820:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858247936 00000100:00100000:0.0:1746143112.294858:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11419 00000100:00100000:0.0:1746143112.294867:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30439:x1830962858247936:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143112.294886:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143112.294904:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e91c expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.294935:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70ad37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e866 expref: 28 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.294943:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 11 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143112.294955:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70ad7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e882 expref: 30 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143112.294961:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143112.294963:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143112.294966:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [487424->700415] (req 487424->700415) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.294994:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70ad7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e882 expref: 30 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143112.295005:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70ad7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e882 expref: 30 pid: 10061 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143112.295015:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861098368:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143112.295111:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 11 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143112.295120:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 11 pid: 10061 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143112.295129:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861098496:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143112.295163:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70ad37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e866 expref: 28 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.295181:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70ad37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e866 expref: 28 pid: 10061 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143112.295191:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861098624:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143112.295212:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.297320:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.303923:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861098752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143112.303985:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143112.304059:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861098752 00000100:00100000:1.0:1746143112.304067:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861098752 00000100:00100000:1.0:1746143112.304116:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1746143112.304125:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3301:x1830962861098752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746143112.304158:0:8451:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 409534464 pending 30670848 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746143112.304193:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3301:x1830962861098752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.304199:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:1.0:1746143112.304219:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143112.305461:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143112.305478:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3302:1830962861098880:0@lo:400:kworker.0 00000100:00100000:1.0:1746143112.305508:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143112.305531:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830962861099392:0@lo:400:kworker.0 00000100:00100000:1.0:1746143112.305549:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143112.305563:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143112.305568:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861099264:0@lo:400:kworker.0 00000100:00100000:1.0:1746143112.305600:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143112.305623:0:14791:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861098880 00000100:00100000:1.0:1746143112.305625:0:14791:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861098880 00000100:00100000:1.0:1746143112.305646:0:14791:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1746143112.305651:0:14791:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3302:x1830962861098880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143112.305674:0:14791:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3302:x1830962861098880:12345-0@lo:400:kworker.0 Request processed in 23us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.305678:0:14791:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1746143112.305699:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861099264 00000100:00100000:1.0:1746143112.305701:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861099264 00000100:00100000:1.0:1746143112.305723:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1746143112.305728:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3302:x1830962861099264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143112.305749:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3302:x1830962861099264:12345-0@lo:400:kworker.0 Request processed in 22us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.305753:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1746143112.305781:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861098752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143112.305797:0:3302:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872629 gen 2 00000004:00080000:1.0:1746143112.305802:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f23800, transno 17179872555 00000004:00080000:1.0:1746143112.305809:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f21180, transno 17179872556 00000004:00080000:1.0:1746143112.305811:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f21880, transno 17179872557 00000004:00080000:1.0:1746143112.305813:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f20e00, transno 17179872558 00000004:00080000:1.0:1746143112.305815:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f20000, transno 17179872559 00000004:00080000:1.0:1746143112.305817:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f22300, transno 17179872560 00000004:00080000:1.0:1746143112.305819:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f20a80, transno 17179872561 00000004:00080000:1.0:1746143112.305821:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f21c00, transno 17179872562 00000004:00080000:1.0:1746143112.305824:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aed500, transno 17179872569 00000004:00080000:1.0:1746143112.305826:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aeea00, transno 17179872570 00000004:00080000:1.0:1746143112.305828:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aef480, transno 17179872571 00000004:00080000:1.0:1746143112.305830:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aefb80, transno 17179872572 00000004:00080000:1.0:1746143112.305833:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aef100, transno 17179872573 00000004:00080000:1.0:1746143112.305835:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aef800, transno 17179872574 00000004:00080000:1.0:1746143112.305837:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aec700, transno 17179872575 00000004:00080000:1.0:1746143112.305839:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aee680, transno 17179872576 00000004:00080000:1.0:1746143112.305841:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e034380, transno 17179872580 00000004:00080000:1.0:1746143112.305843:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e034700, transno 17179872581 00000004:00080000:1.0:1746143112.305845:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e036a00, transno 17179872582 00000004:00080000:1.0:1746143112.305847:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e034a80, transno 17179872583 00000004:00080000:1.0:1746143112.305850:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e037b80, transno 17179872584 00000004:00080000:1.0:1746143112.305852:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e037100, transno 17179872585 00000004:00080000:1.0:1746143112.305854:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e036300, transno 17179872586 00000004:00080000:1.0:1746143112.305857:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e034000, transno 17179872587 00000100:00100000:0.0:1746143112.305857:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000004:00080000:1.0:1746143112.305859:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5cc8700, transno 17179872588 00000004:00080000:1.0:1746143112.305862:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f23480, transno 17179872589 00000004:00080000:1.0:1746143112.305864:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ccb480, transno 17179872590 00000004:00080000:1.0:1746143112.305867:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f23b80, transno 17179872591 00000004:00080000:1.0:1746143112.305869:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090f22d80, transno 17179872592 00000004:00080000:1.0:1746143112.305872:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ccaa00, transno 17179872593 00000004:00080000:1.0:1746143112.305874:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ae2c700, transno 17179872594 00000004:00080000:1.0:1746143112.305876:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5cca680, transno 17179872595 00000004:00080000:1.0:1746143112.305879:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5843100, transno 17179872603 00000004:00080000:1.0:1746143112.305881:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1e8700, transno 17179872604 00000004:00080000:1.0:1746143112.305883:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5841180, transno 17179872605 00000004:00080000:1.0:1746143112.305886:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a7b100, transno 17179872606 00000004:00080000:1.0:1746143112.305888:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5841f80, transno 17179872607 00000004:00080000:1.0:1746143112.305891:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad5a680, transno 17179872608 00000004:00080000:1.0:1746143112.305893:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5841880, transno 17179872609 00000004:00080000:1.0:1746143112.305895:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1ea300, transno 17179872610 00000100:00100000:0.0:1746143112.305897:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858248320 00000004:00080000:1.0:1746143112.305898:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fe300, transno 17179872614 00000100:00100000:0.0:1746143112.305899:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858248320 00000004:00080000:1.0:1746143112.305900:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5840380, transno 17179872615 00000004:00080000:1.0:1746143112.305904:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f358380, transno 17179872616 00000004:00080000:1.0:1746143112.305906:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f358a80, transno 17179872617 00000004:00080000:1.0:1746143112.305908:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f35b480, transno 17179872618 00000004:00080000:1.0:1746143112.305911:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fd180, transno 17179872619 00000004:00080000:1.0:1746143112.305913:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f35bb80, transno 17179872620 00000004:00080000:1.0:1746143112.305915:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f358700, transno 17179872621 00000004:00080000:1.0:1746143112.305918:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d92aa00, transno 17179872622 00000004:00080000:1.0:1746143112.305920:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d929c00, transno 17179872623 00010000:00010000:0.0:1746143112.305920:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 12 pid: 10061 timeout: 994 lvb_type: 1 00000004:00080000:1.0:1746143112.305922:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d92a680, transno 17179872624 00000004:00080000:1.0:1746143112.305925:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d929f80, transno 17179872625 00000004:00080000:1.0:1746143112.305928:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d92ad80, transno 17179872626 00000004:00080000:1.0:1746143112.305929:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d92b480, transno 17179872627 00000004:00080000:1.0:1746143112.305931:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d92bb80, transno 17179872628 00000004:00080000:1.0:1746143112.305934:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d928000, transno 17179872629 00000100:00100000:1.0:1746143112.305937:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861099264:0@lo:400:kworker.0 00000100:00100000:0.0:1746143112.305940:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5980 00000100:00100000:1.0:1746143112.305945:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3302:1830962861098880:0@lo:400:kworker.0 00000100:00100000:0.0:1746143112.305945:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858248320:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143112.305953:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1746143112.305959:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746143112.305977:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 12 pid: 10061 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143112.305987:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 12 pid: 10061 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143112.306011:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143112.306052:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858248320:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 107us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143112.306059:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5980 00000100:00100000:0.0:1746143112.306748:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861098368:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143112.306758:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be95000/0x25aee876ca70ade6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ba expref: 11 pid: 10061 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143112.306770:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861098496:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143112.306778:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861098624:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.307286:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830962861099392:0@lo:400:kworker.0 00010000:00010000:0.0:1746143112.307382:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [487424->700415] (req 487424->700415) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.307393:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3c7200, rc 0) 00000100:00100000:0.0:1746143112.307415:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:30439:x1830962858247936:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 12550us (12646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143112.307421:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11419 00000100:00100000:0.0:1746143112.311149:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.311175:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.312146:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858248448 00000100:00100000:0.0:1746143112.312154:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858248448 00010000:00010000:0.0:1746143112.312189:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70ad7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e882 expref: 32 pid: 10061 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143112.312756:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5982 00000100:00100000:0.0:1746143112.312762:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858248576:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143112.312769:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143112.312974:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70ad37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e866 expref: 29 pid: 10061 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.312992:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70ad37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e866 expref: 29 pid: 10061 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.313802:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70ad37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e866 expref: 29 pid: 10061 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.313812:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143112.313814:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143112.313821:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.313829:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.314049:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.314065:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baeaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861099520:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143112.314178:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.321127:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baeaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861099520:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143112.321148:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.321189:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858248576:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8426us (10012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.321201:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5982 00000100:00100000:0.0:1746143112.325568:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.325640:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858248832 00000100:00100000:0.0:1746143112.325649:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858248832 00002000:00100000:0.0:1746143112.325693:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (487424->491519) req@ffff880135e64a80 x1830962858248832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.325704:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e64a80 with x1830962858248832 ext(487424->491519) 00002000:00010000:0.0:1746143112.325710:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e64a80 00000100:00100000:0.0:1746143112.325731:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5501 00000100:00100000:0.0:1746143112.325739:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858248832:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143112.325890:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858248832:12345-192.168.201.28@tcp:3:cat.0 Request processed in 151us (329us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143112.325906:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5501 00002000:00100000:0.0:1746143112.325913:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (487424->491519) req@ffff880135e64a80 x1830962858248832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/4536 e 0 to 0 dl 1746143123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.325920:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e64a80 with x1830962858248832 ext(487424->491519) 00002000:00010000:0.0:1746143112.325923:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e64a80 00000100:00100000:1.0:1746143112.329158:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.329184:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143112.475492:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143112.515754:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.518881:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858250112 00000100:00100000:0.0:1746143112.518889:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858250112 00000100:00100000:0.0:1746143112.518935:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7986 00000100:00100000:0.0:1746143112.518942:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30453:x1830962858250112:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143112.518965:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143112.518979:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a200/0x25aee876ca70aeaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e946 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.519100:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519112:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519122:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519133:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519138:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519155:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519249:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519258:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519264:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143112.519272:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143112.519359:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519365:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519372:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519378:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea7b400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143112.519382:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519389:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519400:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143112.519402:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143112.519407:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519419:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7b400/0x25aee876ca70aeb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519442:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519446:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519450:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519454:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea7a000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143112.519457:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519461:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519467:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5370400) 00010000:00010000:0.0:1746143112.519470:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143112.519472:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519476:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a000/0x25aee876ca70aeb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.519517:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7a200/0x25aee876ca70aeaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 20 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.519528:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 19 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.519543:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143112.519545:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143112.519547:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea7be00, rc 0) 00000100:00100000:0.0:1746143112.519605:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30453:x1830962858250112:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 663us (955us total) trans 8589942183 rc 0/0 00000100:00100000:0.0:1746143112.519612:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7986 00000100:00100000:0.0:1746143112.520803:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.520872:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858250240 00000100:00100000:1.0:1746143112.520878:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858250240 00010000:00010000:1.0:1746143112.520905:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70ae6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e915 expref: 217 pid: 14795 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.520937:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5983 00000100:00100000:1.0:1746143112.520943:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+217:1969:x1830962858250240:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.520954:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.520959:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70ae6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e915 expref: 217 pid: 14795 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.520969:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70ae6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e915 expref: 217 pid: 14795 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.520985:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70ae6b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e915 expref: 217 pid: 14795 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.520999:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143112.521003:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70aea3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.521011:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70aea3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.521021:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70aea3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.521070:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.521098:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:1969:x1830962858250240:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 155us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.521106:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5983 00000100:00100000:0.0:1746143112.532760:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.533927:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.547611:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.547655:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.547983:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858250880 00000100:00100000:1.0:1746143112.547995:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858250880 00000100:00100000:1.0:1746143112.548087:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 603 00000100:00100000:1.0:1746143112.548096:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858250880:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.548113:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.548136:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497a00/0x25aee876ca70aef7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e95b expref: 21 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.548163:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143112.548167:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.548206:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858250880:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 111us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.548214:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 603 00000100:00100000:0.0:1746143112.570282:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.572866:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.614284:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.616152:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.616245:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.616295:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858251776 00000100:00100000:1.0:1746143112.616299:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858251776 00000100:00100000:1.0:1746143112.616319:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858251904 00000100:00100000:1.0:1746143112.616321:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858251904 00000100:00100000:1.0:1746143112.616333:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11428 00000100:00100000:1.0:1746143112.616338:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30454:x1830962858251776:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143112.616346:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.616356:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd1400/0x25aee876ca70af13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e970 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.616371:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.616376:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.616377:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.616379:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd1400/0x25aee876ca70af13 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e970 expref: 9 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.616394:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.616402:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 12 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.616410:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861101184:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.616446:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.616503:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11429 00000100:00100000:1.0:1746143112.616509:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30451:x1830962858251904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143112.616516:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.616523:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e977 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.616536:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.616542:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.616544:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.616546:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e977 expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.616561:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.616569:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 9 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.616590:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861101312:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.616614:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.628392:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861101184:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.628423:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd1400/0x25aee876ca70af13 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e970 expref: 9 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.628440:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd1400, rc 0) 00000100:00100000:1.0:1746143112.628484:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30454:x1830962858251776:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12144us (12332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.628492:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11428 00000100:00100000:1.0:1746143112.628555:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861101312:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.628568:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e977 expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.628597:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd1c00, rc 0) 00000100:00100000:1.0:1746143112.628614:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30451:x1830962858251904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12105us (12369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.628620:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11429 00000100:00100000:1.0:1746143112.628675:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.631401:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.631515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.631546:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858252160 00000100:00100000:0.0:1746143112.631555:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858252160 00002000:00100000:0.0:1746143112.631622:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (487424->700415) req@ffff8800a5e39180 x1830962858252160/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.631633:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39180 with x1830962858252160 ext(487424->700415) 00010000:00010000:0.0:1746143112.631644:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 13 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.631657:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 13 pid: 21048 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746143112.631683:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e39180 00000100:00100000:1.0:1746143112.632074:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858252416 00000100:00100000:1.0:1746143112.632081:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858252416 00010000:00010000:1.0:1746143112.632106:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134a10e00/0x25aee876ca70ac9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7ef expref: 10 pid: 8169 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.632148:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5984 00000100:00100000:1.0:1746143112.632157:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858252416:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.632173:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143112.632195:0:9869:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4139 00010000:00010000:1.0:1746143112.632203:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134a10e00/0x25aee876ca70ac9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7ef expref: 10 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.632214:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134a10e00/0x25aee876ca70ac9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7ef expref: 10 pid: 8169 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143112.632346:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1821 00000100:00100000:0.0:1746143112.632355:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1968:x1830962858252160:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143112.632678:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.632768:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.632791:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858252032 00000100:00100000:0.0:1746143112.632797:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858252032 00010000:00010000:0.0:1746143112.632815:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090495e00/0x25aee876ca70ae09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8dd expref: 7 pid: 26949 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143112.632837:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858252544 00000100:00100000:0.0:1746143112.632840:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858252544 00010000:00010000:0.0:1746143112.632854:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130ade600/0x25aee876ca70acb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e804 expref: 23 pid: 4756 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143112.632874:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5985 00000100:00100000:0.0:1746143112.632880:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858252032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143112.632890:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.632943:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a10e00/0x25aee876ca70ac9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e7ef expref: 11 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.634264:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090495e00/0x25aee876ca70ae09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8dd expref: 7 pid: 26949 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143112.634274:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090495e00/0x25aee876ca70ae09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8dd expref: 7 pid: 26949 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143112.634288:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090495e00/0x25aee876ca70ae09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8dd expref: 7 pid: 26949 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143112.634310:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143112.634337:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858252032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1458us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143112.634344:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5985 00010000:00010000:1.0:1746143112.634448:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.634466:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858252416:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2311us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.634472:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5984 00000100:00100000:1.0:1746143112.646708:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858252160:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 14339us (18017us total) trans 21474839880 rc 0/0 00000100:00100000:1.0:1746143112.646724:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1821 00002000:00100000:1.0:1746143112.646738:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (487424->700415) req@ffff8800a5e39180 x1830962858252160/t21474839880(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/448 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.646748:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39180 with x1830962858252160 ext(487424->700415) 00010000:00010000:1.0:1746143112.646761:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 15 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.646776:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3c7200/0x25aee876ca70ae79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e91c expref: 15 pid: 21048 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143112.646783:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e39180 00000100:00100000:0.0:1746143112.653065:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858252800 00000100:00100000:0.0:1746143112.653077:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858252800 00002000:00100000:0.0:1746143112.653122:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2969600->2973695) req@ffff88012b801f80 x1830962858252800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.653133:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801f80 with x1830962858252800 ext(2969600->2973695) 00002000:00010000:0.0:1746143112.653140:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b801f80 00000100:00100000:0.0:1746143112.653171:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5503 00000100:00100000:0.0:1746143112.653179:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858252800:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143112.653390:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858252800:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 212us (1892us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143112.653397:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5503 00002000:00100000:0.0:1746143112.653403:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2969600->2973695) req@ffff88012b801f80 x1830962858252800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/4536 e 0 to 0 dl 1746143123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.653410:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801f80 with x1830962858252800 ext(2969600->2973695) 00002000:00010000:0.0:1746143112.653413:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b801f80 00000100:00100000:0.0:1746143112.656703:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.657075:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.673304:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.673649:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.674171:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.674188:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858253312 00000100:00100000:1.0:1746143112.674191:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858253312 00010000:00010000:1.0:1746143112.674215:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a53f1200/0x25aee876ca70ae3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8f9 expref: 15 pid: 22204 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.674232:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858253568 00000100:00100000:1.0:1746143112.674234:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858253568 00010000:00010000:1.0:1746143112.674241:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 10 pid: 8169 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.674511:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5988 00000100:00100000:1.0:1746143112.674517:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858253312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.674528:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.674545:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a53f1200/0x25aee876ca70ae3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8f9 expref: 15 pid: 22204 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.674555:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a53f1200/0x25aee876ca70ae3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8f9 expref: 15 pid: 22204 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.674583:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f1200/0x25aee876ca70ae3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8f9 expref: 15 pid: 22204 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.674600:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.674634:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858253312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 116us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.674639:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5988 00000100:00100000:1.0:1746143112.674658:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5989 00000100:00100000:1.0:1746143112.674662:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858253568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.674668:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.674673:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 10 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.674681:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 10 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.674695:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090494400/0x25aee876ca70add8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8ac expref: 10 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.674704:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.674706:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.674712:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b430ee00/0x25aee876ca70af21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e97e expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.674719:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b430ee00/0x25aee876ca70af21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e97e expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.674745:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b430ee00/0x25aee876ca70af21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e97e expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.674754:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e034700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861101952:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143112.674793:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.678750:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.679154:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858253696 00000100:00100000:0.0:1746143112.679164:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858253696 00010000:00010000:0.0:1746143112.679206:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 11 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143112.679245:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5990 00000100:00100000:0.0:1746143112.679253:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e036a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858253696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143112.679267:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143112.679289:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 11 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.679300:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 11 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.679323:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc64400/0x25aee876ca70ae10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8e4 expref: 11 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.679342:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143112.679344:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143112.679352:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e977 expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.679361:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e977 expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.679392:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e977 expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143112.679404:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f358380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861102080:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143112.679479:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.680340:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e034700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861101952:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143112.680358:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143112.680426:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858253568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5761us (6254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143112.680434:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5989 00000100:00100000:1.0:1746143112.681625:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f358380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861102080:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143112.681640:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.681698:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e036a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858253696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2445us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.681706:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5990 00000100:00100000:1.0:1746143112.684553:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.685765:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.687502:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858254080 00000100:00100000:0.0:1746143112.687514:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858254080 00002000:00100000:0.0:1746143112.687558:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008e034a80 x1830962858254080/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.687568:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e034a80 with x1830962858254080 ext(1048576->2097151) 00002000:00010000:0.0:1746143112.687583:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e034a80 00000100:00100000:0.0:1746143112.687608:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858254208 00000100:00100000:0.0:1746143112.687610:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858254208 00002000:00100000:0.0:1746143112.687622:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3563520->3567615) req@ffff88008e037b80 x1830962858254208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.687628:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e037b80 with x1830962858254208 ext(3563520->3567615) 00002000:00010000:0.0:1746143112.687631:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e037b80 00000100:00100000:0.0:1746143112.687642:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5505 00000100:00100000:0.0:1746143112.687649:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858254080:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143112.704606:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858254080:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 16953us (20057us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143112.704617:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5505 00002000:00100000:1.0:1746143112.704624:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008e034a80 x1830962858254080/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/440 e 0 to 0 dl 1746143123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.704631:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e034a80 with x1830962858254080 ext(1048576->2097151) 00002000:00010000:1.0:1746143112.704636:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e034a80 00000100:00100000:0.0:1746143112.726158:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.726270:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.726310:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858254720 00000100:00100000:0.0:1746143112.726317:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858254720 00002000:00100000:0.0:1746143112.726355:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (2027520->2031615) req@ffff88009f35b480 x1830962858254720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.726378:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35b480 with x1830962858254720 ext(2027520->2031615) 00010000:00010000:0.0:1746143112.726386:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 8 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.726399:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 8 pid: 8169 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746143112.726406:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f35b480 00000100:00100000:0.0:1746143112.726434:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1823 00000100:00100000:0.0:1746143112.726440:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858254720:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143112.726843:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858254592 00000100:00100000:1.0:1746143112.726846:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858254592 00000100:00100000:1.0:1746143112.726868:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11432 00000100:00100000:1.0:1746143112.726873:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30454:x1830962858254592:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143112.726882:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.726897:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba21400/0x25aee876ca70af2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e98c expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.726915:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.726917:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.726923:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba21400/0x25aee876ca70af2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e98c expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.726936:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ba21400/0x25aee876ca70af2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e98c expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.726945:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba21400, rc 0) 00000100:00100000:1.0:1746143112.726981:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30454:x1830962858254592:12345-192.168.201.28@tcp:101:cat.0 Request processed in 108us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.726987:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11432 00000100:00100000:0.0:1746143112.728073:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858254720:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1631us (1800us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143112.728079:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1823 00002000:00100000:0.0:1746143112.728084:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (2027520->2031615) req@ffff88009f35b480 x1830962858254720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:263/0 lens 488/4536 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143112.728092:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35b480 with x1830962858254720 ext(2027520->2031615) 00010000:00010000:0.0:1746143112.728097:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 8 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143112.728107:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 8 pid: 8169 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746143112.728112:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f35b480 00000100:00100000:0.0:1746143112.728531:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.750191:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.750232:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.750271:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.753454:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.753505:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858255744 00000100:00100000:1.0:1746143112.753511:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858255744 00002000:00100000:1.0:1746143112.753541:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1474560->2027519) req@ffff88009f358700 x1830962858255744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.753551:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358700 with x1830962858255744 ext(1474560->2027519) 00010000:00010000:1.0:1746143112.753559:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 14 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.753580:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 14 pid: 8169 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143112.753587:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f358700 00000100:00100000:1.0:1746143112.753602:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1826 00000100:00100000:1.0:1746143112.753607:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858255744:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143112.760311:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.776493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.776615:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858256000 00000100:00100000:1.0:1746143112.776624:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858256000 00010000:00010000:1.0:1746143112.776655:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 13 pid: 8169 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.776693:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5991 00000100:00100000:1.0:1746143112.776700:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858256000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.776713:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.776734:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 13 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.776745:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 13 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.776765:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f0200/0x25aee876ca70ae41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e900 expref: 13 pid: 8169 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.776957:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.776959:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.776966:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70af28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e985 expref: 16 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.776975:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70af28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e985 expref: 16 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.777211:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70af28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e985 expref: 16 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.777224:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e036d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861102464:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143112.777311:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.778264:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858256128 00000100:00100000:1.0:1746143112.778268:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858256128 00010000:00010000:1.0:1746143112.778284:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b430ee00/0x25aee876ca70af21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e97e expref: 17 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.778311:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5992 00000100:00100000:1.0:1746143112.778317:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858256128:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.778325:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.778338:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b430ee00/0x25aee876ca70af21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e97e expref: 17 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.778346:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b430ee00/0x25aee876ca70af21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e97e expref: 17 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.778359:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b430ee00/0x25aee876ca70af21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e97e expref: 17 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.778368:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.778370:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.778374:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.778380:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.778399:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.778407:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e035880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861102592:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143112.778608:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.784838:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.785613:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e035880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861102592:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143112.785631:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.785932:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858256128:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7613us (7719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.785944:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5992 00000100:00100000:0.0:1746143112.788443:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.788667:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858256768 00000100:00100000:1.0:1746143112.788673:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858256768 00002000:00100000:1.0:1746143112.788698:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8801317b4380 x1830962858256768/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.788708:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b4380 with x1830962858256768 ext(1048576->2097151) 00002000:00010000:1.0:1746143112.788713:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b4380 00000100:00100000:1.0:1746143112.788738:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5509 00000100:00100000:1.0:1746143112.788911:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858256768:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143112.794301:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.797825:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858256768:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 9072us (9378us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143112.797837:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5509 00002000:00100000:1.0:1746143112.797846:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8801317b4380 x1830962858256768/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:263/0 lens 488/440 e 0 to 0 dl 1746143123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.797856:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b4380 with x1830962858256768 ext(1048576->2097151) 00002000:00010000:1.0:1746143112.797862:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b4380 00000100:00100000:0.0:1746143112.805236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.809108:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.814296:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.814682:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858257664 00000100:00100000:1.0:1746143112.814692:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858257664 00000100:00100000:1.0:1746143112.814952:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11435 00000100:00100000:1.0:1746143112.814960:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30451:x1830962858257664:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143112.814978:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.814996:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70af44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e9a1 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.815765:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.815775:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.815776:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143112.815780:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70af44 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a1 expref: 17 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.815810:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.815823:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 14 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.815836:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e037480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861102720:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.817591:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.819929:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e037480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861102720:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.819953:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70af44 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a1 expref: 17 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.819968:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba21800, rc 0) 00000100:00100000:1.0:1746143112.820001:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:30451:x1830962858257664:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5042us (5716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.820008:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11435 00000100:00100000:1.0:1746143112.833769:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.833821:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858257920 00000100:00100000:0.0:1746143112.833830:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858257920 00000100:00100000:0.0:1746143112.833884:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11436 00000100:00100000:0.0:1746143112.833891:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30454:x1830962858257920:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143112.833910:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143112.833928:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70af4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e9a8 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.833956:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5496800/0x25aee876ca70af0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e969 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.833963:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143112.833965:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143112.833968:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70af4b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a8 expref: 12 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.833994:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5496800/0x25aee876ca70af0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e969 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.834003:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5496800/0x25aee876ca70af0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e969 expref: 20 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143112.834257:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861102848:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143112.834759:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.840876:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.841095:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858258048 00000100:00100000:1.0:1746143112.841104:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858258048 00002000:00100000:1.0:1746143112.841150:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2969600->3145727) req@ffff88012d3d7b80 x1830962858258048/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.841161:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d7b80 with x1830962858258048 ext(2969600->3145727) 00010000:00010000:1.0:1746143112.841170:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5496800/0x25aee876ca70af0c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e969 expref: 21 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.841194:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5496800/0x25aee876ca70af0c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e969 expref: 21 pid: 21048 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143112.841201:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3d7b80 00000100:00100000:1.0:1746143112.841228:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1829 00000100:00100000:1.0:1746143112.841235:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858258048:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143112.841503:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861102848:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.841529:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70af4b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a8 expref: 12 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.841544:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df5800, rc 0) 00000100:00100000:1.0:1746143112.841565:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30454:x1830962858257920:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7674us (7808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.841582:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11436 00000100:00100000:1.0:1746143112.845862:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858258048:12345-192.168.201.28@tcp:4:cat.0 Request processed in 4620us (4990us total) trans 17179872635 rc 0/0 00000100:00100000:1.0:1746143112.845872:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1829 00002000:00100000:1.0:1746143112.845880:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2969600->3145727) req@ffff88012d3d7b80 x1830962858258048/t17179872635(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/448 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.845888:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d7b80 with x1830962858258048 ext(2969600->3145727) 00010000:00010000:1.0:1746143112.845896:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5496800/0x25aee876ca70af0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e969 expref: 23 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.845905:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5496800/0x25aee876ca70af0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e969 expref: 23 pid: 21048 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143112.845912:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3d7b80 00000100:00100000:0.0:1746143112.847092:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.847206:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858258176 00000100:00100000:1.0:1746143112.847213:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858258176 00010000:00010000:1.0:1746143112.847234:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 15 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.847262:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5993 00000100:00100000:1.0:1746143112.847268:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858258176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.847279:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.847325:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 15 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.847334:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 15 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.847354:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f391800/0x25aee876ca70af36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e993 expref: 15 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.847381:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.847384:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.847391:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70af44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a1 expref: 16 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.847398:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70af44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a1 expref: 16 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.847426:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70af44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a1 expref: 16 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143112.847436:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e036d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861102976:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143112.847496:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.848551:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.852010:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.852054:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858258560 00000100:00100000:1.0:1746143112.852060:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858258560 00002000:00100000:1.0:1746143112.852095:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800942c7480 x1830962858258560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.852104:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7480 with x1830962858258560 ext(2097152->3145727) 00002000:00010000:1.0:1746143112.852108:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c7480 00000100:00100000:1.0:1746143112.852133:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5512 00000100:00100000:1.0:1746143112.852139:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1971:x1830962858258560:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143112.854324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.861701:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1971:x1830962858258560:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 9549us (9679us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143112.861714:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5512 00002000:00100000:1.0:1746143112.861727:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800942c7480 x1830962858258560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/440 e 0 to 0 dl 1746143123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.861737:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7480 with x1830962858258560 ext(2097152->3145727) 00002000:00010000:1.0:1746143112.861744:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c7480 00000100:00100000:0.0:1746143112.872513:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.872865:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858259072 00000100:00100000:1.0:1746143112.872875:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858259072 00000100:00100000:0.0:1746143112.872880:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.872923:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858258944 00000100:00100000:1.0:1746143112.872926:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858258944 00000100:00100000:1.0:1746143112.872963:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11437 00000100:00100000:1.0:1746143112.872971:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30451:x1830962858259072:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143112.872989:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.873006:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70af52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e9af expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.873060:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.873062:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.873069:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70af52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9af expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.873083:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70af52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9af expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.873091:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444600, rc 0) 00000100:00100000:1.0:1746143112.873134:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30451:x1830962858259072:12345-192.168.201.28@tcp:101:cat.0 Request processed in 165us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.873146:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11437 00000100:00100000:0.0:1746143112.881003:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.881074:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.881181:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858259456 00000100:00100000:1.0:1746143112.881186:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858259456 00002000:00100000:1.0:1746143112.881219:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009b598700 x1830962858259456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.881230:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598700 with x1830962858259456 ext(2097152->3145727) 00002000:00010000:1.0:1746143112.881235:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598700 00000100:00100000:1.0:1746143112.881249:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5514 00000100:00100000:1.0:1746143112.881254:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858259456:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143112.887145:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.895825:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.899283:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858259456:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 18019us (18199us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143112.899296:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5514 00002000:00100000:1.0:1746143112.899308:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009b598700 x1830962858259456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/440 e 0 to 0 dl 1746143123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.899318:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598700 with x1830962858259456 ext(2097152->3145727) 00002000:00010000:1.0:1746143112.899324:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598700 00000100:00100000:0.0:1746143112.899654:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.899969:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858260096 00000100:00100000:1.0:1746143112.899975:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858260096 00002000:00100000:1.0:1746143112.900003:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3715072->3719167) req@ffff88009d92aa00 x1830962858260096/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/0 e 0 to 0 dl 1746143123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.900011:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d92aa00 with x1830962858260096 ext(3715072->3719167) 00010000:00010000:1.0:1746143112.900018:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70af59 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9b6 expref: 17 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.900044:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70af59 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9b6 expref: 17 pid: 21048 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143112.900057:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d92aa00 00000100:00100000:1.0:1746143112.900079:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1830 00000100:00100000:1.0:1746143112.900087:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1970:x1830962858260096:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143112.900245:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1970:x1830962858260096:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 158us (591us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143112.900250:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1830 00002000:00100000:1.0:1746143112.900254:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3715072->3719167) req@ffff88009d92aa00 x1830962858260096/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/4536 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.900262:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d92aa00 with x1830962858260096 ext(3715072->3719167) 00010000:00010000:1.0:1746143112.900267:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70af59 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9b6 expref: 17 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.900276:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70af59 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9b6 expref: 17 pid: 21048 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143112.900282:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d92aa00 00000100:00100000:0.0:1746143112.906341:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.910514:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.910559:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.913829:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.920888:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.921642:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.921851:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858260352:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 14681us (15519us total) trans 0 rc 245760/245760 00000100:00100000:1.0:1746143112.921864:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1831 00002000:00100000:1.0:1746143112.921878:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3391487) req@ffff88009d929c00 x1830962858260352/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:263/0 lens 488/440 e 0 to 0 dl 1746143123 ref 1 fl Complete:H/200/0 rc 245760/245760 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143112.921888:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d929c00 with x1830962858260352 ext(3145728->3391487) 00010000:00010000:1.0:1746143112.921898:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70af59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9b6 expref: 21 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.921915:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70af59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9b6 expref: 21 pid: 21048 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143112.921922:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d929c00 00000100:00100000:0.0:1746143112.935697:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.939925:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.940013:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.950961:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.951083:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.951121:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.951158:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858263040 00000100:00100000:1.0:1746143112.951168:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858263040 00000100:00100000:1.0:1746143112.951215:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7989 00000100:00100000:1.0:1746143112.951233:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:30462:x1830962858263040:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143112.951253:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.951271:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094444400/0x25aee876ca70af91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e9f5 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.951625:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.951637:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.951647:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.951659:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.951664:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.951669:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.951979:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377a00/0x25aee876ca70afa6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.951987:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377a00/0x25aee876ca70afa6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.951993:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377a00/0x25aee876ca70afa6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143112.952002:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143112.952106:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952112:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952118:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952124:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094444000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143112.952127:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952134:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952144:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143112.952147:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143112.952150:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952155:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444000/0x25aee876ca70af98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952172:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952177:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952182:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952186:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5377200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143112.952188:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952193:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952199:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e924100) 00010000:00010000:1.0:1746143112.952201:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143112.952203:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952208:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377200/0x25aee876ca70af9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143112.952242:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444400/0x25aee876ca70af91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9f5 expref: 25 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.952252:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377a00/0x25aee876ca70afa6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9f5 expref: 24 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.952258:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143112.952260:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143112.952262:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5377a00, rc 0) 00000100:00100000:1.0:1746143112.952282:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30462:x1830962858263040:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1050us (1201us total) trans 8589942189 rc 0/0 00000100:00100000:1.0:1746143112.952288:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7989 00000100:00100000:1.0:1746143112.952323:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.952337:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858262528 00000100:00100000:1.0:1746143112.952340:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858262528 00000100:00100000:1.0:1746143112.953360:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11444 00000100:00100000:1.0:1746143112.953366:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858262528:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143112.953374:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.953382:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e9e0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.953393:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.953395:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.953399:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e0 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.953408:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e0 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.953416:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5376000, rc 0) 00000100:00100000:1.0:1746143112.953433:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858262528:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 68us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.953439:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11444 00000100:00100000:0.0:1746143112.959835:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.959999:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.970627:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.971078:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858263680 00000100:00100000:1.0:1746143112.971089:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858263680 00000100:00100000:1.0:1746143112.971731:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11446 00000100:00100000:1.0:1746143112.971941:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30462:x1830962858263680:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143112.971961:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143112.971981:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5376a00/0x25aee876ca70afd0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164e9fc expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.972013:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70af28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e985 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.972022:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e0 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.972068:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5200/0x25aee876ca70af3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e99a expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.972076:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.972078:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143112.972082:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5376a00/0x25aee876ca70afd0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1126400->1323007] (req 1126400->1323007) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9fc expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.972115:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5200/0x25aee876ca70af3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e99a expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.972553:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5200/0x25aee876ca70af3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e99a expref: 18 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.972576:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e034380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861104000:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.973471:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e0 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143112.973482:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e0 expref: 7 pid: 22204 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143112.973492:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e036a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861104128:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.974943:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70af28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e985 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.974955:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70af28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e985 expref: 20 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.974966:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e036d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861104256:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.975008:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143112.976013:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143112.976065:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858263936 00000100:00100000:0.0:1746143112.976072:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858263936 00000100:00100000:0.0:1746143112.976114:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7990 00000100:00100000:0.0:1746143112.976122:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30459:x1830962858263936:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143112.976141:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143112.976159:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70afd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea03 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.976273:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70afde lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.976287:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f12600/0x25aee876ca70af83 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9cb expref: 14 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.976294:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377a00/0x25aee876ca70afa6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9f5 expref: 23 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.976300:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70afde lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143112.976322:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377a00/0x25aee876ca70afa6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9f5 expref: 23 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.976330:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377a00/0x25aee876ca70afa6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9f5 expref: 23 pid: 14796 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143112.976353:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861104384:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143112.976638:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094f12600/0x25aee876ca70af83 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9cb expref: 14 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143112.976646:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f12600/0x25aee876ca70af83 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9cb expref: 14 pid: 14796 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143112.976653:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861104512:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143112.976673:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143112.985970:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e034380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861104000:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.986069:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.986110:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143112.986130:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858264192 00000100:00100000:1.0:1746143112.986136:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858264192 00010000:00010000:1.0:1746143112.986164:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e0 expref: 8 pid: 22204 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143112.986186:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858264064 00000100:00100000:1.0:1746143112.986188:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858264064 00010000:00010000:1.0:1746143112.986196:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5200/0x25aee876ca70af3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e99a expref: 19 pid: 21048 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.986211:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5998 00000100:00100000:1.0:1746143112.986216:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858264192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.986229:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.986249:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e0 expref: 8 pid: 22204 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.986260:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5376000/0x25aee876ca70afc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e0 expref: 8 pid: 22204 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143112.986285:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.986307:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858264192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.986313:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5998 00000100:00100000:1.0:1746143112.986326:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5999 00000100:00100000:1.0:1746143112.986330:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858264064:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143112.986338:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143112.986346:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5200/0x25aee876ca70af3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e99a expref: 19 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.986355:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5200/0x25aee876ca70af3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e99a expref: 19 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.986368:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5200/0x25aee876ca70af3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e99a expref: 19 pid: 21048 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143112.986389:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143112.986406:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858264064:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143112.986411:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5999 00010000:00010000:1.0:1746143112.993213:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5377a00/0x25aee876ca70afa6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9f5 expref: 23 pid: 14796 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143112.993232:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861104384:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143112.993242:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861104512:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143112.993259:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70afde lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143112.996116:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143112.996908:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70afde lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143112.996917:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70afde lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:1.0:1746143112.996940:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143112.997127:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70afd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea03 expref: 15 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.997140:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70afde lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea03 expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143112.997146:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143112.997148:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143112.997151:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8400, rc 0) 00000100:00100000:1.0:1746143112.997179:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30459:x1830962858263936:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 21058us (21168us total) trans 8589942190 rc 0/0 00000100:00100000:1.0:1746143112.997185:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7990 00000100:00100000:0.0:1746143113.001070:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.001496:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.002393:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.002720:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858265088 00000100:00100000:1.0:1746143113.002725:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858265088 00000100:00100000:1.0:1746143113.002758:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7991 00000100:00100000:1.0:1746143113.002764:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30459:x1830962858265088:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143113.002777:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.002779:0:1037:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143113.002799:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70afde lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea03 expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.002813:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143113.002817:0:1037:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143113.002826:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647a00/0x25aee876ca70affa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea18 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.003133:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003147:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003155:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003166:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003172:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003542:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003549:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8646c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143113.003552:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003559:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003576:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143113.003579:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143113.003582:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003586:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646c00/0x25aee876ca70b001 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.003609:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647a00/0x25aee876ca70affa lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea18 expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.003617:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647a00/0x25aee876ca70affa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea18 expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.003624:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8647a00, rc 0) 00000100:00100000:1.0:1746143113.004099:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30459:x1830962858265088:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 1334us (1705us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143113.004106:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7991 00000100:00100000:0.0:1746143113.005177:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.005259:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143113.008793:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143113.008839:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.010401:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3347 00000100:00100000:0.0:1746143113.010411:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30459:x1830962858265856:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143113.015211:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30459:x1830962858265856:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 4791us (6360us total) trans 8589942191 rc 0/0 00000100:00100000:0.0:1746143113.015222:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3347 00000100:00100000:0.0:1746143113.016854:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.016922:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858266112 00000100:00100000:1.0:1746143113.016932:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858266112 00002000:00100000:1.0:1746143113.016975:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009f396680 x1830962858266112/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.016985:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f396680 with x1830962858266112 ext(4194304->5210111) 00002000:00010000:1.0:1746143113.016990:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f396680 00000100:00100000:1.0:1746143113.017020:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5522 00000100:00100000:1.0:1746143113.017027:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858266112:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143113.019705:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.039988:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858266112:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22945us (23123us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143113.040003:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5522 00002000:00100000:1.0:1746143113.040018:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009f396680 x1830962858266112/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/440 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.040028:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f396680 with x1830962858266112 ext(4194304->5210111) 00002000:00010000:1.0:1746143113.040050:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f396680 00000100:00100000:1.0:1746143113.041759:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.041803:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858266624 00000100:00100000:0.0:1746143113.041811:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858266624 00000100:00100000:0.0:1746143113.041905:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3348 00000100:00100000:0.0:1746143113.041912:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:30462:x1830962858266624:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:0.0:1746143113.042152:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30462:x1830962858266624:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 240us (400us total) trans 8589942192 rc 0/0 00000100:00100000:0.0:1746143113.042159:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3348 00000100:00100000:0.0:1746143113.059724:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.063204:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.063253:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858267008 00000100:00100000:0.0:1746143113.063261:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858267008 00000100:00100000:0.0:1746143113.064975:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7992 00000100:00100000:0.0:1746143113.064986:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:30465:x1830962858267008:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143113.065011:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143113.065042:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7d600/0x25aee876ca70b00f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea26 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.065139:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70b016 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143113.065154:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70b016 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143113.065166:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70b016 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143113.065177:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143113.065302:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7d600/0x25aee876ca70b00f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea26 expref: 219 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.065332:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70b016 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea26 expref: 218 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.065339:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143113.065341:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143113.065343:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b7da00, rc 0) 00000100:00100000:0.0:1746143113.065370:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+218:30465:x1830962858267008:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 387us (2174us total) trans 8589942193 rc 0/0 00000100:00100000:0.0:1746143113.065376:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7992 00000100:00100000:0.0:1746143113.067733:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.073762:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f575500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861105024:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143113.073807:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136034600/0x25aee876ca70b024 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea2d expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.073824:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136034600/0x25aee876ca70b024 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea2d expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.073836:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136034600, rc 0) 00000100:00100000:0.0:1746143113.073923:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858267136:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5835us (6194us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143113.073933:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11450 00000100:00100000:0.0:1746143113.137760:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.146218:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.153943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.156183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.156215:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858267520 00000100:00100000:0.0:1746143113.156222:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858267520 00010000:00010000:0.0:1746143113.156602:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb3200/0x25aee876ca70afb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e7 expref: 7 pid: 8169 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143113.156625:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6005 00000100:00100000:0.0:1746143113.156631:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858267520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143113.156638:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143113.156646:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132eb3200/0x25aee876ca70afb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e7 expref: 7 pid: 8169 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143113.156655:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132eb3200/0x25aee876ca70afb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e7 expref: 7 pid: 8169 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143113.156668:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132eb3200/0x25aee876ca70afb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9e7 expref: 7 pid: 8169 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143113.156681:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.156683:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.156690:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.156699:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.156731:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143113.156750:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861105536:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143113.162716:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.162951:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858267904 00000100:00100000:1.0:1746143113.162958:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858267904 00002000:00100000:1.0:1746143113.162999:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3960832->3964927) req@ffff88009fb54e00 x1830962858267904/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.163009:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb54e00 with x1830962858267904 ext(3960832->3964927) 00002000:00010000:1.0:1746143113.163014:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb54e00 00000100:00100000:1.0:1746143113.163064:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5524 00000100:00100000:1.0:1746143113.163072:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858267904:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143113.163242:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858267904:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 171us (548us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143113.163253:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5524 00002000:00100000:1.0:1746143113.163258:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3960832->3964927) req@ffff88009fb54e00 x1830962858267904/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/4536 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.163266:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb54e00 with x1830962858267904 ext(3960832->3964927) 00002000:00010000:1.0:1746143113.163269:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb54e00 00000100:00100000:0.0:1746143113.167761:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.169104:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.175309:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.179298:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858268672 00000100:00100000:0.0:1746143113.179304:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858268672 00010000:00010000:0.0:1746143113.179323:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70af52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9af expref: 25 pid: 4756 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143113.180246:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6008 00000100:00100000:0.0:1746143113.180255:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858268800:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143113.180267:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143113.180287:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70af4b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a8 expref: 12 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.180299:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70af4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a8 expref: 12 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.180318:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.180319:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.180527:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009358c400/0x25aee876ca70b032 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea3b expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.180535:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009358c400/0x25aee876ca70b032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea3b expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.180559:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009358c400/0x25aee876ca70b032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea3b expref: 23 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143113.180580:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861106176:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143113.180627:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143113.180658:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70af4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9a8 expref: 12 pid: 22204 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143113.180674:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f576300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861105920:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143113.180697:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009358c400/0x25aee876ca70b032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea3b expref: 23 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.180712:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009358c400, rc 0) 00000100:00100000:0.0:1746143113.180962:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30465:x1830962858268032:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 12743us (13207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.180968:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11452 00000100:00080000:1.0:1746143113.181403:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1746143113.190148:0:21048:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143111 -> 1746143112 00002000:00010000:0.0:1746143113.190153:0:21048:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143110 -> 1746143111 00002000:00010000:0.0:1746143113.190154:0:21048:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143111 -> 1746143112 00000100:00100000:0.0:1746143113.190172:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f574e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861106048:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143113.190213:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e2d600/0x25aee876ca70b04e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea49 expref: 15 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.190233:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e2d600/0x25aee876ca70b04e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea49 expref: 15 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.190244:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2d600, rc 0) 00000100:00100000:0.0:1746143113.190294:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858268544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12028us (12142us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143113.190302:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11453 00000100:00100000:0.0:1746143113.190325:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858268928 00000100:00100000:0.0:1746143113.190331:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858268928 00000100:00100000:0.0:1746143113.190358:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11454 00000100:00100000:0.0:1746143113.190364:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30471:x1830962858268928:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143113.190593:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143113.190605:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea50 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.190628:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e977 expref: 22 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.190636:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e12800/0x25aee876ca70af8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d9 expref: 6 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.190644:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba21400/0x25aee876ca70af2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e98c expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143113.190647:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861106176:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143113.190650:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.190652:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.190655:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1777664->2076671] (req 1777664->2076671) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.190669:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143113.190682:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba21400/0x25aee876ca70af2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e98c expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.190694:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ba21400/0x25aee876ca70af2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e98c expref: 13 pid: 4756 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143113.190706:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861106304:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143113.190712:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858268800:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10457us (11954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.190722:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6008 00010000:00010000:0.0:1746143113.190980:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e12800/0x25aee876ca70af8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d9 expref: 6 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.190989:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e12800/0x25aee876ca70af8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d9 expref: 6 pid: 8169 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746143113.190996:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861106432:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143113.191017:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e977 expref: 22 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.191024:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009acd1c00/0x25aee876ca70af1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e977 expref: 22 pid: 4756 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143113.191055:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861106560:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143113.191068:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143113.193209:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.196293:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.196487:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858269312 00000100:00100000:1.0:1746143113.196497:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858269312 00010000:00010000:1.0:1746143113.196536:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e12800/0x25aee876ca70af8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d9 expref: 7 pid: 8169 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.196589:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6009 00000100:00100000:1.0:1746143113.196597:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858269312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143113.196612:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143113.196636:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e12800/0x25aee876ca70af8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d9 expref: 7 pid: 8169 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.196648:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e12800/0x25aee876ca70af8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d9 expref: 7 pid: 8169 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.196675:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e12800/0x25aee876ca70af8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d9 expref: 7 pid: 8169 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.196693:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143113.196746:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858269312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 149us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.196753:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6009 00000100:00100000:0.0:1746143113.199005:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861106560:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143113.199062:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1777664->2076671] (req 1777664->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.199080:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8200, rc 0) 00000100:00100000:0.0:1746143113.199182:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30471:x1830962858268928:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8814us (9150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.199190:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11454 00000100:00100000:0.0:1746143113.202488:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.202537:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.202580:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858269568 00000100:00100000:1.0:1746143113.202592:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858269568 00000100:00100000:1.0:1746143113.202645:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11455 00000100:00100000:1.0:1746143113.202652:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30473:x1830962858269568:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143113.202671:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.202689:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea57 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.202716:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.202723:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1777664->2076671] (req 1777664->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.202729:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143113.202732:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.202771:0:21048:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [1777664->2076671] (req 1777664->2076671) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.202790:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.203015:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8646c00, rc 0) 00000100:00100000:1.0:1746143113.205882:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30473:x1830962858269568:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3219us (3390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.205893:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11455 00000100:00100000:0.0:1746143113.209172:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.215632:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861106816:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143113.215656:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143113.215704:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858269696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5912us (6538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.215715:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6011 00000100:00100000:0.0:1746143113.222179:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.235220:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.235321:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858270208 00000100:00100000:1.0:1746143113.235335:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858270208 00002000:00100000:1.0:1746143113.235387:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (2072576->2076671) req@ffff8800a5c46a00 x1830962858270208/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.235398:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c46a00 with x1830962858270208 ext(2072576->2076671) 00010000:00010000:1.0:1746143113.235407:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2076671) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 12 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.235423:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2076671) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 12 pid: 21048 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143113.235619:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c46a00 00000100:00100000:1.0:1746143113.235656:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1835 00000100:00100000:1.0:1746143113.235664:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858270208:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143113.235860:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858270208:12345-192.168.201.28@tcp:3:cat.0 Request processed in 195us (650us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143113.235866:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1835 00002000:00100000:1.0:1746143113.235872:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (2072576->2076671) req@ffff8800a5c46a00 x1830962858270208/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/4536 e 0 to 0 dl 1746143124 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.235879:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c46a00 with x1830962858270208 ext(2072576->2076671) 00010000:00010000:1.0:1746143113.235884:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2076671) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 12 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.235893:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2076671) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 12 pid: 21048 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143113.235899:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c46a00 00000100:00100000:0.0:1746143113.240464:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.265605:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.265692:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858270592 00000100:00100000:0.0:1746143113.265702:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858270592 00010000:00010000:0.0:1746143113.265743:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2076671) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 14 pid: 21048 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143113.265786:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6012 00000100:00100000:0.0:1746143113.265795:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858270592:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143113.265810:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143113.265828:0:16965:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143111 -> 1746143112 00002000:00010000:0.0:1746143113.265831:0:16965:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143111 -> 1746143112 00010000:00010000:0.0:1746143113.265837:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2076671) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 14 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.265849:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2076671) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 14 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.265872:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8200/0x25aee876ca70b055 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2076671) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea50 expref: 14 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.265892:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.265894:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.265901:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.265909:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.265940:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143113.265951:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861106944:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143113.266058:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143113.279490:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.281115:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.281385:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858271104 00000100:00100000:1.0:1746143113.281392:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858271104 00002000:00100000:1.0:1746143113.281424:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a5c46680 x1830962858271104/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.281432:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c46680 with x1830962858271104 ext(1048576->2097151) 00002000:00010000:1.0:1746143113.281440:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c46680 00000100:00100000:1.0:1746143113.281466:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5527 00000100:00100000:1.0:1746143113.281472:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858271104:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143113.299311:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858271104:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17831us (18191us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143113.299322:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5527 00002000:00100000:1.0:1746143113.299332:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a5c46680 x1830962858271104/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/440 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.299340:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c46680 with x1830962858271104 ext(1048576->2097151) 00002000:00010000:1.0:1746143113.299346:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c46680 00000100:00100000:0.0:1746143113.315742:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.315955:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.315987:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.316015:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858271360 00000100:00100000:1.0:1746143113.316016:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858271232 00000100:00100000:0.0:1746143113.316024:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858271360 00000100:00100000:1.0:1746143113.316028:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858271232 00000100:00100000:0.0:1746143113.316091:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858271616 00000100:00100000:0.0:1746143113.316094:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858271616 00000100:00100000:0.0:1746143113.316122:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11456 00000100:00100000:0.0:1746143113.316129:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858271360:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143113.316133:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11457 00010000:00010000:0.0:1746143113.316149:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143113.316153:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858271232:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143113.316169:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143113.316169:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136035400/0x25aee876ca70b063 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea65 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.316183:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea5e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.316204:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.316206:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.316213:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143113.316219:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bae8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861107200:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143113.316227:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.316237:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093cede00, rc 0) 00000100:00100000:1.0:1746143113.316281:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858271232:12345-192.168.201.28@tcp:101:cat.0 Request processed in 130us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.316287:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11457 00000100:00100000:0.0:1746143113.316313:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143113.316343:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858271488 00000100:00100000:1.0:1746143113.316347:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858271488 00000100:00100000:1.0:1746143113.316367:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11459 00000100:00100000:1.0:1746143113.316372:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858271488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143113.316380:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.316389:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ceda00/0x25aee876ca70b078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea6c expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143113.316425:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861107328:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143113.316487:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143113.320965:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861107328:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143113.320983:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ceda00/0x25aee876ca70b078 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea6c expref: 15 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.320992:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ceda00/0x25aee876ca70b078 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea6c expref: 15 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.321016:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ceda00, rc 0) 00000100:00100000:1.0:1746143113.321065:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858271488:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4691us (4743us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143113.321071:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11459 00000100:00100000:0.0:1746143113.324125:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.324209:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858271744 00000100:00100000:1.0:1746143113.324217:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858271744 00000100:00100000:1.0:1746143113.324270:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11460 00000100:00100000:1.0:1746143113.324278:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30473:x1830962858271744:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143113.324299:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.324314:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093cece00/0x25aee876ca70b07f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea7a expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.324337:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.324349:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143113.324351:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143113.324354:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093cece00/0x25aee876ca70b07f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea7a expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.324379:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.324391:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 18 pid: 22204 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.324403:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861107456:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143113.324480:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143113.328988:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.329015:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.329079:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858272128 00000100:00100000:1.0:1746143113.329088:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858272128 00000100:00100000:0.0:1746143113.329089:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:1.0:1746143113.329134:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88012baeb480 x1830962858272128/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.329144:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeb480 with x1830962858272128 ext(0->1048575) 00002000:00010000:1.0:1746143113.329149:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baeb480 00000100:00100000:1.0:1746143113.329166:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858272256 00000100:00100000:1.0:1746143113.329169:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858272256 00002000:00100000:1.0:1746143113.329182:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012baeb800 x1830962858272256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.329189:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeb800 with x1830962858272256 ext(1048576->2097151) 00002000:00010000:1.0:1746143113.329192:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baeb800 00000100:00100000:1.0:1746143113.329202:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858272384 00000100:00100000:1.0:1746143113.329204:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858272384 00002000:00100000:1.0:1746143113.329213:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3960832->4194303) req@ffff88012baea300 x1830962858272384/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.329219:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baea300 with x1830962858272384 ext(3960832->4194303) 00010000:00010000:1.0:1746143113.329227:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 20 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.329239:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 20 pid: 22204 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143113.329245:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012baea300 00000100:00100000:1.0:1746143113.329257:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1837 00000100:00100000:1.0:1746143113.329263:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858272384:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143113.329712:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861107456:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.329733:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093cece00/0x25aee876ca70b07f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea7a expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.329745:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093cece00, rc 0) 00000100:00100000:1.0:1746143113.329765:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30473:x1830962858271744:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5487us (5646us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.329771:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11460 00000100:00100000:0.0:1746143113.329829:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5528 00000100:00100000:0.0:1746143113.329838:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858272128:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143113.340845:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858272384:12345-192.168.201.28@tcp:4:cat.0 Request processed in 11571us (11744us total) trans 21474839886 rc 0/0 00000100:00100000:1.0:1746143113.340854:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1837 00002000:00100000:1.0:1746143113.340863:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3960832->4194303) req@ffff88012baea300 x1830962858272384/t21474839886(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/448 e 0 to 0 dl 1746143124 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.340870:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baea300 with x1830962858272384 ext(3960832->4194303) 00010000:00010000:1.0:1746143113.340877:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 23 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.340889:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093fcfc00/0x25aee876ca70b02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea34 expref: 23 pid: 22204 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143113.340894:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012baea300 00000100:00100000:1.0:1746143113.348343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.350236:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.374807:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.374928:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.375201:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858273152 00000100:00100000:0.0:1746143113.375208:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858273152 00000100:00100000:0.0:1746143113.375244:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3349 00000100:00100000:0.0:1746143113.375251:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:7717:x1830962858273152:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143113.375731:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:7717:x1830962858273152:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 480us (803us total) trans 8589942195 rc 0/0 00000100:00100000:0.0:1746143113.375738:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3349 00000100:00100000:0.0:1746143113.381129:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.394833:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.402680:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.402712:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.402730:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.402775:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858273664 00000100:00100000:0.0:1746143113.402780:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858273664 00002000:00100000:0.0:1746143113.402809:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1126400->1323007) req@ffff880136be8e00 x1830962858273664/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143113.402818:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be8e00 with x1830962858273664 ext(1126400->1323007) 00010000:00010000:0.0:1746143113.402824:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5376a00/0x25aee876ca70afd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9fc expref: 17 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.402835:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5376a00/0x25aee876ca70afd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9fc expref: 17 pid: 22204 timeout: 995 lvb_type: 0 00002000:00010000:0.0:1746143113.402841:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136be8e00 00000100:00100000:0.0:1746143113.402854:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1838 00000100:00100000:1.0:1746143113.402929:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11463 00000100:00100000:1.0:1746143113.402937:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858273920:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143113.402945:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.402954:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093d21a00/0x25aee876ca70b0b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ea96 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143113.402990:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861108096:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143113.403050:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143113.403171:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858273664:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143113.403425:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.403452:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.410963:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.413346:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.413406:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858274688 00000100:00100000:1.0:1746143113.413411:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858274688 00000100:00100000:1.0:1746143113.413435:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 7996 00000100:00100000:1.0:1746143113.413441:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:30481:x1830962858274688:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143113.413451:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.413460:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d21e00/0x25aee876ca70b0d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eab2 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.413729:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.413740:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.413747:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143113.415417:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.417003:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143113.417465:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.417474:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:1.0:1746143113.417493:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143113.417609:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d21e00/0x25aee876ca70b0d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab2 expref: 17 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.417625:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab2 expref: 16 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.417632:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143113.417634:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143113.417637:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d20000, rc 0) 00000100:00100000:0.0:1746143113.417637:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.417649:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858275072 00000100:00100000:0.0:1746143113.417652:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858275072 00000100:00100000:1.0:1746143113.417662:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:30481:x1830962858274688:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4221us (4317us total) trans 8589942196 rc 0/0 00010000:00010000:0.0:1746143113.417667:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5376a00/0x25aee876ca70afd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9fc expref: 17 pid: 22204 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.417669:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7996 00000100:00100000:0.0:1746143113.417682:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6017 00000100:00100000:0.0:1746143113.417687:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858275072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143113.417694:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143113.417707:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5376a00/0x25aee876ca70afd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9fc expref: 17 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.417715:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5376a00/0x25aee876ca70afd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1323007) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9fc expref: 17 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.417728:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5376a00/0x25aee876ca70afd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1323007) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9fc expref: 17 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.418190:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.418192:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.418199:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.418207:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.418470:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143113.418486:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861108608:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143113.418529:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143113.420097:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.420896:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861108608:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143113.420909:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143113.420925:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858275072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3237us (3290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.420934:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6017 00000100:00100000:1.0:1746143113.429207:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.429704:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.429778:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.430870:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858275456 00000100:00100000:0.0:1746143113.430874:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858275456 00010000:00010000:0.0:1746143113.430892:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab2 expref: 18 pid: 1037 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143113.430918:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858275584 00000100:00100000:0.0:1746143113.430921:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858275584 00010000:00010000:0.0:1746143113.430932:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b0cc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaab expref: 28 pid: 14796 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143113.430947:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6018 00000100:00100000:0.0:1746143113.430953:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:1970:x1830962858275456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143113.430962:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143113.430967:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab2 expref: 18 pid: 1037 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.430977:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab2 expref: 18 pid: 1037 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.430996:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d20000/0x25aee876ca70b0da lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab2 expref: 18 pid: 1037 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.431014:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143113.431018:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143113.431027:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143113.431047:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143113.431053:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143113.431087:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:1970:x1830962858275456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 133us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.431094:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6018 00000100:00100000:0.0:1746143113.431108:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6019 00000100:00100000:0.0:1746143113.431113:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858275584:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143113.431119:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143113.431123:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b0cc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaab expref: 28 pid: 14796 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.431131:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b0cc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaab expref: 28 pid: 14796 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.431143:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b0cc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaab expref: 28 pid: 14796 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143113.431157:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143113.431160:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143113.431168:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143113.431174:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143113.431191:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143113.431205:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858275584:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 91us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.431210:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6019 00000100:00100000:1.0:1746143113.445121:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.445178:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.445205:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858275968 00000100:00100000:0.0:1746143113.445214:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858275968 00000100:00100000:0.0:1746143113.445249:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11467 00000100:00100000:0.0:1746143113.445257:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858275968:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143113.445272:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143113.445287:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eac7 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.445306:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.445309:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.445317:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.445506:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.445516:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8647000, rc 0) 00000100:00100000:0.0:1746143113.445552:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858275968:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 296us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.445573:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11467 00000100:00100000:0.0:1746143113.458089:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143113.477267:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143113.482728:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.483251:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.506000:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.511849:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858277632 00000100:00100000:0.0:1746143113.511863:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858277632 00000100:00100000:0.0:1746143113.511917:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3350 00000100:00100000:0.0:1746143113.511925:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:30481:x1830962858277632:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:0.0:1746143113.512172:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:30481:x1830962858277632:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 247us (4352us total) trans 8589942198 rc 0/0 00000100:00100000:0.0:1746143113.512179:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3350 00000100:00100000:0.0:1746143113.525250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.525298:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.565120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.565193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.565246:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.565300:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.565368:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858278016 00000100:00100000:0.0:1746143113.565381:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858278016 00002000:00100000:0.0:1746143113.565646:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880090f23800 x1830962858278016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143113.565665:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23800 with x1830962858278016 ext(2097152->3145727) 00002000:00010000:0.0:1746143113.565672:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f23800 00000100:00100000:0.0:1746143113.565697:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858278272 00000100:00100000:0.0:1746143113.565702:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858278272 00002000:00100000:0.0:1746143113.565722:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880090f21180 x1830962858278272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143113.565729:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21180 with x1830962858278272 ext(3145728->4194303) 00002000:00010000:0.0:1746143113.565732:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21180 00000100:00100000:0.0:1746143113.565747:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858278528 00000100:00100000:0.0:1746143113.565750:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858278528 00002000:00100000:0.0:1746143113.565766:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880090f21880 x1830962858278528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143113.565773:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21880 with x1830962858278528 ext(2097152->3145727) 00002000:00010000:0.0:1746143113.565777:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f21880 00000100:00100000:0.0:1746143113.565807:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5535 00000100:00100000:0.0:1746143113.565818:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858278016:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143113.565975:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5537 00000100:00100000:1.0:1746143113.565985:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858278528:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143113.606540:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858278912 00000100:00100000:1.0:1746143113.606550:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858278912 00000100:00100000:1.0:1746143113.606620:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11471 00000100:00100000:1.0:1746143113.606628:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858278912:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143113.606649:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.606669:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eaea expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.606695:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.606697:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.606708:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 17 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.606727:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 17 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.606738:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2735c00, rc 0) 00000100:00100000:1.0:1746143113.606796:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858278912:12345-192.168.201.28@tcp:101:cat.0 Request processed in 168us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.606803:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11471 00000100:00100000:1.0:1746143113.607318:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858279040 00000100:00100000:1.0:1746143113.607322:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858279040 00000100:00100000:1.0:1746143113.607342:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11472 00000100:00100000:1.0:1746143113.607348:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30480:x1830962858279040:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143113.607357:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.607368:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca70b135 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eaf1 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.607387:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130adf600/0x25aee876ca70ad4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e874 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.607395:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 6 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.607402:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ce8a00/0x25aee876ca70ad84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e889 expref: 30 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.607408:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.607410:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.607413:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca70b135 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1613824->2097151] (req 1613824->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf1 expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.607441:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ce8a00/0x25aee876ca70ad84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e889 expref: 30 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.607460:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ce8a00/0x25aee876ca70ad84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e889 expref: 30 pid: 8169 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.607471:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109248:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.607570:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 6 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.607580:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 6 pid: 26949 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.607594:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109376:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.607623:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130adf600/0x25aee876ca70ad4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e874 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.607631:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130adf600/0x25aee876ca70ad4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e874 expref: 13 pid: 10061 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.607638:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109504:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143113.607652:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143113.618216:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858278272:12345-192.168.201.28@tcp:3:cat.0 Request processed in 52362us (53011us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143113.619944:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5536 00002000:00100000:1.0:1746143113.619966:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880090f21180 x1830962858278272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/440 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.619978:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21180 with x1830962858278272 ext(3145728->4194303) 00002000:00010000:1.0:1746143113.619985:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21180 00000100:00100000:0.0:1746143113.630922:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.630965:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.630991:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858279424 00000100:00100000:0.0:1746143113.630999:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858279424 00010000:00010000:0.0:1746143113.631055:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 7 pid: 26949 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746143113.631083:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858279168 00000100:00100000:0.0:1746143113.631085:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858279168 00010000:00010000:0.0:1746143113.631098:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ce8a00/0x25aee876ca70ad84 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e889 expref: 31 pid: 8169 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746143113.631130:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6021 00000100:00100000:0.0:1746143113.631137:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858279424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143113.631150:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143113.631174:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 7 pid: 26949 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746143113.631185:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 7 pid: 26949 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746143113.631212:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143113.632242:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ce8a00/0x25aee876ca70ad84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e889 expref: 30 pid: 8169 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.632261:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109248:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.632272:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090494e00/0x25aee876ca70adfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e8c1 expref: 7 pid: 26949 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.632281:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109376:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143113.632291:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109504:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.632537:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca70b135 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1613824->2097151] (req 1613824->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf1 expref: 29 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.632549:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2734a00, rc 0) 00000100:00100000:1.0:1746143113.634498:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30480:x1830962858279040:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 27147us (27274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.634506:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11472 00000100:00100000:0.0:1746143113.635104:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858279424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3964us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.635111:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6021 00000100:00100000:0.0:1746143113.636911:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.639199:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858279808 00000100:00100000:1.0:1746143113.639207:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858279808 00000100:00100000:1.0:1746143113.639250:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11473 00000100:00100000:1.0:1746143113.639256:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30483:x1830962858279808:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143113.639271:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.639294:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eaf8 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.640844:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135e9b400/0x25aee876ca70b0e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab9 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.640854:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 26 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.640860:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.640862:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.640866:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3706880->4194303] (req 3706880->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.640896:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 26 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.640907:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 26 pid: 8449 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.640920:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109760:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.640991:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135e9b400/0x25aee876ca70b0e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab9 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.640999:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135e9b400/0x25aee876ca70b0e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eab9 expref: 14 pid: 4756 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.641008:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109888:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143113.641026:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143113.645195:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.648155:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858278528:12345-192.168.201.28@tcp:3:cat.0 Request processed in 82165us (82904us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143113.648166:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5537 00002000:00100000:1.0:1746143113.648175:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880090f21880 x1830962858278528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/440 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.648184:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21880 with x1830962858278528 ext(2097152->3145727) 00010000:00010000:1.0:1746143113.648193:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 25 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.648207:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 25 pid: 8449 timeout: 995 lvb_type: 1 00002000:00010000:1.0:1746143113.648214:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090f21880 00000100:00100000:1.0:1746143113.652779:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109760:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143113.653670:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861109888:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.653704:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3706880->4194303] (req 3706880->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.653723:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f391800, rc 0) 00000100:00100000:1.0:1746143113.654013:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30483:x1830962858279808:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14755us (17103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.654021:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11473 00000100:00100000:0.0:1746143113.656079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.656145:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858280192 00000100:00100000:1.0:1746143113.656152:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858280192 00000100:00100000:1.0:1746143113.656197:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11474 00000100:00100000:1.0:1746143113.656203:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30480:x1830962858280192:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143113.656220:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.656239:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b2735200/0x25aee876ca70b143 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eaff expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.656267:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.656277:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135c9b800/0x25aee876ca70b0a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea8f expref: 5 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.656283:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 26 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.656288:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.656290:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.656293:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b2735200/0x25aee876ca70b143 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->1499135] (req 1048576->1499135) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaff expref: 26 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.656320:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 26 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.656331:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 26 pid: 8449 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.656342:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861110016:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.657543:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135c9b800/0x25aee876ca70b0a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea8f expref: 5 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.657563:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135c9b800/0x25aee876ca70b0a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea8f expref: 5 pid: 10061 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.657573:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861110144:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143113.657602:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.657611:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.657625:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861110272:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143113.657644:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143113.658271:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.663634:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.663677:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.663703:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.663749:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.663772:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858280832 00000100:00100000:1.0:1746143113.663781:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858280832 00010000:00010000:1.0:1746143113.663818:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 27 pid: 8449 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.663846:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6025 00000100:00100000:1.0:1746143113.663853:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858280832:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143113.664092:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143113.664119:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 27 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.664131:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 27 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.664153:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70b127 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eae3 expref: 27 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.664172:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.664174:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.664181:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.664189:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.664220:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143113.664231:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861110400:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143113.664310:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143113.664411:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.664427:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858281088 00000100:00100000:1.0:1746143113.664429:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858281088 00010000:00010000:1.0:1746143113.664442:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 27 pid: 8449 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.664459:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6026 00000100:00100000:1.0:1746143113.664465:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858281088:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143113.664471:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143113.664482:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 27 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.664490:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 27 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.664502:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143113.664524:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858281088:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.664531:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6026 00000100:00100000:1.0:1746143113.664578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.664589:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858281216 00000100:00100000:1.0:1746143113.664592:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858281216 00010000:00010000:1.0:1746143113.664602:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.664619:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6027 00000100:00100000:1.0:1746143113.664623:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858281216:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143113.664629:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143113.664636:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.664649:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 13 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.664660:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143113.664674:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858281216:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.664680:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6027 00000100:00100000:1.0:1746143113.664728:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.664740:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858280960 00000100:00100000:1.0:1746143113.664743:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858280960 00010000:00010000:1.0:1746143113.664754:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135c9b800/0x25aee876ca70b0a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea8f expref: 6 pid: 10061 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143113.664770:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6028 00000100:00100000:1.0:1746143113.664775:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858280960:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143113.664781:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143113.664788:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135c9b800/0x25aee876ca70b0a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea8f expref: 6 pid: 10061 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.664797:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135c9b800/0x25aee876ca70b0a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea8f expref: 6 pid: 10061 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143113.664808:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.664809:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.664813:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b2735200/0x25aee876ca70b143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaff expref: 26 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.664824:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b2735200/0x25aee876ca70b143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaff expref: 26 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.664844:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b2735200/0x25aee876ca70b143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaff expref: 26 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143113.664852:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861110528:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143113.664873:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97840 going to sleep for 11 seconds 00010000:00010000:0.0:1746143113.665748:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093cede00/0x25aee876ca70b071 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea5e expref: 28 pid: 8449 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746143113.665769:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861110016:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143113.665778:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135c9b800/0x25aee876ca70b0a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea8f expref: 6 pid: 10061 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746143113.665791:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861110144:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143113.665799:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8646c00/0x25aee876ca70b05c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea57 expref: 16 pid: 21048 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143113.665806:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861110272:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143113.665993:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b2735200/0x25aee876ca70b143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaff expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.666002:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2735200, rc 0) 00000100:00100000:0.0:1746143113.666021:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:30480:x1830962858280192:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9819us (10022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.666027:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11474 00000100:00100000:0.0:1746143113.668198:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.674233:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.675494:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.675527:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.682239:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.682277:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.682357:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.684475:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.687864:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.689723:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.690658:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.690683:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.690707:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.690731:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858283392 00000100:00100000:0.0:1746143113.690737:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858283392 00010000:00010000:0.0:1746143113.690934:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a518be00/0x25aee876ca70b120 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eadc expref: 22 pid: 8449 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746143113.690959:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6031 00000100:00100000:0.0:1746143113.690964:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858283392:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143113.690976:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143113.690998:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a518be00/0x25aee876ca70b120 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eadc expref: 22 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746143113.691008:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a518be00/0x25aee876ca70b120 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eadc expref: 22 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746143113.691045:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a518be00/0x25aee876ca70b120 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eadc expref: 22 pid: 8449 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746143113.691064:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.691066:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.691074:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.691081:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.691109:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143113.691115:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11481 00000100:00100000:0.0:1746143113.691120:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861111552:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143113.691122:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858282880:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143113.691134:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.691146:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cad200/0x25aee876ca70b174 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eb29 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143113.691167:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143113.691175:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861111680:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143113.691200:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143113.694059:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861111680:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143113.694077:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cad200/0x25aee876ca70b174 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb29 expref: 17 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.694090:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cad200/0x25aee876ca70b174 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb29 expref: 17 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143113.694499:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cad200, rc 0) 00000100:00100000:1.0:1746143113.694533:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858282880:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3412us (4811us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143113.694539:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11481 00000100:00100000:1.0:1746143113.694575:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861111552:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143113.694587:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143113.694605:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858283392:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3640us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.694612:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6031 00000100:00100000:0.0:1746143113.696573:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.696643:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858283648 00000100:00100000:1.0:1746143113.696650:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858283648 00002000:00100000:1.0:1746143113.696684:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4534272->4538367) req@ffff880092aee680 x1830962858283648/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.696694:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aee680 with x1830962858283648 ext(4534272->4538367) 00002000:00010000:1.0:1746143113.696699:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aee680 00000100:00100000:1.0:1746143113.696715:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5542 00000100:00100000:1.0:1746143113.696720:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858283648:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143113.696859:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858283648:12345-192.168.201.28@tcp:3:cat.0 Request processed in 138us (306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143113.696865:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5542 00002000:00100000:1.0:1746143113.696870:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4534272->4538367) req@ffff880092aee680 x1830962858283648/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/4536 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.696876:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aee680 with x1830962858283648 ext(4534272->4538367) 00002000:00010000:1.0:1746143113.696878:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aee680 00000100:00100000:0.0:1746143113.703479:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.705101:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858284288 00000100:00100000:1.0:1746143113.705105:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858284288 00000100:00100000:0.0:1746143113.705119:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858284160 00000100:00100000:0.0:1746143113.705124:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858284160 00010000:00010000:1.0:1746143113.705127:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 14 pid: 21048 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.705144:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6032 00000100:00100000:1.0:1746143113.705148:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858284288:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143113.705156:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143113.705161:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3352 00000100:00100000:0.0:1746143113.705167:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5213c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:30483:x1830962858284160:12345-192.168.201.28@tcp:35:multiop.0 00010000:00010000:1.0:1746143113.705171:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 14 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.705180:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 14 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.705198:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f391800/0x25aee876ca70b13c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf8 expref: 14 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.705211:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.705213:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.705220:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a315a00/0x25aee876ca70b158 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb14 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.705226:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a315a00/0x25aee876ca70b158 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb14 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.705254:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a315a00/0x25aee876ca70b158 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb14 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143113.705263:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861111936:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143113.705313:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143113.705333:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5213c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:30483:x1830962858284160:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 165us (359us total) trans 8589942200 rc 0/0 00000100:00100000:0.0:1746143113.705339:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3352 00000100:00100000:1.0:1746143113.717428:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861111936:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143113.717454:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143113.717516:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858284288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 12365us (12488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.717527:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6032 00000100:00100000:0.0:1746143113.717780:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.717820:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858284672 00000100:00100000:1.0:1746143113.717827:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858284672 00002000:00100000:1.0:1746143113.717864:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092aed500 x1830962858284672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.717874:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aed500 with x1830962858284672 ext(3145728->4194303) 00002000:00010000:1.0:1746143113.717880:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092aed500 00000100:00100000:1.0:1746143113.717895:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5544 00000100:00100000:1.0:1746143113.717912:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858284672:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143113.725179:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858284672:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 7269us (7391us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143113.725190:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5544 00002000:00100000:1.0:1746143113.725200:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092aed500 x1830962858284672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/440 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.725212:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aed500 with x1830962858284672 ext(3145728->4194303) 00002000:00010000:1.0:1746143113.725217:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092aed500 00000100:00100000:0.0:1746143113.732374:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.736177:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.739845:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.740907:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858285056 00000100:00100000:1.0:1746143113.740915:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858285056 00002000:00100000:1.0:1746143113.740956:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4538367) req@ffff8800a5cc8700 x1830962858285056/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.740965:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc8700 with x1830962858285056 ext(4194304->4538367) 00010000:00010000:1.0:1746143113.740972:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 18 pid: 4756 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.740983:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 18 pid: 4756 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143113.741001:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5cc8700 00000100:00100000:1.0:1746143113.741023:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1842 00000100:00100000:1.0:1746143113.741044:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858285056:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143113.748207:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858285056:12345-192.168.201.28@tcp:4:cat.0 Request processed in 7166us (8363us total) trans 21474839888 rc 0/0 00000100:00100000:1.0:1746143113.748221:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1842 00002000:00100000:1.0:1746143113.748234:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4538367) req@ffff8800a5cc8700 x1830962858285056/t21474839888(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/448 e 0 to 0 dl 1746143124 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.748244:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc8700 with x1830962858285056 ext(4194304->4538367) 00010000:00010000:1.0:1746143113.748255:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 20 pid: 4756 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.748277:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 20 pid: 4756 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143113.748285:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5cc8700 00000100:00100000:0.0:1746143113.750230:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.750692:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858285184 00000100:00100000:1.0:1746143113.750702:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858285184 00010000:00010000:1.0:1746143113.750739:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 20 pid: 4756 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.751028:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6033 00000100:00100000:1.0:1746143113.751099:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858285184:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143113.751114:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143113.751133:0:7111:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143111 -> 1746143112 00010000:00010000:1.0:1746143113.751138:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 20 pid: 4756 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.751149:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 20 pid: 4756 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.751171:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70b15f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->4538367] (req 4194304->4538367) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb1b expref: 20 pid: 4756 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.752195:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.752198:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143113.752208:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093cece00/0x25aee876ca70b190 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb4c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.752222:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093cece00/0x25aee876ca70b190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb4c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.752261:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093cece00/0x25aee876ca70b190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb4c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143113.752274:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861112192:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143113.752869:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143113.757900:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861112192:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143113.757921:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143113.757981:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858285184:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6881us (7756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.757993:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6033 00000100:00100000:1.0:1746143113.758055:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858285440 00000100:00100000:1.0:1746143113.758062:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858285440 00002000:00100000:1.0:1746143113.758098:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009fb57b80 x1830962858285440/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.758109:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb57b80 with x1830962858285440 ext(4194304->5210111) 00002000:00010000:1.0:1746143113.758113:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb57b80 00000100:00100000:1.0:1746143113.758136:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5545 00000100:00100000:1.0:1746143113.758143:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858285440:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143113.774330:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858285440:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16174us (16957us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143113.774347:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5545 00002000:00100000:1.0:1746143113.774360:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009fb57b80 x1830962858285440/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/440 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.774567:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb57b80 with x1830962858285440 ext(4194304->5210111) 00002000:00010000:1.0:1746143113.774573:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb57b80 00000100:00100000:0.0:1746143113.849016:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.850415:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.850715:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858285696 00000100:00100000:1.0:1746143113.850725:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858285696 00000100:00100000:1.0:1746143113.852367:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858285952 00000100:00100000:1.0:1746143113.852371:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858285952 00000100:00100000:1.0:1746143113.852889:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8000 00000100:00100000:1.0:1746143113.852897:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:30494:x1830962858285952:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143113.852910:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143113.852918:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffac00/0x25aee876ca70b1a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eb5a expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.852959:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.852966:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.852973:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143113.867204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.867258:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.867275:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.867289:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.867382:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11487 00000100:00100000:0.0:1746143113.867394:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858286336:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143113.867411:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143113.867427:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdd3c00/0x25aee876ca70b1b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eb6f expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.867640:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.867643:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.867650:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdd3c00/0x25aee876ca70b1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb6f expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.867665:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fdd3c00/0x25aee876ca70b1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb6f expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.867675:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdd3c00, rc 0) 00000100:00100000:0.0:1746143113.867717:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858286336:12345-192.168.201.28@tcp:101:cat.0 Request processed in 326us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.867724:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11487 00000100:00100000:0.0:1746143113.867745:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11489 00000100:00100000:0.0:1746143113.867751:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858286464:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143113.867958:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143113.867968:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdd2200/0x25aee876ca70b1c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eb76 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143113.867981:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.867983:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143113.867987:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdd2200/0x25aee876ca70b1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb76 expref: 17 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.867996:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdd2200/0x25aee876ca70b1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb76 expref: 17 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.868001:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdd2200, rc 0) 00000100:00100000:0.0:1746143113.868016:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858286464:12345-192.168.201.28@tcp:101:cat.0 Request processed in 267us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143113.868022:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11489 00000100:00100000:0.0:1746143113.871686:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.871766:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858286592 00000100:00100000:1.0:1746143113.871773:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858286592 00010000:00010000:1.0:1746143113.871806:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac0 expref: 17 pid: 14796 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143113.871835:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6034 00000100:00100000:1.0:1746143113.871841:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:1969:x1830962858286592:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143113.871854:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143113.871859:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac0 expref: 17 pid: 14796 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.871870:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac0 expref: 17 pid: 14796 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.871891:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9aa00/0x25aee876ca70b0fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac0 expref: 17 pid: 14796 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.873913:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143113.873922:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143113.873935:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143113.873943:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143113.873954:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.873959:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143113.873965:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143113.875103:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861112576:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143113.875130:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f12200/0x25aee876ca70b1c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb61 expref: 17 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.875142:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f12200/0x25aee876ca70b1c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb61 expref: 17 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143113.875154:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f12200, rc 0) 00000100:00100000:0.0:1746143113.875182:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858286080:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7809us (7990us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143113.875190:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11486 00010000:00010000:1.0:1746143113.875657:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143113.875690:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:1969:x1830962858286592:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3847us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143113.875700:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6034 00010000:00010000:1.0:1746143113.875735:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143113.875743:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143113.875757:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143113.875842:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 221 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.875855:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 220 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143113.875862:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143113.875865:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143113.875867:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c9b800, rc 0) 00000100:00100000:1.0:1746143113.876058:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+220:30491:x1830962858285696:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 23581us (27055us total) trans 8589942202 rc 0/0 00000100:00100000:1.0:1746143113.876065:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 7999 00000100:00100000:0.0:1746143113.887307:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.900249:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.900350:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858286848 00000100:00100000:1.0:1746143113.900359:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858286848 00002000:00100000:1.0:1746143113.900402:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1613824->2097151) req@ffff8800a5840380 x1830962858286848/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.900412:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840380 with x1830962858286848 ext(1613824->2097151) 00010000:00010000:1.0:1746143113.900422:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca70b135 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf1 expref: 25 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.900435:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca70b135 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf1 expref: 25 pid: 21048 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143113.900442:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5840380 00000100:00100000:1.0:1746143113.900523:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1843 00000100:00100000:1.0:1746143113.900531:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858286848:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143113.942266:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858286848:12345-192.168.201.28@tcp:4:cat.0 Request processed in 41720us (42012us total) trans 17179872639 rc 0/0 00000100:00100000:1.0:1746143113.942281:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1843 00002000:00100000:1.0:1746143113.942295:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1613824->2097151) req@ffff8800a5840380 x1830962858286848/t17179872639(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:264/0 lens 488/448 e 0 to 0 dl 1746143124 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.942305:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840380 with x1830962858286848 ext(1613824->2097151) 00010000:00010000:1.0:1746143113.942317:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca70b135 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf1 expref: 27 pid: 21048 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143113.942336:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b2734a00/0x25aee876ca70b135 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaf1 expref: 27 pid: 21048 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143113.942343:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5840380 00000100:00100000:0.0:1746143113.947314:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.958785:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.970367:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143113.970522:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858287360 00000100:00100000:1.0:1746143113.970531:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858287360 00002000:00100000:1.0:1746143113.970582:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008f576a00 x1830962858287360/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/0 e 0 to 0 dl 1746143124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143113.970597:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576a00 with x1830962858287360 ext(1048576->2097151) 00002000:00010000:1.0:1746143113.970602:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f576a00 00000100:00100000:1.0:1746143113.970676:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5546 00000100:00100000:1.0:1746143113.970684:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858287360:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143113.983534:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143113.986108:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858287360:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15420us (15744us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143113.986118:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5546 00002000:00100000:0.0:1746143113.986130:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008f576a00 x1830962858287360/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:264/0 lens 488/440 e 0 to 0 dl 1746143124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143113.986140:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576a00 with x1830962858287360 ext(1048576->2097151) 00002000:00010000:0.0:1746143113.986146:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f576a00 00000100:00100000:0.0:1746143114.004764:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.017098:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.017170:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.022969:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5547 00000100:00100000:1.0:1746143114.022995:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858287872:12345-192.168.201.28@tcp:3:cat.0 00000100:00080000:0.0:1746143114.025057:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143114.025114:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.056868:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858287872:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33872us (39774us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143114.056881:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5547 00002000:00100000:0.0:1746143114.056894:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008f574700 x1830962858287872/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.056904:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574700 with x1830962858287872 ext(1048576->2097151) 00002000:00010000:0.0:1746143114.056911:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f574700 00000100:00100000:0.0:1746143114.064365:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.066654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.081852:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.083800:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.102075:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.102107:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.102126:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.102152:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.102175:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858289280 00000100:00100000:1.0:1746143114.102183:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858289280 00010000:00010000:1.0:1746143114.102219:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd1400/0x25aee876ca70af13 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e970 expref: 22 pid: 22204 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143114.102247:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858289152 00000100:00100000:1.0:1746143114.102249:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858289152 00010000:00010000:1.0:1746143114.102268:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb3c00/0x25aee876ca70afbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d2 expref: 7 pid: 8169 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143114.102283:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858289408 00000100:00100000:1.0:1746143114.102285:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858289408 00010000:00010000:1.0:1746143114.102295:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb3000/0x25aee876ca70afec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea0a expref: 22 pid: 21048 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746143114.102310:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6036 00000100:00100000:1.0:1746143114.102318:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858289280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.102331:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.102357:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acd1400/0x25aee876ca70af13 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e970 expref: 22 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143114.102367:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acd1400/0x25aee876ca70af13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e970 expref: 22 pid: 22204 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143114.102397:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.102442:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858289280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 123us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.102449:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6036 00000100:00100000:1.0:1746143114.102464:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6037 00000100:00100000:1.0:1746143114.102469:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858289152:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.102477:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.102485:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132eb3c00/0x25aee876ca70afbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d2 expref: 7 pid: 8169 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143114.102495:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132eb3c00/0x25aee876ca70afbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d2 expref: 7 pid: 8169 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143114.102509:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132eb3c00/0x25aee876ca70afbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e9d2 expref: 7 pid: 8169 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143114.102526:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.102543:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858289152:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 74us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.102568:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6037 00000100:00100000:1.0:1746143114.102580:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6038 00000100:00100000:1.0:1746143114.102585:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858289408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.102593:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.102602:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132eb3000/0x25aee876ca70afec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea0a expref: 22 pid: 21048 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143114.102611:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132eb3000/0x25aee876ca70afec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea0a expref: 22 pid: 21048 timeout: 995 lvb_type: 1 00010000:00010000:1.0:1746143114.102625:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.102627:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.102636:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b4c200/0x25aee876ca70b200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 40960->782335) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eba0 expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.102645:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b4c200/0x25aee876ca70b200 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 40960->782335) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eba0 expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.102676:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b4c200/0x25aee876ca70b200 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 40960->782335) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eba0 expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.102689:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861113856:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143114.102747:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143114.102837:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:1.0:1746143114.102889:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143114.102900:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858289664 00000100:00100000:1.0:1746143114.102904:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858289664 00002000:00100000:1.0:1746143114.102931:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009a709880 x1830962858289664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.102941:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a709880 with x1830962858289664 ext(1048576->2097151) 00002000:00010000:1.0:1746143114.102945:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a709880 00000100:00100000:1.0:1746143114.102959:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5549 00000100:00100000:1.0:1746143114.102964:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858289664:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143114.105914:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858288896:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20414us (22107us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.105925:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5548 00002000:00100000:1.0:1746143114.105935:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008f574a80 x1830962858288896/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.105946:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574a80 with x1830962858288896 ext(1048576->2097151) 00002000:00010000:1.0:1746143114.105951:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f574a80 00000100:00100000:0.0:1746143114.109133:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.109277:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858289920 00000100:00100000:0.0:1746143114.109285:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858289920 00002000:00100000:0.0:1746143114.109327:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008f577800 x1830962858289920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.109338:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577800 with x1830962858289920 ext(1048576->2097151) 00002000:00010000:0.0:1746143114.109345:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f577800 00000100:00100000:0.0:1746143114.109363:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5550 00000100:00100000:0.0:1746143114.109369:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858289920:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143114.133904:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858289664:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 30936us (31064us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.133913:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5549 00002000:00100000:1.0:1746143114.133923:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009a709880 x1830962858289664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.133931:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a709880 with x1830962858289664 ext(1048576->2097151) 00002000:00010000:1.0:1746143114.133936:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a709880 00000100:00100000:1.0:1746143114.137235:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858290432 00000100:00100000:1.0:1746143114.137244:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858290432 00002000:00100000:1.0:1746143114.137286:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (40960->45055) req@ffff88012b801880 x1830962858290432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.137296:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801880 with x1830962858290432 ext(40960->45055) 00002000:00010000:1.0:1746143114.137302:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b801880 00000100:00100000:1.0:1746143114.137331:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5551 00000100:00100000:1.0:1746143114.137340:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858290432:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143114.137589:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858290432:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 248us (2561us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143114.137596:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5551 00002000:00100000:1.0:1746143114.137602:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (40960->45055) req@ffff88012b801880 x1830962858290432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/4536 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.137609:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801880 with x1830962858290432 ext(40960->45055) 00002000:00010000:1.0:1746143114.137612:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b801880 00000100:00100000:0.0:1746143114.144376:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.144500:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858290688 00000100:00100000:1.0:1746143114.144509:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858290688 00002000:00100000:1.0:1746143114.144563:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3592192->3596287) req@ffff88008fe79180 x1830962858290688/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.144574:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe79180 with x1830962858290688 ext(3592192->3596287) 00002000:00010000:1.0:1746143114.144579:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe79180 00000100:00100000:1.0:1746143114.144609:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5552 00000100:00100000:1.0:1746143114.144617:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858290688:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143114.145004:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858290688:12345-192.168.201.28@tcp:3:cat.0 Request processed in 387us (636us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143114.145012:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5552 00002000:00100000:1.0:1746143114.145019:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3592192->3596287) req@ffff88008fe79180 x1830962858290688/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/4536 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.145026:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe79180 with x1830962858290688 ext(3592192->3596287) 00002000:00010000:1.0:1746143114.145044:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe79180 00000100:00100000:1.0:1746143114.145230:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858289920:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 35860us (36105us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.145237:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5550 00002000:00100000:1.0:1746143114.145242:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008f577800 x1830962858289920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.145250:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577800 with x1830962858289920 ext(1048576->2097151) 00002000:00010000:1.0:1746143114.145254:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f577800 00000100:00100000:0.0:1746143114.160294:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.160338:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.160531:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.162008:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858290944 00000100:00100000:1.0:1746143114.162018:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858290944 00000100:00100000:0.0:1746143114.162042:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.162067:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858291200 00000100:00100000:0.0:1746143114.162070:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858291200 00002000:00100000:1.0:1746143114.162079:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008fe79c00 x1830962858290944/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.162085:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008e034000 x1830962858291200/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.162091:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe79c00 with x1830962858290944 ext(2097152->3145727) 00002000:00100000:0.0:1746143114.162091:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e034000 with x1830962858291200 ext(3145728->4194303) 00002000:00010000:1.0:1746143114.162097:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe79c00 00002000:00010000:0.0:1746143114.162097:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e034000 00000100:00100000:1.0:1746143114.162118:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858291456 00000100:00100000:1.0:1746143114.162122:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858291456 00000100:00100000:0.0:1746143114.162125:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858291712 00000100:00100000:0.0:1746143114.162127:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858291712 00000100:00100000:1.0:1746143114.162138:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5553 00002000:00100000:0.0:1746143114.162138:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008e034700 x1830962858291712/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 504/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143114.162145:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858290944:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:0.0:1746143114.162145:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e034700 with x1830962858291712 ext(3145728->4194303) 00002000:00010000:0.0:1746143114.162147:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e034700 00000100:00100000:0.0:1746143114.162158:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5554 00000100:00100000:0.0:1746143114.162162:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858291200:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:1.0:1746143114.164247:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008e037480 x1830962858291456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.164255:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e037480 with x1830962858291456 ext(2097152->3145727) 00002000:00010000:1.0:1746143114.164261:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e037480 00000100:00100000:1.0:1746143114.164282:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5556 00000100:00100000:1.0:1746143114.164289:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858291456:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143114.186492:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858290944:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24347us (26210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.186500:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5553 00002000:00100000:1.0:1746143114.186505:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008fe79c00 x1830962858290944/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.186513:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe79c00 with x1830962858290944 ext(2097152->3145727) 00002000:00010000:1.0:1746143114.186517:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe79c00 00000100:00100000:1.0:1746143114.192735:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858291200:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30560us (32384us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.192924:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5554 00002000:00100000:1.0:1746143114.192936:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008e034000 x1830962858291200/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.192946:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e034000 with x1830962858291200 ext(3145728->4194303) 00002000:00010000:1.0:1746143114.192953:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e034000 00000100:00100000:1.0:1746143114.204137:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858291456:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39835us (43593us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.204149:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5556 00002000:00100000:1.0:1746143114.204161:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008e037480 x1830962858291456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.204172:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e037480 with x1830962858291456 ext(2097152->3145727) 00002000:00010000:1.0:1746143114.204180:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e037480 00000100:00100000:0.0:1746143114.206297:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.216599:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.216644:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.218005:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.218064:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858292608 00000100:00100000:1.0:1746143114.218071:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858292608 00000100:00100000:1.0:1746143114.218108:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11498 00000100:00100000:1.0:1746143114.218114:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858292608:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143114.218131:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.218146:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f2b200/0x25aee876ca70b215 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ebbc expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.218190:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861114624:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143114.218253:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97e40 going to sleep for 11 seconds 00002000:00010000:1.0:1746143114.220291:0:10061:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143111 -> 1746143113 00002000:00010000:1.0:1746143114.220295:0:10061:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143111 -> 1746143113 00002000:00010000:1.0:1746143114.220297:0:10061:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143111 -> 1746143113 00000100:00100000:1.0:1746143114.220311:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861114624:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143114.220331:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f2b200/0x25aee876ca70b215 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebbc expref: 23 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.220341:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f2b200/0x25aee876ca70b215 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebbc expref: 23 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.220365:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f2b200, rc 0) 00000100:00100000:1.0:1746143114.220393:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858292608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2279us (3749us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143114.220397:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11498 00000100:00100000:0.0:1746143114.221974:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.225410:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861114752:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143114.225431:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801367a7400/0x25aee876ca70b21c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebb5 expref: 16 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.225446:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801367a7400, rc 0) 00000100:00100000:0.0:1746143114.225466:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30496:x1830962858292480:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6142us (8879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.225474:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11499 00000100:00100000:0.0:1746143114.225582:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.226280:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.226333:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858293376 00000100:00100000:1.0:1746143114.226339:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858293376 00002000:00100000:1.0:1746143114.226367:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4366336->4370431) req@ffff88009f358a80 x1830962858293376/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.226376:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358a80 with x1830962858293376 ext(4366336->4370431) 00002000:00010000:1.0:1746143114.226381:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f358a80 00000100:00100000:1.0:1746143114.226396:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5559 00000100:00100000:1.0:1746143114.226402:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858293376:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143114.226558:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858293376:12345-192.168.201.28@tcp:3:cat.0 Request processed in 143us (265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143114.226565:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5559 00002000:00100000:1.0:1746143114.226571:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4366336->4370431) req@ffff88009f358a80 x1830962858293376/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/4536 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.226578:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358a80 with x1830962858293376 ext(4366336->4370431) 00002000:00010000:1.0:1746143114.226581:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f358a80 00000100:00100000:0.0:1746143114.235161:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.235193:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858293504 00000100:00100000:0.0:1746143114.235202:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858293504 00002000:00100000:0.0:1746143114.235248:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4370431) req@ffff880135e64000 x1830962858293504/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.235259:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e64000 with x1830962858293504 ext(4194304->4370431) 00010000:00010000:0.0:1746143114.235268:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801367a7a00/0x25aee876ca70b20e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4370431) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebae expref: 23 pid: 4756 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.235282:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801367a7a00/0x25aee876ca70b20e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4370431) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebae expref: 23 pid: 4756 timeout: 996 lvb_type: 0 00002000:00010000:0.0:1746143114.235290:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e64000 00000100:00100000:0.0:1746143114.235313:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1847 00000100:00100000:0.0:1746143114.235322:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858293504:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143114.240338:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.242153:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858293632 00000100:00100000:1.0:1746143114.242164:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858293632 00000100:00100000:1.0:1746143114.242311:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8001 00000100:00100000:1.0:1746143114.242321:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:30501:x1830962858293632:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143114.242346:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.242364:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2ac00/0x25aee876ca70b22a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ebca expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.242660:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.242673:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.242686:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.242698:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.242703:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.242707:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.242825:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.242836:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 219 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.242843:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb5a expref: 29 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.242848:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.242876:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb5a expref: 29 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.242887:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffae00/0x25aee876ca70b1ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb5a expref: 29 pid: 1037 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.242897:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861115136:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.242975:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 219 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.242982:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 219 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.242990:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861115264:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.243008:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97b40 going to sleep for 11 seconds 00000100:00080000:1.0:1746143114.243024:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143114.244270:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858293504:12345-192.168.201.28@tcp:4:cat.0 Request processed in 8947us (9119us total) trans 21474839889 rc 0/0 00000100:00100000:1.0:1746143114.244280:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1847 00002000:00100000:1.0:1746143114.244290:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4370431) req@ffff880135e64000 x1830962858293504/t21474839889(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/448 e 0 to 0 dl 1746143125 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.244300:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e64000 with x1830962858293504 ext(4194304->4370431) 00010000:00010000:1.0:1746143114.244309:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801367a7a00/0x25aee876ca70b20e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4370431) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebae expref: 24 pid: 4756 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.244320:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801367a7a00/0x25aee876ca70b20e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4538367] (req 4194304->4370431) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebae expref: 24 pid: 4756 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746143114.244326:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e64000 00000100:00100000:0.0:1746143114.247378:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.247409:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.250205:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861115136:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.250216:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861115264:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.250244:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:1.0:1746143114.254083:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.254294:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.254537:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858294400 00000100:00100000:0.0:1746143114.254561:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858294400 00010000:00010000:0.0:1746143114.254598:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4aaa00/0x25aee876ca70b207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eba7 expref: 31 pid: 4756 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143114.254629:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6044 00000100:00100000:0.0:1746143114.254636:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858294400:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.254652:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143114.254672:0:9869:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143112 -> 1746143113 00002000:00010000:0.0:1746143114.254676:0:9869:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143112 -> 1746143113 00002000:00010000:0.0:1746143114.254678:0:9869:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143112 -> 1746143113 00010000:00010000:0.0:1746143114.254683:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b4aaa00/0x25aee876ca70b207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eba7 expref: 31 pid: 4756 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.254695:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b4aaa00/0x25aee876ca70b207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eba7 expref: 31 pid: 4756 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.254720:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b4aaa00/0x25aee876ca70b207 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eba7 expref: 31 pid: 4756 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.254738:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.254740:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.254747:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801367a7400/0x25aee876ca70b21c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebb5 expref: 15 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.254755:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801367a7400/0x25aee876ca70b21c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebb5 expref: 15 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.254787:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801367a7400/0x25aee876ca70b21c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebb5 expref: 15 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143114.254800:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861115520:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143114.254869:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3b40 going to sleep for 11 seconds 00000100:00080000:0.0:1746143114.257805:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143114.257977:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.259521:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861115520:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143114.259533:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.259577:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858294400:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4940us (5281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.259584:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6044 00000100:00100000:0.0:1746143114.261189:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.261229:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.263157:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858294912 00000100:00100000:1.0:1746143114.263165:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858294912 00010000:00010000:1.0:1746143114.263199:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 221 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.263225:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6046 00000100:00100000:1.0:1746143114.263231:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+221:1970:x1830962858294912:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.263244:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.263250:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 221 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.263261:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 221 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.263285:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b19e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb53 expref: 221 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.263311:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.263316:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263326:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263334:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263357:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.263384:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+220:1970:x1830962858294912:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 152us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.263390:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6046 00010000:00010000:1.0:1746143114.263420:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263426:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143114.263470:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143114.263475:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143114.263491:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263501:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263510:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263516:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263521:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263527:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f2aa00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143114.263530:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263536:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263557:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143114.263560:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143114.263563:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263568:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2aa00/0x25aee876ca70b231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263577:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263582:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263586:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263606:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f2a800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143114.263608:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263613:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263620:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e924100) 00010000:00010000:1.0:1746143114.263622:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143114.263624:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263628:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a800/0x25aee876ca70b238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.263659:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2ac00/0x25aee876ca70b22a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebca expref: 18 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.263672:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebca expref: 17 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.263678:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.263680:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143114.263683:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f2a600, rc 0) 00000100:00100000:1.0:1746143114.263703:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:30501:x1830962858293632:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 21385us (23375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.263710:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8001 00000100:00100000:0.0:1746143114.270300:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143114.283105:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143114.283350:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858295680 00000100:00100000:1.0:1746143114.283357:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858295680 00000100:00100000:1.0:1746143114.283391:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858295808 00000100:00100000:1.0:1746143114.283394:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858295808 00000100:00100000:1.0:1746143114.283417:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11504 00000100:00100000:1.0:1746143114.283424:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858295680:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143114.283436:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.283449:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd5c00/0x25aee876ca70b25b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ebe6 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.283465:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.283467:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.283474:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd5c00/0x25aee876ca70b25b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebe6 expref: 9 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.283488:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd5c00/0x25aee876ca70b25b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebe6 expref: 9 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.283503:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd5c00, rc 0) 00000100:00100000:1.0:1746143114.283531:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858295680:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.283537:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11504 00000100:00100000:1.0:1746143114.283566:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11505 00000100:00100000:1.0:1746143114.283572:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858295808:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143114.283578:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.283586:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fd5800/0x25aee876ca70b262 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ebed expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.283599:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.283601:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.283605:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd5800/0x25aee876ca70b262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebed expref: 8 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.283615:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fd5800/0x25aee876ca70b262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebed expref: 8 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.283622:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd5800, rc 0) 00000100:00100000:1.0:1746143114.283638:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858295808:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 66us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.283643:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11505 00000100:00100000:0.0:1746143114.284484:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.284509:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.285271:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858295936 00000100:00100000:1.0:1746143114.285276:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858295936 00000100:00100000:1.0:1746143114.285299:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858296064 00000100:00100000:1.0:1746143114.285302:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858296064 00000100:00100000:1.0:1746143114.285316:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11506 00000100:00100000:1.0:1746143114.285322:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858295936:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143114.285331:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.285343:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd5600/0x25aee876ca70b269 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ebf4 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.285613:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861115776:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143114.285672:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143114.288477:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861115776:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143114.288497:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd5600/0x25aee876ca70b269 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebf4 expref: 24 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.288508:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd5600/0x25aee876ca70b269 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebf4 expref: 24 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.288528:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd5600, rc 0) 00000100:00100000:1.0:1746143114.288882:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858295936:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3557us (4396us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143114.288890:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11506 00000100:00100000:1.0:1746143114.291643:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.291663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.291692:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858296320 00000100:00100000:1.0:1746143114.292074:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858296320 00000100:00100000:0.0:1746143114.292239:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.292701:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8002 00000100:00100000:1.0:1746143114.292713:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:30501:x1830962858296320:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143114.292724:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.292737:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5200/0x25aee876ca70b27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ec02 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.292830:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.292842:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebca expref: 18 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.292848:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.292876:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebca expref: 18 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.292889:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebca expref: 18 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.293023:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861115904:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.293100:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143114.298788:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143114.299877:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f2a600/0x25aee876ca70b23f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebca expref: 18 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.299900:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861115904:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.299918:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.299927:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.299932:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143114.299954:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143114.300320:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5200/0x25aee876ca70b27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 19 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.300334:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 18 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.300341:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.300343:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143114.300345:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd4800, rc 0) 00000100:00100000:1.0:1746143114.300377:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:30501:x1830962858296320:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7669us (8714us total) trans 8589942205 rc 0/0 00000100:00100000:1.0:1746143114.300384:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8002 00000100:00100000:0.0:1746143114.302708:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.302761:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858296832 00000100:00100000:1.0:1746143114.302769:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858296832 00000100:00100000:1.0:1746143114.302816:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8003 00000100:00100000:1.0:1746143114.302824:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:30501:x1830962858296832:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143114.302850:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.302868:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4400/0x25aee876ca70b29a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ec17 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.302947:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.302962:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 19 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.302969:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.302998:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 19 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.303011:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 19 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.303023:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861116160:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143114.303184:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143114.305649:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.305702:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.311246:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.311278:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858297472 00000100:00100000:0.0:1746143114.311286:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858297472 00010000:00010000:0.0:1746143114.311322:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 20 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143114.311352:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6048 00000100:00100000:0.0:1746143114.311359:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:1969:x1830962858297472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.311373:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143114.311379:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 20 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.311392:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 20 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.311413:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143114.311417:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143114.311427:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143114.311434:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143114.311449:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.311478:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:1969:x1830962858297472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.311484:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6048 00010000:00010000:1.0:1746143114.312654:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b28c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec02 expref: 19 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.312670:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861116160:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.312687:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.312695:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.312700:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143114.312746:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143114.312751:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143114.312769:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.312797:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4400/0x25aee876ca70b29a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 19 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.312810:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 18 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.312818:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.312821:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143114.312824:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd4600, rc 0) 00000100:00100000:1.0:1746143114.312859:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:30501:x1830962858296832:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 10035us (10158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.312865:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8003 00000100:00100000:0.0:1746143114.327160:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.332854:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.338665:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.338756:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858298112 00000100:00100000:1.0:1746143114.338766:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858298112 00000100:00100000:1.0:1746143114.338942:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8004 00000100:00100000:1.0:1746143114.338952:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e36d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:30501:x1830962858298112:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143114.338977:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.338998:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2a800/0x25aee876ca70b2af lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ec25 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.339138:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.339152:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.339164:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143114.339177:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143114.339298:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2a800/0x25aee876ca70b2af lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 21 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.339343:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 20 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.339352:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.339355:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143114.339359:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2aa00, rc 0) 00000100:00100000:1.0:1746143114.339413:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e36d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:30501:x1830962858298112:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 463us (965us total) trans 8589942206 rc 0/0 00000100:00100000:1.0:1746143114.339420:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8004 00000100:00100000:0.0:1746143114.345606:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.345892:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.346006:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858298368 00000100:00100000:1.0:1746143114.346015:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858298368 00000100:00100000:1.0:1746143114.346068:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11511 00000100:00100000:1.0:1746143114.346075:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858298368:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:1.0:1746143114.346116:0:21048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.346134:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a524a600/0x25aee876ca70b1dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb7d expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.346143:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093cece00/0x25aee876ca70b24d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebd8 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.346151:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a518b400/0x25aee876ca70b1eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb8b expref: 30 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.346156:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.346158:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.346160:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.346175:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a518b400/0x25aee876ca70b1eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb8b expref: 30 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.346187:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a518b400/0x25aee876ca70b1eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb8b expref: 30 pid: 10061 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.346200:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861116544:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.346257:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093cece00/0x25aee876ca70b24d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebd8 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.346267:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093cece00/0x25aee876ca70b24d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebd8 expref: 8 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143114.346276:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861116672:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.347288:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a524a600/0x25aee876ca70b1dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb7d expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143114.347295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143114.347298:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a524a600/0x25aee876ca70b1dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb7d expref: 15 pid: 10061 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.347308:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861116800:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143114.347326:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.347327:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143114.347345:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.347363:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858298624 00000100:00100000:1.0:1746143114.347367:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858298624 00000100:00100000:1.0:1746143114.347386:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858298880 00000100:00100000:1.0:1746143114.347388:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858298880 00000100:00100000:0.0:1746143114.347388:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.347398:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858298496 00000100:00100000:1.0:1746143114.347400:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858298496 00000100:00100000:1.0:1746143114.347409:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858298752 00000100:00100000:1.0:1746143114.347411:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858298752 00000100:00100000:1.0:1746143114.347423:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11513 00000100:00100000:1.0:1746143114.347428:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858298624:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:1.0:1746143114.347446:0:8169:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.347465:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 22 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.347474:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 19 pid: 21048 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143114.348924:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861116544:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.349284:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.349291:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.349293:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.349295:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.349315:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.349724:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 9 pid: 21048 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143114.349736:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861118208:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.349992:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 19 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.350001:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 19 pid: 21048 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143114.350009:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861118336:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.350051:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 22 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.350060:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 22 pid: 10061 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.350069:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861118464:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.350088:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143114.366782:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861116672:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143114.366797:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b800700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861116416:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143114.366824:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143114.374220:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.374255:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861116800:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.374288:0:21048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143114.374291:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.374316:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858299264 00000100:00100000:1.0:1746143114.374321:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858299264 00010000:00010000:1.0:1746143114.374349:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093cece00/0x25aee876ca70b24d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebd8 expref: 11 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143114.374368:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6050 00000100:00100000:1.0:1746143114.374373:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858299264:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143114.374376:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143114.374386:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143114.374393:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143114.374406:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093cece00/0x25aee876ca70b24d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebd8 expref: 11 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143114.374407:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143114.374415:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093cece00/0x25aee876ca70b24d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebd8 expref: 11 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143114.374425:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858299520 00000100:00100000:0.0:1746143114.374429:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858299520 00010000:00010000:1.0:1746143114.374434:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093cece00/0x25aee876ca70b24d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebd8 expref: 11 pid: 22204 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.374448:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a524a600/0x25aee876ca70b1dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb7d expref: 16 pid: 10061 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.374449:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.374467:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858299392 00000100:00100000:0.0:1746143114.374470:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858299392 00010000:00010000:0.0:1746143114.374479:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd5800/0x25aee876ca70b262 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebed expref: 11 pid: 8169 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143114.374490:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858299648 00000100:00100000:0.0:1746143114.374493:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858299648 00010000:00010000:0.0:1746143114.374503:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090028c00/0x25aee876ca70b285 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec10 expref: 20 pid: 22204 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143114.374516:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6051 00000100:00100000:0.0:1746143114.374522:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858299520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.374530:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143114.374536:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858299264:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 160us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.374559:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6050 00010000:00010000:0.0:1746143114.374559:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a524a600/0x25aee876ca70b1dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb7d expref: 16 pid: 10061 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.374569:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a524a600/0x25aee876ca70b1dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb7d expref: 16 pid: 10061 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.374575:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6052 00000100:00100000:1.0:1746143114.374581:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858299392:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.374584:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a524a600/0x25aee876ca70b1dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb7d expref: 16 pid: 10061 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.374589:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143114.374599:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.374601:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094fd5800/0x25aee876ca70b262 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebed expref: 10 pid: 8169 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.374601:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.374606:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.374612:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fd5800/0x25aee876ca70b262 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebed expref: 10 pid: 8169 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.374616:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.374624:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143114.374634:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.374640:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858299392:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 60us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.374646:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6052 00000100:00100000:0.0:1746143114.374654:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858299520:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.374659:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6053 00000100:00100000:0.0:1746143114.374663:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6051 00000100:00100000:1.0:1746143114.374664:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858299648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.374673:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.374688:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090028c00/0x25aee876ca70b285 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec10 expref: 20 pid: 22204 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.374698:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090028c00/0x25aee876ca70b285 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec10 expref: 20 pid: 22204 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.374710:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.374727:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858299648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 62us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.374733:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6053 00000100:00100000:1.0:1746143114.374975:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861118208:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.375129:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861118336:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.375142:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861118464:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.375158:0:8169:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375274:0:21048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375282:0:21048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375314:0:21048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375322:0:21048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375337:0:21048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375345:0:21048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e2ac00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143114.375349:0:21048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375357:0:21048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375374:0:21048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.375385:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e2ac00/0x25aee876ca70b2cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.375648:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858298368:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 29573us (30042us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.375658:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11511 00000100:00100000:0.0:1746143114.375976:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.377115:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.377143:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.377164:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.377179:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.377194:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858299904 00000100:00100000:0.0:1746143114.377197:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858299904 00010000:00010000:0.0:1746143114.377214:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 20 pid: 21048 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143114.377230:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858299776 00000100:00100000:0.0:1746143114.377232:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858299776 00010000:00010000:0.0:1746143114.377241:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 10 pid: 21048 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143114.377250:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858300160 00000100:00100000:0.0:1746143114.377252:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858300160 00010000:00010000:0.0:1746143114.377260:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 23 pid: 10061 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143114.377269:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858300800 00000100:00100000:0.0:1746143114.377270:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858300800 00010000:00010000:0.0:1746143114.377278:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801367a6e00/0x25aee876ca70b223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebc3 expref: 24 pid: 4756 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143114.377287:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858300032 00000100:00100000:0.0:1746143114.377289:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858300032 00010000:00010000:0.0:1746143114.377298:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cac600/0x25aee876ca70b270 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebfb expref: 30 pid: 8449 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143114.377316:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6054 00000100:00100000:0.0:1746143114.377322:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858299904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.377331:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143114.377344:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 20 pid: 21048 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.377352:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 20 pid: 21048 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.377366:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b2735c00/0x25aee876ca70b12e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eaea expref: 20 pid: 21048 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.377376:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.377398:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858299904:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 76us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.377404:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6054 00000100:00100000:0.0:1746143114.377415:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6055 00000100:00100000:0.0:1746143114.377419:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858299776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.377425:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143114.377432:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 10 pid: 21048 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.377440:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 10 pid: 21048 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.377456:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8647000/0x25aee876ca70b104 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eac7 expref: 10 pid: 21048 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.377464:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.377475:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858299776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 56us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.377481:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6055 00000100:00100000:0.0:1746143114.377488:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6056 00000100:00100000:0.0:1746143114.377492:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858300160:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.377498:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143114.377503:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 24 pid: 10061 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.377510:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 24 pid: 10061 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.377520:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135c9ba00/0x25aee876ca70b0a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ea88 expref: 24 pid: 10061 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.377527:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.377529:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.377532:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.377540:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.377636:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.377654:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858300160:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 161us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.377661:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6056 00000100:00100000:0.0:1746143114.377694:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6057 00000100:00100000:0.0:1746143114.377699:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858300800:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.377706:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143114.377714:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801367a6e00/0x25aee876ca70b223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebc3 expref: 22 pid: 4756 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.377723:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801367a6e00/0x25aee876ca70b223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebc3 expref: 22 pid: 4756 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.377736:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801367a6e00/0x25aee876ca70b223 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ebc3 expref: 22 pid: 4756 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.377744:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.377758:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858300800:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 59us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.377782:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6057 00010000:00010000:1.0:1746143114.377889:0:8169:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.377898:0:8169:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.377919:0:8169:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.377928:0:8169:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.377935:0:8169:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.377942:0:8169:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e2a200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143114.377945:0:8169:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.377953:0:8169:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.377965:0:8169:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.377972:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e2a200/0x25aee876ca70b2d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.378020:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858298624:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 30590us (30724us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.378048:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11513 00000100:00100000:0.0:1746143114.378977:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858300928 00000100:00100000:0.0:1746143114.378981:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858300928 00010000:00010000:0.0:1746143114.378998:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f12600/0x25aee876ca70b166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4538368->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb22 expref: 19 pid: 8169 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143114.379021:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6062 00000100:00100000:0.0:1746143114.379028:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858300544:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.379057:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143114.379068:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b4ca00/0x25aee876ca70b1f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb92 expref: 15 pid: 22204 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.379078:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b4ca00/0x25aee876ca70b1f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb92 expref: 15 pid: 22204 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.379091:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b4ca00/0x25aee876ca70b1f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb92 expref: 15 pid: 22204 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143114.379102:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.379104:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.379108:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a03400/0x25aee876ca70b2e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.379116:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a03400/0x25aee876ca70b2e0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.379135:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.379192:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6063 00000100:00100000:1.0:1746143114.379200:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858300928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.379207:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.379218:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f12600/0x25aee876ca70b166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4538368->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb22 expref: 19 pid: 8169 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.379228:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f12600/0x25aee876ca70b166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4538368->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb22 expref: 19 pid: 8169 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.379241:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f12600/0x25aee876ca70b166 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4538368->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eb22 expref: 19 pid: 8169 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.379251:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.379252:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.379255:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090028600/0x25aee876ca70b2e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.379269:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090028600/0x25aee876ca70b2e7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.379294:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.379753:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858300544:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 723us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.379761:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6062 00000100:00100000:1.0:1746143114.379807:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858300928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 608us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.380142:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6063 00000100:00100000:1.0:1746143114.391929:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.391954:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858301312 00000100:00100000:1.0:1746143114.391962:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858301312 00000100:00100000:1.0:1746143114.392009:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8005 00000100:00100000:1.0:1746143114.392017:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+220:30505:x1830962858301312:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143114.392054:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.393183:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626600/0x25aee876ca70b2ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ec2c expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.393268:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.393284:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 19 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.393292:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 19 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.393299:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.393331:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 19 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.393341:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 19 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.393353:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861118592:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.393436:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 19 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.393444:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 19 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.393451:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861118720:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.393470:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143114.398863:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.398886:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.399393:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858301568 00000100:00100000:1.0:1746143114.399402:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858301568 00010000:00010000:1.0:1746143114.399433:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 20 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.399466:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858301440 00000100:00100000:1.0:1746143114.399468:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858301440 00010000:00010000:1.0:1746143114.399476:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 21 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.399489:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6065 00000100:00100000:1.0:1746143114.399496:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+21:1970:x1830962858301568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.399509:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.399514:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 21 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.399523:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 21 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.399553:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.399558:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.399565:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.399571:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.399609:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+21:1970:x1830962858301568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 113us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.399616:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6065 00000100:00100000:1.0:1746143114.399630:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6066 00000100:00100000:1.0:1746143114.399634:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:1970:x1830962858301440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.399641:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.399645:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 20 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.399652:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 20 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.399661:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.399664:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.399675:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.399682:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.399696:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.399711:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:1970:x1830962858301440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 76us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.399717:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6066 00010000:00010000:1.0:1746143114.399755:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b2b6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec25 expref: 19 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.399779:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861118592:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.399788:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4600/0x25aee876ca70b2a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec17 expref: 18 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.399795:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861118720:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.399808:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.399814:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.401236:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143114.401253:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143114.401364:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626600/0x25aee876ca70b2ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 223 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.401377:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 222 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.401384:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.401387:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143114.401389:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b626000, rc 0) 00000100:00100000:1.0:1746143114.403419:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+222:30505:x1830962858301312:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11392us (11488us total) trans 8589942207 rc 0/0 00000100:00100000:1.0:1746143114.403429:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8005 00000100:00100000:0.0:1746143114.409491:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143114.410159:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.410168:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.410188:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.410194:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.410200:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.410206:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090028000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143114.410209:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.410216:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.410227:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.410233:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090028000/0x25aee876ca70b2c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143114.410284:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858298240:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 64194us (64392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.410291:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11512 00000100:00100000:0.0:1746143114.417837:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.417963:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858301952 00000100:00100000:1.0:1746143114.417973:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858301952 00000100:00100000:1.0:1746143114.418060:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8006 00000100:00100000:1.0:1746143114.418068:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:30501:x1830962858301952:12345-192.168.201.28@tcp:36:lfs.0 00000100:00100000:1.0:1746143114.418172:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:30501:x1830962858301952:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 105us (347us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746143114.418178:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8006 00000100:00100000:0.0:1746143114.420454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.429490:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.439685:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143114.480639:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143114.539799:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.539839:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.539920:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.544208:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.544246:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.544308:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.544572:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858303232 00000100:00100000:1.0:1746143114.544578:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858303232 00000100:00100000:1.0:1746143114.544605:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858303360 00000100:00100000:1.0:1746143114.544607:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858303360 00000100:00100000:1.0:1746143114.544614:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858303488 00000100:00100000:1.0:1746143114.544616:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858303488 00000100:00100000:1.0:1746143114.544628:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11520 00000100:00100000:1.0:1746143114.544634:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858303232:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143114.544650:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.544667:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ec4f expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143114.544690:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x68140788, atime: 0x68140788, ctime: 0x68140787, blocks: 0x821 00010000:00010000:1.0:1746143114.544905:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.544907:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.544915:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143114.544926:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11521 00010000:00010000:1.0:1746143114.544928:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.544936:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b627200, rc 0) 00000100:00100000:0.0:1746143114.544944:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858303360:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143114.544963:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143114.544967:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858303232:12345-192.168.201.28@tcp:101:cat.0 Request processed in 332us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.544973:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11520 00010000:00010000:0.0:1746143114.544982:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ec56 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.544985:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11522 00000100:00100000:1.0:1746143114.544989:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858303488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143114.544995:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.545005:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b626c00/0x25aee876ca70b33b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ec5d expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143114.545005:0:4758:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x68140789, atime: 0x68140788, ctime: 0x68140789, blocks: 0x1809 00002000:00010000:1.0:1746143114.545018:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x68140789, atime: 0x68140789, ctime: 0x68140789, blocks: 0x102b 00010000:00010000:0.0:1746143114.545022:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.545024:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.545028:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.545057:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.545060:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b626c00/0x25aee876ca70b33b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec5d expref: 31 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.545070:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b626c00/0x25aee876ca70b33b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec5d expref: 31 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.545076:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b626c00, rc 0) 00010000:00010000:0.0:1746143114.545081:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143114.545089:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858303488:12345-192.168.201.28@tcp:101:cat.0 Request processed in 99us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.545094:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11522 00010000:00010000:0.0:1746143114.545097:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143114.545111:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135e9ba00, rc 0) 00000100:00100000:1.0:1746143114.547768:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858303360:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2822us (3513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.547776:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11521 00000100:00100000:0.0:1746143114.564207:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.571298:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.571352:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.572184:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858304000 00000100:00100000:1.0:1746143114.572195:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858304000 00002000:00100000:1.0:1746143114.572242:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094513480 x1830962858304000/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.572252:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513480 with x1830962858304000 ext(1048576->2097151) 00002000:00010000:1.0:1746143114.572259:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094513480 00000100:00100000:1.0:1746143114.572476:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858304256 00000100:00100000:1.0:1746143114.572479:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858304256 00002000:00100000:1.0:1746143114.572493:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094512680 x1830962858304256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.572500:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512680 with x1830962858304256 ext(1048576->2097151) 00002000:00010000:1.0:1746143114.572504:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094512680 00000100:00100000:1.0:1746143114.572529:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5567 00000100:00100000:1.0:1746143114.572534:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858304256:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143114.572845:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.572859:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858304512 00000100:00100000:0.0:1746143114.572862:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858304512 00002000:00100000:0.0:1746143114.572878:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094513100 x1830962858304512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.572885:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513100 with x1830962858304512 ext(1048576->2097151) 00002000:00010000:0.0:1746143114.572888:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094513100 00000100:00100000:0.0:1746143114.596682:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858304256:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24142us (25324us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143114.596692:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5567 00002000:00100000:0.0:1746143114.596700:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094512680 x1830962858304256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.596707:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512680 with x1830962858304256 ext(1048576->2097151) 00002000:00010000:0.0:1746143114.596712:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094512680 00000100:00100000:1.0:1746143114.598498:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858304768 00000100:00100000:1.0:1746143114.598503:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858304768 00010000:00010000:1.0:1746143114.598524:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b626c00/0x25aee876ca70b33b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec5d expref: 32 pid: 4756 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143114.598567:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6068 00000100:00100000:1.0:1746143114.598571:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1971:x1830962858304768:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.598580:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.598600:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b626c00/0x25aee876ca70b33b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec5d expref: 32 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143114.598612:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b626c00/0x25aee876ca70b33b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec5d expref: 32 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143114.598625:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b626c00/0x25aee876ca70b33b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec5d expref: 32 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143114.598641:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.598642:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.598648:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c8c400/0x25aee876ca70b342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec64 expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.598655:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c8c400/0x25aee876ca70b342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec64 expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.598683:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093c8c400/0x25aee876ca70b342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec64 expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.598693:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861118976:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143114.598945:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143114.601551:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.601989:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861118976:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143114.602005:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.602062:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858304768:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3487us (4946us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.602072:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6068 00000100:00100000:0.0:1746143114.616714:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.619214:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.619972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.620226:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.620924:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.624811:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858306944 00000100:00100000:1.0:1746143114.624829:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858306944 00002000:00100000:1.0:1746143114.624870:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094513800 x1830962858306944/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.624881:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513800 with x1830962858306944 ext(1048576->2097151) 00002000:00010000:1.0:1746143114.624886:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094513800 00000100:00100000:1.0:1746143114.624905:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5573 00000100:00100000:1.0:1746143114.624913:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858306944:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143114.629095:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.629137:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.629156:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.629173:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858307072 00000100:00100000:0.0:1746143114.629180:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858307072 00000100:00100000:1.0:1746143114.629183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143114.629230:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdbaa00/0x25aee876ca70b365 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec87 expref: 25 pid: 4756 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143114.630208:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6069 00000100:00100000:0.0:1746143114.630216:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1970:x1830962858307072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143114.630230:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143114.630254:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fdbaa00/0x25aee876ca70b365 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec87 expref: 25 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.630265:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fdbaa00/0x25aee876ca70b365 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec87 expref: 25 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.630286:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdbaa00/0x25aee876ca70b365 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec87 expref: 25 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.630306:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.630326:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858307072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 111us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.630333:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6069 00000100:00100000:0.0:1746143114.630354:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858307328 00000100:00100000:0.0:1746143114.630357:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858307328 00002000:00100000:0.0:1746143114.630379:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009a70b100 x1830962858307328/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.630388:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70b100 with x1830962858307328 ext(2097152->3145727) 00010000:00010000:0.0:1746143114.630393:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 25 pid: 4758 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143114.630404:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 25 pid: 4758 timeout: 996 lvb_type: 1 00002000:00010000:0.0:1746143114.630409:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a70b100 00000100:00100000:0.0:1746143114.630419:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1849 00000100:00100000:0.0:1746143114.630423:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858307328:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143114.630640:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.630668:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1850 00000100:00100000:1.0:1746143114.630675:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858307584:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143114.636090:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.641848:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.657261:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858306944:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32336us (36324us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.657274:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5573 00002000:00100000:1.0:1746143114.657287:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094513800 x1830962858306944/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.657297:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513800 with x1830962858306944 ext(1048576->2097151) 00002000:00010000:1.0:1746143114.657303:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094513800 00000100:00100000:1.0:1746143114.671277:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858307328:12345-192.168.201.28@tcp:3:cat.0 Request processed in 40852us (42139us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.671285:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1849 00002000:00100000:1.0:1746143114.671291:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009a70b100 x1830962858307328/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.671299:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70b100 with x1830962858307328 ext(2097152->3145727) 00010000:00010000:1.0:1746143114.671306:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 27 pid: 4758 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143114.671314:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 27 pid: 4758 timeout: 996 lvb_type: 1 00002000:00010000:1.0:1746143114.671319:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a70b100 00000100:00100000:0.0:1746143114.671739:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.672309:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.681330:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.681523:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.682764:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.683323:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858309120 00000100:00100000:1.0:1746143114.683329:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858309120 00010000:00010000:1.0:1746143114.683347:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 25 pid: 4758 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143114.683370:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6071 00000100:00100000:1.0:1746143114.683376:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858309120:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.683383:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.683396:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 25 pid: 4758 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143114.683405:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 25 pid: 4758 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143114.683418:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135e9ba00/0x25aee876ca70b334 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec56 expref: 25 pid: 4758 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143114.686907:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143114.687065:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.687071:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.687084:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c8c800/0x25aee876ca70b373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec95 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.687095:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c8c800/0x25aee876ca70b373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec95 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.687138:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093c8c800/0x25aee876ca70b373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec95 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.687152:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861119872:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143114.690354:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143114.690727:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861119872:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143114.690741:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143114.690751:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.690786:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858309120:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7409us (8022us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.690794:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6071 00000100:00100000:1.0:1746143114.692735:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.692953:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858309888 00000100:00100000:0.0:1746143114.692961:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858309888 00000100:00100000:1.0:1746143114.692983:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:0.0:1746143114.692998:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009a70ad80 x1830962858309888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.693007:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70ad80 with x1830962858309888 ext(2097152->3145727) 00002000:00010000:0.0:1746143114.693012:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a70ad80 00000100:00100000:0.0:1746143114.693045:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858310144 00000100:00100000:0.0:1746143114.693048:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858310144 00002000:00100000:0.0:1746143114.693060:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3223552->3227647) req@ffff88009a70a300 x1830962858310144/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.693073:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70a300 with x1830962858310144 ext(3223552->3227647) 00002000:00010000:0.0:1746143114.693076:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a70a300 00000100:00100000:0.0:1746143114.693095:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5579 00000100:00100000:0.0:1746143114.693102:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858310144:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143114.693245:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858310144:12345-192.168.201.28@tcp:3:cat.0 Request processed in 142us (266us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143114.693251:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5579 00002000:00100000:0.0:1746143114.693257:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3223552->3227647) req@ffff88009a70a300 x1830962858310144/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/4536 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143114.693264:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70a300 with x1830962858310144 ext(3223552->3227647) 00002000:00010000:0.0:1746143114.693266:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a70a300 00000100:00100000:1.0:1746143114.715527:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.715596:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858310528 00000100:00100000:0.0:1746143114.715603:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858310528 00000100:00100000:0.0:1746143114.715725:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11536 00000100:00100000:0.0:1746143114.715733:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30515:x1830962858310528:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143114.715747:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143114.715764:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fd5a00/0x25aee876ca70b39d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ecbf expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.715785:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.715786:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.715793:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd5a00/0x25aee876ca70b39d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecbf expref: 17 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.715805:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fd5a00/0x25aee876ca70b39d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecbf expref: 17 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.715814:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd5a00, rc 0) 00000100:00100000:0.0:1746143114.716312:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30515:x1830962858310528:12345-192.168.201.28@tcp:101:cat.0 Request processed in 579us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.716319:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11536 00000100:00100000:0.0:1746143114.723216:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.730200:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.739694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.745783:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.752991:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.756566:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.762021:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.762924:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858311680 00000100:00100000:1.0:1746143114.762935:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858311680 00010000:00010000:1.0:1746143114.762974:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c8c800/0x25aee876ca70b373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec95 expref: 26 pid: 4758 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.763020:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6072 00000100:00100000:1.0:1746143114.763047:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858311680:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.763063:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143114.763086:0:7112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143112 -> 1746143113 00010000:00010000:1.0:1746143114.763093:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c8c800/0x25aee876ca70b373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec95 expref: 26 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.763103:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c8c800/0x25aee876ca70b373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec95 expref: 26 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.763131:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c8c800/0x25aee876ca70b373 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec95 expref: 26 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.763165:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.763167:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.763175:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec51600/0x25aee876ca70b3a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecc6 expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.763184:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec51600/0x25aee876ca70b3a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecc6 expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.763216:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec51600/0x25aee876ca70b3a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecc6 expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.763229:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861120256:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143114.763316:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143114.769103:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861120256:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143114.769127:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.769177:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858311680:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6148us (7360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.769187:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6072 00000100:00100000:0.0:1746143114.770605:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.770687:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858311936 00000100:00100000:1.0:1746143114.770695:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858311936 00002000:00100000:1.0:1746143114.770732:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008eb75180 x1830962858311936/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.770741:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb75180 with x1830962858311936 ext(3145728->4194303) 00002000:00010000:1.0:1746143114.770746:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb75180 00000100:00100000:1.0:1746143114.770773:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5583 00000100:00100000:1.0:1746143114.770781:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858311936:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143114.796466:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858311936:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25673us (25855us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.796479:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5583 00002000:00100000:1.0:1746143114.796491:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008eb75180 x1830962858311936/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.796500:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb75180 with x1830962858311936 ext(3145728->4194303) 00002000:00010000:1.0:1746143114.796506:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb75180 00000100:00100000:0.0:1746143114.797643:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.797761:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858312064 00000100:00100000:1.0:1746143114.797769:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858312064 00010000:00010000:1.0:1746143114.797798:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdbaa00/0x25aee876ca70b37a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3194880->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec9c expref: 19 pid: 4758 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143114.810021:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.810113:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858312320 00000100:00100000:1.0:1746143114.810121:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858312320 00002000:00100000:1.0:1746143114.810168:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eb74000 x1830962858312320/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.810178:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74000 with x1830962858312320 ext(3145728->4194303) 00002000:00010000:1.0:1746143114.810184:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb74000 00000100:00100000:1.0:1746143114.811721:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5584 00000100:00100000:1.0:1746143114.811732:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858312320:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143114.822351:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.827574:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858312320:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15835us (17553us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.827587:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5584 00002000:00100000:1.0:1746143114.827600:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eb74000 x1830962858312320/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.827610:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74000 with x1830962858312320 ext(3145728->4194303) 00002000:00010000:1.0:1746143114.827616:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb74000 00000100:00100000:0.0:1746143114.833444:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.833845:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858312704 00000100:00100000:1.0:1746143114.833854:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858312704 00002000:00100000:1.0:1746143114.833903:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eb74700 x1830962858312704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.833915:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74700 with x1830962858312704 ext(3145728->4194303) 00002000:00010000:1.0:1746143114.833921:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb74700 00000100:00100000:1.0:1746143114.833957:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5585 00000100:00100000:1.0:1746143114.833965:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858312704:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143114.835877:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.845058:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858312704:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11064us (11595us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143114.845070:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5585 00002000:00100000:1.0:1746143114.845085:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eb74700 x1830962858312704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.845095:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74700 with x1830962858312704 ext(3145728->4194303) 00002000:00010000:1.0:1746143114.845101:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb74700 00000100:00100000:0.0:1746143114.845885:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.848409:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858313088 00000100:00100000:1.0:1746143114.848428:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858313088 00002000:00100000:1.0:1746143114.848485:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008eb77100 x1830962858313088/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.848496:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77100 with x1830962858313088 ext(4194304->5210111) 00002000:00010000:1.0:1746143114.848503:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb77100 00000100:00100000:1.0:1746143114.848553:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5586 00000100:00100000:1.0:1746143114.848561:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858313088:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143114.858551:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.860067:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858313088:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11503us (14180us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143114.860076:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5586 00002000:00100000:1.0:1746143114.860083:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008eb77100 x1830962858313088/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/440 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.860091:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77100 with x1830962858313088 ext(4194304->5210111) 00002000:00010000:1.0:1746143114.860095:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb77100 00000100:00100000:0.0:1746143114.865021:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.872881:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.877779:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.879948:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.888530:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.896951:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.896990:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.897026:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.902685:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.904935:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858314496 00000100:00100000:1.0:1746143114.904944:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858314496 00000100:00100000:1.0:1746143114.904991:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11545 00000100:00100000:1.0:1746143114.904999:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858314496:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143114.905019:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.905052:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ecfe expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.905087:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecfe expref: 24 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.905098:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecfe expref: 24 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.905120:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c9a400, rc 0) 00000100:00100000:1.0:1746143114.905147:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858314496:12345-192.168.201.28@tcp:101:cat.0 Request processed in 149us (2475us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143114.905154:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11545 00000100:00100000:0.0:1746143114.905872:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.908654:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.914899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.915924:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858315136 00000100:00100000:1.0:1746143114.915933:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858315136 00002000:00100000:1.0:1746143114.915980:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88012baa2a00 x1830962858315136/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.915991:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa2a00 with x1830962858315136 ext(5206016->5210111) 00002000:00010000:1.0:1746143114.915996:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa2a00 00000100:00100000:1.0:1746143114.916333:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5589 00000100:00100000:1.0:1746143114.916342:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858315136:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143114.916776:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858315136:12345-192.168.201.28@tcp:3:cat.0 Request processed in 434us (1884us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143114.916783:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5589 00002000:00100000:1.0:1746143114.916789:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88012baa2a00 x1830962858315136/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:265/0 lens 488/4536 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.916797:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa2a00 with x1830962858315136 ext(5206016->5210111) 00002000:00010000:1.0:1746143114.916800:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa2a00 00000100:00100000:0.0:1746143114.944396:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.946952:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.950172:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5590 00000100:00100000:1.0:1746143114.950183:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858315520:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143114.950743:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858315520:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 561us (3792us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143114.950752:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5590 00002000:00100000:1.0:1746143114.950760:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3338240->3342335) req@ffff88012baa3480 x1830962858315520/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/4536 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.950769:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa3480 with x1830962858315520 ext(3338240->3342335) 00002000:00010000:1.0:1746143114.950773:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa3480 00000100:00100000:0.0:1746143114.958122:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.958391:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858315776 00000100:00100000:1.0:1746143114.958400:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858315776 00002000:00100000:1.0:1746143114.958451:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (4067328->4071423) req@ffff88012baa0a80 x1830962858315776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/0 e 0 to 0 dl 1746143125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.958461:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0a80 with x1830962858315776 ext(4067328->4071423) 00002000:00010000:1.0:1746143114.958467:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa0a80 00000100:00100000:1.0:1746143114.958500:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5591 00000100:00100000:1.0:1746143114.958509:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858315776:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143114.958697:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858315776:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 189us (586us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143114.958703:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5591 00002000:00100000:1.0:1746143114.958709:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (4067328->4071423) req@ffff88012baa0a80 x1830962858315776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:265/0 lens 488/4536 e 0 to 0 dl 1746143125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143114.958716:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0a80 with x1830962858315776 ext(4067328->4071423) 00002000:00010000:1.0:1746143114.958718:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa0a80 00000100:00100000:0.0:1746143114.960692:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.961436:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858315904 00000100:00100000:1.0:1746143114.961444:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858315904 00000100:00100000:1.0:1746143114.961498:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8008 00000100:00100000:1.0:1746143114.961506:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:30528:x1830962858315904:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143114.961542:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.961562:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a600/0x25aee876ca70b3f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed13 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.961626:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.961640:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.961651:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.961663:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.961668:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.961673:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.961781:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.961790:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 221 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.961797:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090029a00/0x25aee876ca70b30a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec33 expref: 31 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.961804:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.961837:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090029a00/0x25aee876ca70b30a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec33 expref: 31 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.961848:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090029a00/0x25aee876ca70b30a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec33 expref: 31 pid: 1037 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.961860:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861121536:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.961958:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 221 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.961965:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 221 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.961973:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861121664:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.961989:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143114.966084:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.966622:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861121536:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.966635:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861121664:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.966660:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:1.0:1746143114.968374:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.972108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.972155:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.972204:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858316544 00000100:00100000:1.0:1746143114.972213:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858316544 00010000:00010000:1.0:1746143114.972248:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090029a00/0x25aee876ca70b30a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec33 expref: 33 pid: 1037 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.972288:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858316672 00000100:00100000:1.0:1746143114.972291:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858316672 00010000:00010000:1.0:1746143114.972303:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 223 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.972318:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6078 00000100:00100000:1.0:1746143114.972325:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1968:x1830962858316544:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.972336:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.972342:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090029a00/0x25aee876ca70b30a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec33 expref: 33 pid: 1037 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.972352:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090029a00/0x25aee876ca70b30a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec33 expref: 33 pid: 1037 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.972375:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090029a00/0x25aee876ca70b30a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec33 expref: 33 pid: 1037 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.972393:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.972398:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.972408:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.972413:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.972419:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.972679:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858316544:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 353us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.972691:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6078 00000100:00100000:1.0:1746143114.972707:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6079 00000100:00100000:1.0:1746143114.972712:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+223:1971:x1830962858316672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143114.972720:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143114.972724:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 223 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.972732:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 223 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.972743:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b2f5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec2c expref: 223 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143114.972751:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.972754:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.972760:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.972767:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.972787:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143114.972803:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+222:1971:x1830962858316672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 90us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.972808:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6079 00010000:00010000:1.0:1746143114.972827:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.972834:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143114.972877:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143114.972882:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143114.973339:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973351:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973587:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973594:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973599:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973605:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135c9a400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143114.973609:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973616:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973624:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143114.973627:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143114.973631:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973635:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a400/0x25aee876ca70b3f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973645:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973651:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973655:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973660:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135c9b800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143114.973662:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973666:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973672:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e924700) 00010000:00010000:1.0:1746143114.973674:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143114.973677:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973681:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9b800/0x25aee876ca70b3ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.973713:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9a600/0x25aee876ca70b3f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed13 expref: 22 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.973725:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed13 expref: 21 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.973732:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143114.973733:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143114.973735:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c9be00, rc 0) 00000100:00100000:1.0:1746143114.973777:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+21:30528:x1830962858315904:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 12272us (13091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.973986:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8008 00000100:00100000:0.0:1746143114.978655:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.978694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.978722:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.978747:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.978764:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143114.980323:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.980410:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858317440 00000100:00100000:1.0:1746143114.980415:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858317440 00000100:00100000:1.0:1746143114.980449:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858317312 00000100:00100000:1.0:1746143114.980451:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858317312 00000100:00100000:0.0:1746143114.980461:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11549 00000100:00100000:0.0:1746143114.980473:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858316928:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143114.980490:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143114.980503:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed21 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.980524:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.980525:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.980544:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143114.980557:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143114.980564:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11550 00000100:00100000:1.0:1746143114.980571:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858317056:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143114.980571:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2a200, rc 0) 00010000:00010000:1.0:1746143114.980579:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.980589:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135c9ba00/0x25aee876ca70b41b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed28 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.980603:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143114.980603:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858316928:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 134us (1909us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143114.980604:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143114.980610:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135c9ba00/0x25aee876ca70b41b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed28 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143114.980610:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11549 00010000:00010000:1.0:1746143114.980622:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135c9ba00/0x25aee876ca70b41b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed28 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143114.980629:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c9ba00, rc 0) 00000100:00100000:0.0:1746143114.980630:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11552 00000100:00100000:0.0:1746143114.980635:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858317312:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143114.980643:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143114.980651:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b429 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed36 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143114.980652:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858317056:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 81us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143114.980659:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11550 00010000:00010000:0.0:1746143114.980670:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b429 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed36 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143114.980678:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e2aa00/0x25aee876ca70b429 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed36 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143114.980691:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2aa00, rc 0) 00000100:00100000:0.0:1746143114.980717:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858317312:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 82us (403us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143114.980723:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11552 00000100:00100000:0.0:1746143114.980736:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11553 00000100:00100000:0.0:1746143114.980742:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858317184:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143114.980973:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143114.980980:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed2f expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.980991:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.980992:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143114.980996:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143114.981005:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143114.981011:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2ac00, rc 0) 00000100:00100000:0.0:1746143114.981026:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858317184:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 285us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143114.981067:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11553 00000100:00100000:0.0:1746143114.988449:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143114.988942:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858317696 00000100:00100000:1.0:1746143114.988952:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858317696 00000100:00100000:1.0:1746143114.989016:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8009 00000100:00100000:1.0:1746143114.989024:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+21:30528:x1830962858317696:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143114.989083:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143114.989104:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647000/0x25aee876ca70b437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed44 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.989207:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b43e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.989221:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed13 expref: 22 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.989228:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b43e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143114.989258:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed13 expref: 22 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143114.989269:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c9be00/0x25aee876ca70b406 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed13 expref: 22 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143114.989280:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861121920:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143114.989358:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143114.993299:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861121920:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143114.993327:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b43e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143114.993710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143114.994561:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b43e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143114.994568:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b43e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:0.0:1746143114.994588:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143114.995332:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647000/0x25aee876ca70b437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed44 expref: 23 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.995588:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b626000/0x25aee876ca70b43e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed44 expref: 22 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143114.995595:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143114.995598:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143114.995601:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b626000, rc 0) 00000100:00100000:0.0:1746143114.995628:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+22:30528:x1830962858317696:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 6605us (7190us total) trans 8589942213 rc 0/0 00000100:00100000:0.0:1746143114.995635:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8009 00000100:00100000:0.0:1746143115.000527:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.006509:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143115.007098:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8da00/0x25aee876ca70b453 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143115.007104:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8da00/0x25aee876ca70b453 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:0.0:1746143115.007148:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143115.007152:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143115.007169:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8da00/0x25aee876ca70b453 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143115.007205:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8d000/0x25aee876ca70b44c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed4b expref: 23 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.007831:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8da00/0x25aee876ca70b453 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed4b expref: 22 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.007839:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143115.007842:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143115.007844:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c8da00, rc 0) 00000100:00100000:0.0:1746143115.008645:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+22:30528:x1830962858317952:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7882us (8127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.008654:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8010 00000100:00100000:0.0:1746143115.012022:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.013956:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.014361:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11554 00000100:00100000:0.0:1746143115.014373:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858318208:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143115.014391:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.014410:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e2b000/0x25aee876ca70b45a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed52 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.014444:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e2b000/0x25aee876ca70b45a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed52 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.014668:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e2b000/0x25aee876ca70b45a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed52 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.014680:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2b000, rc 0) 00000100:00100000:0.0:1746143115.014730:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858318208:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 360us (2720us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143115.014737:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11554 00000100:00100000:0.0:1746143115.014755:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11555 00000100:00100000:0.0:1746143115.014760:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858318336:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143115.014768:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.014777:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e2ae00/0x25aee876ca70b461 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed59 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.014992:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861122176:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143115.015058:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143115.021130:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.030741:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.030783:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.030810:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.033621:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11558 00000100:00100000:1.0:1746143115.033631:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858318848:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:1.0:1746143115.033654:0:20836:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.033666:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5637e00/0x25aee876ca70b31f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec41 expref: 33 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.033673:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.033681:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdbb000/0x25aee876ca70b350 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec72 expref: 18 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.033687:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.033688:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.033690:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.033708:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdbb000/0x25aee876ca70b350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec72 expref: 18 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.033718:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fdbb000/0x25aee876ca70b350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec72 expref: 18 pid: 4756 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.033726:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861122688:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.033775:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.033789:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 8 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.033797:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861122816:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.033824:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5637e00/0x25aee876ca70b31f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec41 expref: 33 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.033831:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5637e00/0x25aee876ca70b31f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec41 expref: 33 pid: 20836 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.033839:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861122944:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.033855:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143115.033889:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.033957:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858319104 00000100:00100000:1.0:1746143115.033963:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858319104 00000100:00100000:1.0:1746143115.033987:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11559 00000100:00100000:1.0:1746143115.033992:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858319104:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:1.0:1746143115.034012:0:8169:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.034023:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.034046:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.034058:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdbac00/0x25aee876ca70b35e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec80 expref: 22 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.034069:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.034070:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.034073:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.034092:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fdbac00/0x25aee876ca70b35e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec80 expref: 22 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.034100:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fdbac00/0x25aee876ca70b35e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec80 expref: 22 pid: 4756 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.034110:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861123072:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.034142:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.034150:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 8 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.034158:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861123200:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.034180:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.034192:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 24 pid: 4756 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.034198:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861123328:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.034213:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143115.037750:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.037836:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.054610:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.054649:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.054690:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143115.058807:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143115.076680:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.076775:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858321920 00000100:00100000:0.0:1746143115.076778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.076784:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858321920 00000100:00100000:0.0:1746143115.076807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.076822:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.077005:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8012 00000100:00100000:0.0:1746143115.077013:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858319872 00000100:00100000:1.0:1746143115.077014:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:30534:x1830962858321920:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:0.0:1746143115.077016:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858319872 00010000:00010000:0.0:1746143115.077067:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdbb000/0x25aee876ca70b350 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec72 expref: 18 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.077068:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143115.077086:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858320128 00000100:00100000:0.0:1746143115.077088:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858320128 00010000:00010000:0.0:1746143115.077098:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5637e00/0x25aee876ca70b31f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec41 expref: 33 pid: 20836 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.077099:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb4000/0x25aee876ca70b4a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed67 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.077110:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858320000 00000100:00100000:0.0:1746143115.077112:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858320000 00010000:00010000:0.0:1746143115.077119:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 8 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143115.077135:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6085 00000100:00100000:0.0:1746143115.077140:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858319872:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143115.077149:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143115.077169:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdbb000/0x25aee876ca70b350 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec72 expref: 18 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143115.077179:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdbb000/0x25aee876ca70b350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec72 expref: 18 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.077197:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb4200/0x25aee876ca70b4ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143115.077203:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143115.077210:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8da00/0x25aee876ca70b453 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed4b expref: 23 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.077216:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8de00/0x25aee876ca70b46f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed60 expref: 23 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.077223:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb4200/0x25aee876ca70b4ae lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143115.077241:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858319872:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 101us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.077247:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6085 00010000:00010000:1.0:1746143115.077249:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8de00/0x25aee876ca70b46f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed60 expref: 23 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.077260:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6086 00010000:00010000:1.0:1746143115.077263:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8de00/0x25aee876ca70b46f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed60 expref: 23 pid: 14796 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143115.077264:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1970:x1830962858320128:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143115.077270:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143115.077275:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861124736:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143115.077276:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5637e00/0x25aee876ca70b31f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec41 expref: 33 pid: 20836 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143115.077284:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5637e00/0x25aee876ca70b31f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec41 expref: 33 pid: 20836 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143115.077295:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143115.077307:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1970:x1830962858320128:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 42us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.077313:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6086 00000100:00100000:0.0:1746143115.077321:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6087 00000100:00100000:0.0:1746143115.077325:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858320000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143115.077332:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.077335:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8da00/0x25aee876ca70b453 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed4b expref: 23 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.077339:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 8 pid: 22204 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.077343:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c8da00/0x25aee876ca70b453 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed4b expref: 23 pid: 14796 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143115.077347:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 8 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.077351:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861124864:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143115.077357:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143115.077360:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143115.077364:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.077368:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746143115.077371:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.077384:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143115.077397:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858320000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 71us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.077401:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6087 00010000:00010000:1.0:1746143115.077405:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdbb000/0x25aee876ca70b350 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec72 expref: 17 pid: 4756 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.077426:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861122688:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.077437:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e2a200/0x25aee876ca70b414 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed21 expref: 7 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.077445:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861122816:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.077460:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861123072:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.077472:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5637e00/0x25aee876ca70b31f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec41 expref: 32 pid: 20836 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.077487:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861122944:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.077507:0:20836:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.077512:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.077523:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861123200:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143115.077523:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858320384 00000100:00100000:0.0:1746143115.077525:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858320384 00000100:00100000:1.0:1746143115.077549:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861123328:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143115.077554:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 25 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.077565:0:8169:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.077573:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6088 00010000:00010000:1.0:1746143115.077577:0:20836:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.077578:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858320384:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143115.077584:0:20836:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.077586:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143115.077598:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 25 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.077602:0:20836:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.077606:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 25 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.077609:0:20836:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.077616:0:20836:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.077618:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b627200/0x25aee876ca70b32d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ec4f expref: 25 pid: 4756 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.077627:0:20836:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b627a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143115.077629:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143115.077632:0:20836:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.077640:0:20836:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.077643:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858320384:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 65us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.077649:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6088 00010000:00010000:1.0:1746143115.077650:0:20836:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.077657:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b627a00/0x25aee876ca70b48b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.077680:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.077690:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858320256 00000100:00100000:0.0:1746143115.077693:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858320256 00000100:00100000:1.0:1746143115.077694:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858318848:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 44066us (46883us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.077702:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11558 00010000:00010000:0.0:1746143115.077702:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 10 pid: 22204 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143115.077714:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6089 00000100:00100000:0.0:1746143115.077718:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858320256:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143115.077726:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143115.077733:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 10 pid: 22204 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143115.077741:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 10 pid: 22204 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143115.077753:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e2ac00/0x25aee876ca70b430 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed2f expref: 10 pid: 22204 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143115.077762:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143115.077775:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858320256:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 56us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.077780:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6089 00000100:00100000:1.0:1746143115.077788:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861123840:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.077860:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861123456:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.078096:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b803480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861123584:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.078104:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861123712:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.078122:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.079230:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.082887:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.083015:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.085480:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858321024 00000100:00100000:1.0:1746143115.085485:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858321024 00010000:00010000:1.0:1746143115.085510:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093114400/0x25aee876ca70b396 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecb8 expref: 22 pid: 4758 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143115.085541:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6092 00000100:00100000:1.0:1746143115.085547:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858321024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143115.085557:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.085571:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093114400/0x25aee876ca70b396 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecb8 expref: 22 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.085582:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093114400/0x25aee876ca70b396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecb8 expref: 22 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.085598:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093114400/0x25aee876ca70b396 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecb8 expref: 22 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.085609:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143115.085636:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858321024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 89us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.085642:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6092 00000100:00100000:1.0:1746143115.085681:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.085692:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858320640 00000100:00100000:1.0:1746143115.085695:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858320640 00010000:00010000:1.0:1746143115.085705:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6773200/0x25aee876ca70b40d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed1a expref: 9 pid: 8449 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143115.085725:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6093 00000100:00100000:1.0:1746143115.085730:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858320640:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143115.085737:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.085745:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6773200/0x25aee876ca70b40d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed1a expref: 9 pid: 8449 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.085753:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6773200/0x25aee876ca70b40d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed1a expref: 9 pid: 8449 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.085764:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6773200/0x25aee876ca70b40d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed1a expref: 9 pid: 8449 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143115.085774:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.085776:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.085781:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085790:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085810:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143115.085824:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858320640:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 94us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.085831:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6093 00010000:00010000:1.0:1746143115.085851:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085864:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085884:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085892:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085899:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085906:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6773800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143115.085910:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085917:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085927:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.085933:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6773800/0x25aee876ca70b47d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.085972:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858318720:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 53812us (55244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.085982:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11556 00000100:00100000:1.0:1746143115.086047:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.086061:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858320896 00000100:00100000:1.0:1746143115.086064:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858320896 00010000:00010000:1.0:1746143115.086075:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c8d600/0x25aee876ca70b3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4489216->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf7 expref: 21 pid: 20836 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143115.086090:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6094 00000100:00100000:1.0:1746143115.086094:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858320896:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143115.086101:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.086108:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c8d600/0x25aee876ca70b3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4489216->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf7 expref: 21 pid: 20836 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.086115:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c8d600/0x25aee876ca70b3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4489216->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf7 expref: 21 pid: 20836 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.086126:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c8d600/0x25aee876ca70b3d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4489216->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf7 expref: 21 pid: 20836 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.086134:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143115.086148:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858320896:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 53us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.086154:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6094 00000100:00100000:1.0:1746143115.086247:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.086257:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858321280 00000100:00100000:0.0:1746143115.087583:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.087619:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.087639:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858321536 00000100:00100000:0.0:1746143115.087643:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858321536 00002000:00100000:0.0:1746143115.087676:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (4128768->4194303) req@ffff880094516300 x1830962858321536/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.087687:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516300 with x1830962858321536 ext(4128768->4194303) 00010000:00010000:0.0:1746143115.087694:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093c8cc00/0x25aee876ca70b3c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [4128768->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ece2 expref: 17 pid: 20836 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143115.087704:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093c8cc00/0x25aee876ca70b3c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [4128768->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ece2 expref: 17 pid: 20836 timeout: 996 lvb_type: 0 00002000:00010000:0.0:1746143115.087717:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094516300 00000100:00100000:0.0:1746143115.087729:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858321152 00000100:00100000:0.0:1746143115.087732:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858321152 00002000:00100000:0.0:1746143115.087745:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4489215) req@ffff880094515880 x1830962858321152/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.087752:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515880 with x1830962858321152 ext(4194304->4489215) 00010000:00010000:0.0:1746143115.087757:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6772400/0x25aee876ca70b3ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->4489215] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf0 expref: 20 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143115.087764:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6772400/0x25aee876ca70b3ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->4489215] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf0 expref: 20 pid: 4758 timeout: 996 lvb_type: 0 00002000:00010000:0.0:1746143115.087770:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094515880 00000100:00100000:0.0:1746143115.087782:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1854 00000100:00100000:0.0:1746143115.087787:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858321536:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143115.087946:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.087958:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858321408 00000100:00100000:0.0:1746143115.087961:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858321408 00010000:00010000:0.0:1746143115.087974:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70b38f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecb1 expref: 32 pid: 4758 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143115.087989:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6095 00000100:00100000:0.0:1746143115.087993:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858321408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143115.088001:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143115.088013:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70b38f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecb1 expref: 32 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143115.088022:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70b38f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecb1 expref: 32 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143115.088060:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70b38f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecb1 expref: 32 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143115.088071:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143115.088091:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858321408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 97us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.088097:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6095 00000100:00100000:0.0:1746143115.088165:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.088180:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858321664 00000100:00100000:0.0:1746143115.088183:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858321664 00002000:00100000:0.0:1746143115.088197:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3338240->4071423) req@ffff880094514000 x1830962858321664/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.088204:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514000 with x1830962858321664 ext(3338240->4071423) 00010000:00010000:0.0:1746143115.088209:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093c8dc00/0x25aee876ca70b3ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3338240->4128767] (req 3338240->4071423) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed0c expref: 31 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143115.088218:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093c8dc00/0x25aee876ca70b3ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3338240->4128767] (req 3338240->4071423) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed0c expref: 31 pid: 4758 timeout: 996 lvb_type: 0 00002000:00010000:0.0:1746143115.088224:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094514000 00000100:00100000:0.0:1746143115.088237:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1855 00000100:00100000:0.0:1746143115.088242:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858321152:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143115.090020:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858321280 00010000:00010000:1.0:1746143115.090052:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd5a00/0x25aee876ca70b39d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecbf expref: 19 pid: 20836 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143115.090077:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6097 00000100:00100000:1.0:1746143115.090083:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858321280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143115.090091:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.090100:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094fd5a00/0x25aee876ca70b39d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecbf expref: 19 pid: 20836 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.090110:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fd5a00/0x25aee876ca70b39d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecbf expref: 19 pid: 20836 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.090126:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fd5a00/0x25aee876ca70b39d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecbf expref: 19 pid: 20836 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.090137:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143115.090156:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858321280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 73us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.090162:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6097 00000100:00100000:1.0:1746143115.090214:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.090231:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858322176 00000100:00100000:1.0:1746143115.090235:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858322176 00000100:00100000:1.0:1746143115.090252:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11562 00000100:00100000:1.0:1746143115.090257:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858322176:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.090268:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.090282:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132eb5000/0x25aee876ca70b4b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed6e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143115.090303:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x68140789, atime: 0x68140787, ctime: 0x68140789, blocks: 0x793 00010000:00010000:1.0:1746143115.090316:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.090318:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.090326:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb5000/0x25aee876ca70b4b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed6e expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090341:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132eb5000/0x25aee876ca70b4b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed6e expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090349:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb5000, rc 0) 00000100:00100000:1.0:1746143115.090367:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858322176:12345-192.168.201.28@tcp:101:cat.0 Request processed in 109us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.090372:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11562 00000100:00100000:1.0:1746143115.090402:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.090413:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858322432 00000100:00100000:1.0:1746143115.090416:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858322432 00000100:00100000:1.0:1746143115.090429:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11563 00000100:00100000:1.0:1746143115.090434:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858322432:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.090441:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.090450:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed7c expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143115.090464:0:20836:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x68140788, atime: 0x68140787, ctime: 0x68140788, blocks: 0x81d 00010000:00010000:1.0:1746143115.090473:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.090474:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.090479:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 19 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090489:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 19 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090496:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb5200, rc 0) 00000100:00100000:1.0:1746143115.090513:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858322432:12345-192.168.201.28@tcp:101:cat.0 Request processed in 79us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.090519:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11563 00000100:00100000:1.0:1746143115.090564:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.090575:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858322688 00000100:00100000:1.0:1746143115.090577:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858322688 00000100:00100000:1.0:1746143115.090591:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11564 00000100:00100000:1.0:1746143115.090596:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858322688:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.090602:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.090609:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132eb5400/0x25aee876ca70b4c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed8a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.090625:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132eb5400/0x25aee876ca70b4c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed8a expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090633:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132eb5400/0x25aee876ca70b4c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed8a expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090641:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb5400, rc 0) 00000100:00100000:1.0:1746143115.090658:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858322688:12345-192.168.201.28@tcp:101:cat.0 Request processed in 62us (95us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.090667:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11564 00000100:00100000:1.0:1746143115.090694:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.090704:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858322304 00000100:00100000:1.0:1746143115.090707:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858322304 00000100:00100000:1.0:1746143115.090718:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11565 00000100:00100000:1.0:1746143115.090723:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858322304:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.090728:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.090737:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132eb5600/0x25aee876ca70b4ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed75 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143115.090748:0:20836:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x68140788, atime: 0x68140786, ctime: 0x68140788, blocks: 0x81f 00010000:00010000:1.0:1746143115.090755:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.090757:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.090761:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132eb5600/0x25aee876ca70b4ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed75 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090771:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132eb5600/0x25aee876ca70b4ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed75 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090779:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb5600, rc 0) 00000100:00100000:1.0:1746143115.090795:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858322304:12345-192.168.201.28@tcp:101:cat.0 Request processed in 72us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.090800:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11565 00000100:00100000:1.0:1746143115.090834:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.090845:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858322560 00000100:00100000:1.0:1746143115.090848:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858322560 00000100:00100000:1.0:1746143115.090861:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11566 00000100:00100000:1.0:1746143115.090866:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858322560:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.090872:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.090878:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132eb5800/0x25aee876ca70b4d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed83 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.090888:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.090894:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132eb5800/0x25aee876ca70b4d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed83 expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090901:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132eb5800/0x25aee876ca70b4d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed83 expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.090908:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb5800, rc 0) 00000100:00100000:1.0:1746143115.090924:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858322560:12345-192.168.201.28@tcp:101:cat.0 Request processed in 58us (90us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.090930:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11566 00000100:00100000:1.0:1746143115.090981:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.090992:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858322816 00000100:00100000:1.0:1746143115.090995:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858322816 00000100:00100000:1.0:1746143115.091008:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11567 00000100:00100000:1.0:1746143115.091013:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858322816:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.091019:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.091025:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132eb5a00/0x25aee876ca70b4d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed91 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.091081:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861124992:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143115.091130:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97840 going to sleep for 11 seconds 00010000:00010000:1.0:1746143115.094576:0:8169:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.094586:0:8169:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.094613:0:8169:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.094621:0:8169:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.094628:0:8169:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.094635:0:8169:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b626e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143115.094639:0:8169:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.094646:0:8169:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.094655:0:8169:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.094661:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b626e00/0x25aee876ca70b492 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.094709:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858319104:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 60715us (60819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.094717:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11559 00000100:00100000:1.0:1746143115.094759:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861124736:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.094825:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.097006:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858321536:12345-192.168.201.28@tcp:4:cat.0 Request processed in 9212us (9419us total) trans 17179872644 rc 0/0 00000100:00100000:0.0:1746143115.097016:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1854 00002000:00100000:0.0:1746143115.097025:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (4128768->4194303) req@ffff880094516300 x1830962858321536/t17179872644(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/448 e 0 to 0 dl 1746143126 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.097060:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516300 with x1830962858321536 ext(4128768->4194303) 00010000:00010000:0.0:1746143115.097070:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093c8cc00/0x25aee876ca70b3c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [4128768->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ece2 expref: 22 pid: 20836 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143115.097082:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093c8cc00/0x25aee876ca70b3c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [4128768->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ece2 expref: 22 pid: 20836 timeout: 996 lvb_type: 0 00002000:00010000:0.0:1746143115.097089:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094516300 00000100:00100000:0.0:1746143115.097180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.097409:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861124864:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.097430:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb4200/0x25aee876ca70b4ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143115.098611:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb4200/0x25aee876ca70b4ae lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143115.098619:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb4200/0x25aee876ca70b4ae lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:1.0:1746143115.098639:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143115.098783:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb4000/0x25aee876ca70b4a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed67 expref: 35 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.098798:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb4200/0x25aee876ca70b4ae lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed67 expref: 34 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.098805:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143115.098808:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143115.098810:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb4200, rc 0) 00000100:00100000:1.0:1746143115.098844:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+34:30534:x1830962858321920:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 21831us (22177us total) trans 8589942215 rc 0/0 00000100:00100000:1.0:1746143115.098855:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8012 00000100:00100000:1.0:1746143115.106001:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861124992:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143115.106064:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132eb5a00/0x25aee876ca70b4d8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed91 expref: 21 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.106080:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132eb5a00/0x25aee876ca70b4d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed91 expref: 21 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.106092:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb5a00, rc 0) 00000100:00100000:1.0:1746143115.106163:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858322816:12345-192.168.201.28@tcp:101:cat.0 Request processed in 15147us (15179us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.106172:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11567 00000100:00100000:1.0:1746143115.116602:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.116630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.116650:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858323200 00000100:00100000:1.0:1746143115.116658:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858323200 00000100:00100000:1.0:1746143115.116693:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858323456 00000100:00100000:1.0:1746143115.116696:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858323456 00000100:00100000:1.0:1746143115.116712:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11568 00000100:00100000:1.0:1746143115.116720:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858323200:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.116739:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.116773:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132eb5e00/0x25aee876ca70b4e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed98 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.116797:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.116800:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.116809:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb5e00/0x25aee876ca70b4e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed98 expref: 24 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.116825:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132eb5e00/0x25aee876ca70b4e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed98 expref: 24 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.116837:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb5e00, rc 0) 00000100:00100000:1.0:1746143115.116883:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858323200:12345-192.168.201.28@tcp:101:cat.0 Request processed in 164us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.116890:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11568 00000100:00100000:1.0:1746143115.116904:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11569 00000100:00100000:1.0:1746143115.116910:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1970:x1830962858323456:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.116917:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.116927:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132eb4e00/0x25aee876ca70b4ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eda6 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.116938:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.116940:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.116943:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132eb4e00/0x25aee876ca70b4ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eda6 expref: 34 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.116953:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132eb4e00/0x25aee876ca70b4ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eda6 expref: 34 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.116959:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb4e00, rc 0) 00000100:00100000:1.0:1746143115.116974:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1970:x1830962858323456:12345-192.168.201.28@tcp:101:cat.0 Request processed in 65us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.116981:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11569 00000100:00100000:1.0:1746143115.117012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.117028:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858323328 00000100:00100000:1.0:1746143115.117045:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858323328 00000100:00100000:1.0:1746143115.117061:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11570 00000100:00100000:1.0:1746143115.117064:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1970:x1830962858323328:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.117070:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.117076:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132eb4400/0x25aee876ca70b4f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ed9f expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.117086:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.117088:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.117092:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132eb4400/0x25aee876ca70b4f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed9f expref: 35 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.117101:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132eb4400/0x25aee876ca70b4f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed9f expref: 35 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.117108:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb4400, rc 0) 00000100:00100000:1.0:1746143115.117123:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858323328:12345-192.168.201.28@tcp:101:cat.0 Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.117127:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11570 00000100:00100000:1.0:1746143115.117173:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.117183:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858323584 00000100:00100000:1.0:1746143115.117186:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858323584 00000100:00100000:1.0:1746143115.117200:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11571 00000100:00100000:1.0:1746143115.117205:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858323584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.117212:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.117220:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164edad expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143115.117239:0:8169:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x68140788, atime: 0x68140788, ctime: 0x68140787, blocks: 0x821 00010000:00010000:1.0:1746143115.117248:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.117250:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.117254:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 25 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.117262:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 25 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.117268:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb4a00, rc 0) 00000100:00100000:1.0:1746143115.117283:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858323584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 77us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.117287:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11571 00000100:00100000:1.0:1746143115.117327:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.117387:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.117395:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858323840 00000100:00100000:1.0:1746143115.117398:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858323840 00000100:00100000:1.0:1746143115.117410:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11572 00000100:00100000:1.0:1746143115.117414:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858323840:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.117419:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.117425:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132eb4c00/0x25aee876ca70b502 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164edb4 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.117447:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132eb4c00/0x25aee876ca70b502 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edb4 expref: 26 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.117456:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132eb4c00/0x25aee876ca70b502 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edb4 expref: 26 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.117465:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb4c00, rc 0) 00000100:00100000:1.0:1746143115.117478:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858323840:12345-192.168.201.28@tcp:101:cat.0 Request processed in 63us (91us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.117482:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11572 00000100:00100000:1.0:1746143115.117498:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858323712 00000100:00100000:1.0:1746143115.117501:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858323712 00010000:00010000:1.0:1746143115.117516:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c8cc00/0x25aee876ca70b3c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [4128768->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ece2 expref: 20 pid: 20836 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143115.117609:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.117624:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858323968 00000100:00100000:0.0:1746143115.117627:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858323968 00000100:00100000:0.0:1746143115.117648:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11573 00000100:00100000:0.0:1746143115.117653:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1971:x1830962858323968:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143115.117659:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.117665:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e2a000/0x25aee876ca70b509 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164edbb expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.117702:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094516680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861125120:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143115.117746:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143115.132353:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858324224 00000100:00100000:1.0:1746143115.132363:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858324224 00010000:00010000:1.0:1746143115.132399:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c8dc00/0x25aee876ca70b3ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3338240->4128767] (req 3338240->4071423) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed0c expref: 35 pid: 4758 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143115.132436:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858324096 00000100:00100000:1.0:1746143115.132438:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858324096 00010000:00010000:1.0:1746143115.132451:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6772400/0x25aee876ca70b3ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->4489215] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf0 expref: 22 pid: 4758 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143115.132477:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6101 00000100:00100000:1.0:1746143115.132484:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858324224:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143115.132501:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.132525:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c8dc00/0x25aee876ca70b3ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3338240->4128767] (req 3338240->4071423) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed0c expref: 35 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.132545:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c8dc00/0x25aee876ca70b3ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3338240->4128767] (req 3338240->4071423) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed0c expref: 35 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.132570:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c8dc00/0x25aee876ca70b3ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3338240->4128767] (req 3338240->4071423) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed0c expref: 35 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.132590:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.132592:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.132597:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093114000/0x25aee876ca70b4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132606:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093114000/0x25aee876ca70b4a0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132641:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143115.132680:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858324224:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 196us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.132686:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6101 00000100:00100000:1.0:1746143115.132700:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6102 00000100:00100000:1.0:1746143115.132705:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858324096:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143115.132713:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.132727:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6772400/0x25aee876ca70b3ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4489215] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf0 expref: 22 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.132741:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6772400/0x25aee876ca70b3ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4489215] (req 4194304->4489215) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf0 expref: 22 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.132753:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6772400/0x25aee876ca70b3ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4489215] (req 4194304->4489215) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ecf0 expref: 22 pid: 4758 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143115.132762:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.132763:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.132766:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132772:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132785:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143115.132798:0:21048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132806:0:21048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132825:0:21048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132831:0:21048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132843:0:21048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132850:0:21048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6772e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143115.132853:0:21048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132859:0:21048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132867:0:21048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.132872:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6772e00/0x25aee876ca70b499 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.132910:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858319232:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 95025us (95172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.132918:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11560 00000100:00100000:1.0:1746143115.132941:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858324096:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 236us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.132945:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6102 00000100:00100000:0.0:1746143115.144733:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858324480 00000100:00100000:0.0:1746143115.144742:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858324480 00002000:00100000:0.0:1746143115.144789:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88008eb21500 x1830962858324480/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.144799:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21500 with x1830962858324480 ext(0->1048575) 00002000:00010000:0.0:1746143115.144804:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21500 00000100:00100000:0.0:1746143115.144820:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858324736 00000100:00100000:0.0:1746143115.144823:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858324736 00002000:00100000:0.0:1746143115.144837:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb22a00 x1830962858324736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.144844:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb22a00 with x1830962858324736 ext(1048576->2097151) 00002000:00010000:0.0:1746143115.144848:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb22a00 00000100:00100000:0.0:1746143115.144859:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858324992 00000100:00100000:0.0:1746143115.144861:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858324992 00002000:00100000:0.0:1746143115.144871:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008eb22680 x1830962858324992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.144878:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb22680 with x1830962858324992 ext(1048576->2097151) 00002000:00010000:0.0:1746143115.144881:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb22680 00000100:00100000:0.0:1746143115.144894:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5592 00000100:00100000:0.0:1746143115.144902:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858324480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143115.157993:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858325248 00000100:00100000:1.0:1746143115.158010:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858325248 00000100:00100000:1.0:1746143115.158123:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8013 00000100:00100000:1.0:1746143115.158133:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+22:30528:x1830962858325248:12345-192.168.201.28@tcp:36:lfs.0 00000100:00100000:1.0:1746143115.158259:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+22:30528:x1830962858325248:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 127us (4574us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746143115.158266:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8013 00000100:00100000:0.0:1746143115.170887:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858325504 00000100:00100000:0.0:1746143115.170899:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858325504 00002000:00100000:0.0:1746143115.170947:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88008eb23b80 x1830962858325504/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.170959:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb23b80 with x1830962858325504 ext(0->1048575) 00002000:00010000:0.0:1746143115.170966:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb23b80 00000100:00100000:0.0:1746143115.171002:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5595 00000100:00100000:0.0:1746143115.171011:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858325504:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143115.175371:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858326272 00000100:00100000:1.0:1746143115.175381:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858326272 00002000:00100000:1.0:1746143115.175416:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800919df800 x1830962858326272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143115.175426:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919df800 with x1830962858326272 ext(1048576->2097151) 00002000:00010000:1.0:1746143115.175430:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919df800 00000100:00100000:1.0:1746143115.175449:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5597 00000100:00100000:1.0:1746143115.175455:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858326016:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143115.188805:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858326528 00000100:00100000:0.0:1746143115.188812:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858326528 00000100:00100000:0.0:1746143115.188857:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3359 00000100:00100000:0.0:1746143115.188862:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+22:30528:x1830962858326528:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:0.0:1746143115.189063:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+23:30528:x1830962858326528:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 200us (1388us total) trans 8589942216 rc 0/0 00000100:00100000:0.0:1746143115.189068:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3359 00000100:00100000:1.0:1746143115.197322:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858325504:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26299us (26934us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143115.197335:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5595 00002000:00100000:1.0:1746143115.197545:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88008eb23b80 x1830962858325504/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/440 e 0 to 0 dl 1746143126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143115.197556:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb23b80 with x1830962858325504 ext(0->1048575) 00002000:00010000:1.0:1746143115.197563:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb23b80 00000100:00100000:0.0:1746143115.201731:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.201801:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858327040 00000100:00100000:0.0:1746143115.201810:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858327040 00000100:00100000:1.0:1746143115.201837:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858326784 00000100:00100000:1.0:1746143115.201840:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858326784 00000100:00100000:1.0:1746143115.201864:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3360 00000100:00100000:0.0:1746143115.201864:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8014 00000100:00100000:1.0:1746143115.201871:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+23:30528:x1830962858326784:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:0.0:1746143115.201871:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+222:30539:x1830962858327040:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143115.201896:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.201915:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b510 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164edc2 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.201982:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5200/0x25aee876ca70b517 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143115.201996:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5200/0x25aee876ca70b517 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143115.202008:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5200/0x25aee876ca70b517 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143115.202017:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143115.202104:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd4800/0x25aee876ca70b510 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edc2 expref: 225 pid: 1037 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.202110:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+24:30528:x1830962858326784:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 239us (389us total) trans 8589942217 rc 0/0 00000100:00100000:1.0:1746143115.202120:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3360 00010000:00010000:0.0:1746143115.202121:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5200/0x25aee876ca70b517 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edc2 expref: 224 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.202128:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143115.202131:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143115.202134:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd5200, rc 0) 00000100:00100000:0.0:1746143115.202152:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+224:30539:x1830962858327040:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 281us (380us total) trans 8589942218 rc 0/0 00000100:00100000:0.0:1746143115.202157:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8014 00000100:00100000:0.0:1746143115.211917:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.218255:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.227779:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.231462:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.241661:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.246595:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.246668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.247065:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858328320 00000100:00100000:1.0:1746143115.247074:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858328320 00000100:00100000:1.0:1746143115.247305:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11577 00000100:00100000:1.0:1746143115.247313:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1970:x1830962858328320:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.247326:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.247541:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f408400/0x25aee876ca70b53a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164edde expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143115.247566:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x68140789, atime: 0x68140789, ctime: 0x68140789, blocks: 0x102b 00010000:00010000:1.0:1746143115.247584:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.247586:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.247595:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f408400/0x25aee876ca70b53a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edde expref: 35 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.247613:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f408400/0x25aee876ca70b53a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edde expref: 35 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.247625:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408400, rc 0) 00000100:00100000:1.0:1746143115.247659:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858328320:12345-192.168.201.28@tcp:101:cat.0 Request processed in 347us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.247665:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11577 00000100:00100000:0.0:1746143115.273389:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.277612:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.285977:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.311986:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.316537:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.322647:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.345138:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.361013:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.363847:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.364004:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.365097:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858330240 00000100:00100000:0.0:1746143115.365104:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858330240 00002000:00100000:0.0:1746143115.365152:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009a70b480 x1830962858330240/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.365162:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70b480 with x1830962858330240 ext(3145728->4194303) 00002000:00010000:0.0:1746143115.365167:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a70b480 00000100:00100000:0.0:1746143115.365180:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858330112 00000100:00100000:0.0:1746143115.365182:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858330112 00002000:00100000:0.0:1746143115.365190:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009a709c00 x1830962858330112/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.365197:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a709c00 with x1830962858330112 ext(2097152->3145727) 00002000:00010000:0.0:1746143115.365199:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a709c00 00000100:00100000:0.0:1746143115.365216:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5604 00000100:00100000:0.0:1746143115.365222:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1970:x1830962858330240:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143115.367167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.367193:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858330496 00000100:00100000:0.0:1746143115.367197:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858330496 00002000:00100000:0.0:1746143115.367225:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5c46d80 x1830962858330496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.367243:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c46d80 with x1830962858330496 ext(3145728->4194303) 00002000:00010000:0.0:1746143115.367248:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c46d80 00000100:00100000:0.0:1746143115.367263:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5605 00000100:00100000:0.0:1746143115.367269:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858330112:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143115.377658:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.377709:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.431766:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.435091:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.438072:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.442787:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.450228:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.450321:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.455191:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.460604:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.462409:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.462443:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858332544 00000100:00100000:0.0:1746143115.462447:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858332544 00002000:00100000:0.0:1746143115.462471:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3133440->3137535) req@ffff88009f397480 x1830962858332544/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.462481:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f397480 with x1830962858332544 ext(3133440->3137535) 00002000:00010000:0.0:1746143115.462486:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f397480 00000100:00100000:0.0:1746143115.462522:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5610 00000100:00100000:0.0:1746143115.462538:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858332544:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143115.462671:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858332544:12345-192.168.201.28@tcp:3:cat.0 Request processed in 133us (261us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143115.462677:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5610 00002000:00100000:0.0:1746143115.462682:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3133440->3137535) req@ffff88009f397480 x1830962858332544/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/4536 e 0 to 0 dl 1746143126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.462690:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f397480 with x1830962858332544 ext(3133440->3137535) 00002000:00010000:0.0:1746143115.462693:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f397480 00000100:00100000:0.0:1746143115.465592:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.469181:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.469257:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.472125:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.480357:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.480390:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.480668:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.480746:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858333440 00000100:00100000:1.0:1746143115.480755:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858333440 00000100:00100000:1.0:1746143115.480784:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858333312 00000100:00100000:1.0:1746143115.480786:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858333312 00000100:00100000:1.0:1746143115.480803:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11588 00000100:00100000:1.0:1746143115.480809:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858333440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.481045:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.481063:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66da00/0x25aee876ca70b587 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee32 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.481092:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.481104:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66da00/0x25aee876ca70b587 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee32 expref: 37 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.481283:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66da00/0x25aee876ca70b587 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee32 expref: 37 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.481300:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66da00, rc 0) 00000100:00100000:1.0:1746143115.481341:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858333440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 531us (986us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.481347:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11588 00000100:00100000:1.0:1746143115.481359:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11589 00000100:00100000:1.0:1746143115.481364:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858333312:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.481371:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.481381:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b66d200/0x25aee876ca70b58e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee2b expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.481401:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b66d200/0x25aee876ca70b58e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee2b expref: 28 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.481409:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b66d200/0x25aee876ca70b58e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee2b expref: 28 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.481416:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66d200, rc 0) 00000100:00100000:1.0:1746143115.481432:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858333312:12345-192.168.201.28@tcp:101:cat.0 Request processed in 68us (1042us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.481437:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11589 00010000:00010000:1.0:1746143115.482172:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143115.483152:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.492754:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.620914:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.623245:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.653232:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.664960:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861126528:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.664990:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092c6c800/0x25aee876ca70b5a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee47 expref: 26 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.665009:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c6c800, rc 0) 00000100:00100000:1.0:1746143115.665072:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30549:x1830962858334336:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9981us (11850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.665081:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11592 00000100:00100000:1.0:1746143115.666150:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.680421:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.723684:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858334848 00000100:00100000:0.0:1746143115.723694:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858334848 00002000:00100000:0.0:1746143115.723742:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88012baa0e00 x1830962858334848/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143115.723753:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0e00 with x1830962858334848 ext(2097152->3145727) 00002000:00010000:0.0:1746143115.723759:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0e00 00000100:00100000:0.0:1746143115.723790:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5613 00000100:00100000:0.0:1746143115.723797:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858334848:12345-192.168.201.28@tcp:3:multiop.0 00000001:00080000:1.0:1746143115.742003:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942218 is committed 00000001:00080000:1.0:1746143115.742022:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942216 is committed 00000001:00080000:1.0:1746143115.742044:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942200 is committed 00000001:00080000:1.0:1746143115.742079:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942217 is committed 00000001:00080000:1.0:1746143115.742089:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942215 is committed 00000100:00100000:0.0:1746143115.747529:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.747586:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.747640:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858335104 00000100:00100000:1.0:1746143115.747649:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858335104 00000100:00100000:1.0:1746143115.747698:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11593 00000100:00100000:1.0:1746143115.747707:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858335104:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.747731:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.747753:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee55 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.748811:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.748813:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.748826:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 29 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.748845:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 29 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.748859:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66ca00, rc 0) 00000100:00100000:1.0:1746143115.748923:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858335104:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1216us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.748929:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11593 00000100:00100000:0.0:1746143115.759901:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.759942:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.759972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.760005:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.760165:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858335488 00000100:00100000:0.0:1746143115.760171:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858335488 00000100:00100000:0.0:1746143115.760211:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858335616 00000100:00100000:0.0:1746143115.760218:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858335616 00000100:00100000:0.0:1746143115.760239:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11594 00000100:00100000:0.0:1746143115.760245:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30549:x1830962858335488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143115.760262:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.760279:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cf4000/0x25aee876ca70b5cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee5c expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.760303:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092c6d200/0x25aee876ca70b579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee1d expref: 34 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.760310:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143115.760312:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143115.760315:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cf4000/0x25aee876ca70b5cd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee5c expref: 20 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.760341:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092c6d200/0x25aee876ca70b579 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee1d expref: 34 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.760352:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092c6d200/0x25aee876ca70b579 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee1d expref: 34 pid: 20836 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746143115.760362:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861127040:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.760370:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11595 00000100:00100000:1.0:1746143115.760378:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30543:x1830962858335616:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143115.760388:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.760400:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee63 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.760417:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092c6c800/0x25aee876ca70b5a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee47 expref: 27 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.760417:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746143115.760426:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 28 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.760433:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.760434:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.760437:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.760454:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 28 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.760462:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 28 pid: 22204 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746143115.760471:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861127168:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.760503:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092c6c800/0x25aee876ca70b5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee47 expref: 27 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.760510:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092c6c800/0x25aee876ca70b5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee47 expref: 27 pid: 22204 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143115.760532:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861127296:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143115.760551:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53ccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143115.771893:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.771914:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861127168:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143115.774021:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.774071:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.774292:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.774842:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.774861:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.774877:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.774893:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.774935:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858336256 00000100:00100000:0.0:1746143115.774938:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858336256 00000100:00100000:0.0:1746143115.774955:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858336384 00000100:00100000:0.0:1746143115.774957:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858336384 00000100:00100000:0.0:1746143115.774966:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858336512 00000100:00100000:0.0:1746143115.774968:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858336512 00000100:00100000:0.0:1746143115.774980:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11599 00000100:00100000:0.0:1746143115.774984:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858336256:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143115.774990:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.774997:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cf4e00/0x25aee876ca70b5f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee7f expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.775008:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143115.775009:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143115.775014:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cf4e00/0x25aee876ca70b5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee7f expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.775023:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cf4e00/0x25aee876ca70b5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee7f expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.775049:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cf4e00, rc 0) 00000100:00100000:0.0:1746143115.775069:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858336256:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.775074:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11599 00000100:00100000:0.0:1746143115.775086:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11600 00000100:00100000:0.0:1746143115.775090:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858336384:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143115.775096:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.775102:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cf5000/0x25aee876ca70b5f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee86 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.775177:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143115.775187:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cf5000/0x25aee876ca70b5f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee86 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.775195:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cf5000/0x25aee876ca70b5f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee86 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.775207:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cf5000, rc 0) 00000100:00100000:0.0:1746143115.775222:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858336384:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 132us (360us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143115.775227:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11600 00000100:00100000:0.0:1746143115.775239:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11601 00000100:00100000:0.0:1746143115.775243:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858336512:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143115.775249:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.775255:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cf4800/0x25aee876ca70b5fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee8d expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143115.775290:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091983480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861127424:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143115.775354:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861127296:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143115.775377:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.775392:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66cc00, rc 0) 00000100:00100000:1.0:1746143115.775411:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:30543:x1830962858335616:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 15034us (15404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.775425:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11595 00000100:00100000:0.0:1746143115.780150:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143115.791944:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.791991:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.792015:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858337024 00000100:00100000:0.0:1746143115.792024:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858337024 00000100:00100000:0.0:1746143115.792091:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11602 00000100:00100000:0.0:1746143115.792098:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:30552:x1830962858337024:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143115.792117:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.792135:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ee94 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.792164:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 32 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.792172:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cf4e00/0x25aee876ca70b5f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee7f expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.792179:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70b525 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edc9 expref: 26 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.792186:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143115.792187:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143115.792191:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [2084864->2097151] (req 2084864->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 32 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.793940:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70b525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edc9 expref: 25 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.793952:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70b525 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edc9 expref: 25 pid: 754 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746143115.793964:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091980000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861127552:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143115.794017:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cf4e00/0x25aee876ca70b5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee7f expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.794025:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cf4e00/0x25aee876ca70b5f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee7f expref: 6 pid: 754 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746143115.794050:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091981f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861127680:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143115.794492:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 32 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.794501:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 32 pid: 8169 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746143115.794509:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091981880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861127808:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143115.794539:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801369099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143115.794582:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091983480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861127424:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143115.794608:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cf4800/0x25aee876ca70b5fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee8d expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.794619:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cf4800/0x25aee876ca70b5fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee8d expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.795152:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cf4800, rc 0) 00000100:00100000:0.0:1746143115.795175:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858336512:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 19930us (20296us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143115.795185:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11601 00000100:00100000:0.0:1746143115.800128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.800148:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.800185:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.800577:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091980000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861127552:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143115.800587:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091981f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861127680:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143115.800594:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091981880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861127808:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143115.800631:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [2084864->2097151] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.800650:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cf5600, rc 0) 00000100:00100000:0.0:1746143115.800692:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30552:x1830962858337024:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8593us (8699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143115.800701:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11602 00000100:00100000:1.0:1746143115.803260:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.805659:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858337664 00000100:00100000:0.0:1746143115.805667:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858337664 00010000:00010000:0.0:1746143115.805691:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 30 pid: 8169 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746143115.805715:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6114 00000100:00100000:0.0:1746143115.805721:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858337664:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143115.805729:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143115.805730:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143115.805743:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 30 pid: 8169 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746143115.805748:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858337792 00000100:00100000:1.0:1746143115.805752:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858337792 00010000:00010000:0.0:1746143115.805753:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 30 pid: 8169 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746143115.805770:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c600/0x25aee876ca70b5c6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee4e expref: 9 pid: 14796 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143115.805772:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132eb4a00/0x25aee876ca70b4fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164edad expref: 30 pid: 8169 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746143115.805783:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143115.805785:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143115.805789:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6115 00010000:00010000:0.0:1746143115.805792:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.805795:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858337792:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143115.805800:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.805803:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.805809:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c600/0x25aee876ca70b5c6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee4e expref: 9 pid: 14796 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143115.805817:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c600/0x25aee876ca70b5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee4e expref: 9 pid: 14796 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143115.805830:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.805832:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143115.805837:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c200/0x25aee876ca70b613 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143115.805843:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091981880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861128064:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143115.805849:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c200/0x25aee876ca70b613 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143115.805855:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c200/0x25aee876ca70b613 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143115.805868:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143115.805886:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858337792:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.805892:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6115 00000100:00100000:0.0:1746143115.805892:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801369099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143115.812203:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.812256:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.812306:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858338176 00000100:00100000:1.0:1746143115.812311:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858338176 00000100:00100000:1.0:1746143115.812347:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11603 00000100:00100000:1.0:1746143115.812353:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:30555:x1830962858338176:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.812366:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.812381:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66c600/0x25aee876ca70b621 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eea2 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.812403:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143115.812409:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b66c600/0x25aee876ca70b621 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eea2 expref: 38 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.812419:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66c600/0x25aee876ca70b621 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eea2 expref: 38 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.812428:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66c600, rc 0) 00000100:00100000:1.0:1746143115.812450:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:30555:x1830962858338176:12345-192.168.201.28@tcp:101:cat.0 Request processed in 98us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.812458:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11603 00000100:00100000:0.0:1746143115.816212:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.816250:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.818056:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.818088:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.818140:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858338560 00000100:00100000:1.0:1746143115.818145:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858338560 00010000:00010000:1.0:1746143115.818164:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 29 pid: 22204 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746143115.818186:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6117 00000100:00100000:1.0:1746143115.818192:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858338560:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143115.818201:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143115.818218:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 29 pid: 22204 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746143115.818227:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 29 pid: 22204 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746143115.818240:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70b5aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee55 expref: 29 pid: 22204 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746143115.818255:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.818256:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143115.818262:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.818269:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.818290:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.818299:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861128576:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143115.818350:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53ccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143115.826001:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.827793:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861128576:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143115.827811:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143115.827847:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858338560:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9654us (9758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143115.827853:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6117 00000100:00100000:1.0:1746143115.830639:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.831235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.841603:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.841635:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858340096 00000100:00100000:1.0:1746143115.841642:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858340096 00000100:00100000:1.0:1746143115.841696:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11605 00000100:00100000:1.0:1746143115.841704:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858340096:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143115.841722:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.841741:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f763600/0x25aee876ca70b63d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eeb7 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143115.841799:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861128704:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143115.844620:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53ccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143115.844669:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.844755:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11607 00000100:00100000:0.0:1746143115.844763:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858340224:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143115.844775:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.844786:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cf5e00/0x25aee876ca70b64b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eebe expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.844807:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cf5e00/0x25aee876ca70b64b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eebe expref: 9 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.844818:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cf5e00/0x25aee876ca70b64b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eebe expref: 9 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.844835:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cf5e00, rc 0) 00000100:00100000:0.0:1746143115.844872:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858340224:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 109us (1543us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143115.844878:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11607 00000100:00100000:1.0:1746143115.851372:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:1.0:1746143115.852235:0:8448:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143112 -> 1746143114 00002000:00010000:1.0:1746143115.852240:0:8448:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143112 -> 1746143114 00002000:00010000:1.0:1746143115.852243:0:8448:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143111 -> 1746143114 00000100:00100000:1.0:1746143115.852265:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861128704:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143115.852298:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f763600/0x25aee876ca70b63d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb7 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.852312:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f763600/0x25aee876ca70b63d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb7 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.852328:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f763600, rc 0) 00000100:00100000:1.0:1746143115.853677:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858340096:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 11972us (12084us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.853683:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11605 00000100:00100000:0.0:1746143115.875176:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.875220:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.875277:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858341376 00000100:00100000:1.0:1746143115.875286:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858341376 00000100:00100000:1.0:1746143115.878779:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858341504 00000100:00100000:1.0:1746143115.878988:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858341504 00000100:00100000:1.0:1746143115.882293:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1968:x1830962858340608:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 37010us (37615us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143115.882306:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5620 00002000:00100000:1.0:1746143115.882317:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009a70ad80 x1830962858340608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/440 e 0 to 0 dl 1746143126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143115.882326:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70ad80 with x1830962858340608 ext(3145728->4194303) 00010000:00010000:1.0:1746143115.882337:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b66c600/0x25aee876ca70b621 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eea2 expref: 39 pid: 8448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143115.882349:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b66c600/0x25aee876ca70b621 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eea2 expref: 39 pid: 8448 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143115.882357:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a70ad80 00000100:00100000:0.0:1746143115.883948:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.891057:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.891097:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.891139:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.905754:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.905826:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.918352:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.918611:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858342784 00000100:00100000:1.0:1746143115.919055:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858342784 00002000:00100000:1.0:1746143115.919093:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880093b59880 x1830962858342784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143115.919100:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59880 with x1830962858342784 ext(3145728->4194303) 00002000:00010000:1.0:1746143115.919103:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b59880 00000100:00100000:1.0:1746143115.919118:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5622 00000100:00100000:1.0:1746143115.919124:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1971:x1830962858342784:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143115.922436:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.933436:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.936174:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.937438:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1971:x1830962858342784:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 18312us (19105us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143115.937448:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5622 00002000:00100000:1.0:1746143115.937476:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880093b59880 x1830962858342784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:266/0 lens 488/440 e 0 to 0 dl 1746143126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143115.939166:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59880 with x1830962858342784 ext(3145728->4194303) 00002000:00010000:1.0:1746143115.939173:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b59880 00000100:00100000:0.0:1746143115.944545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.944677:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.945013:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858343552 00000100:00100000:1.0:1746143115.945023:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858343552 00000100:00100000:1.0:1746143115.945113:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858343680 00000100:00100000:1.0:1746143115.945116:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858343680 00000100:00100000:1.0:1746143115.945135:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11612 00000100:00100000:1.0:1746143115.945144:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858343552:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.945164:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.945185:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090ff1c00/0x25aee876ca70b67c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eeef expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.945220:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090ff1c00/0x25aee876ca70b67c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeef expref: 30 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.945230:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090ff1c00/0x25aee876ca70b67c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeef expref: 30 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.945245:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090ff1c00, rc 0) 00000100:00100000:1.0:1746143115.945303:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858343552:12345-192.168.201.28@tcp:101:cat.0 Request processed in 159us (770us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.945309:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11612 00000100:00100000:1.0:1746143115.945325:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11613 00000100:00100000:1.0:1746143115.945330:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858343680:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143115.945336:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143115.945345:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090ff0800/0x25aee876ca70b683 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eef6 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143115.945361:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090ff0800/0x25aee876ca70b683 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eef6 expref: 38 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.945370:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090ff0800/0x25aee876ca70b683 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eef6 expref: 38 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143115.945382:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090ff0800, rc 0) 00000100:00100000:1.0:1746143115.945400:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858343680:12345-192.168.201.28@tcp:101:cat.0 Request processed in 70us (723us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143115.945405:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11613 00000100:00100000:0.0:1746143115.952810:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.954284:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.954352:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.954449:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858344064 00000100:00100000:1.0:1746143115.954460:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858344064 00002000:00100000:1.0:1746143115.954509:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880093b5a680 x1830962858344064/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143115.954531:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5a680 with x1830962858344064 ext(3145728->4194303) 00002000:00010000:1.0:1746143115.954537:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5a680 00000100:00100000:1.0:1746143115.954556:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5624 00000100:00100000:1.0:1746143115.954564:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858344064:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143115.954698:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11615 00000100:00100000:0.0:1746143115.954705:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858343808:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143115.954715:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143115.954727:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cf5e00/0x25aee876ca70b691 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164eefd expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143115.954746:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cf5e00/0x25aee876ca70b691 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eefd expref: 30 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.954754:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cf5e00/0x25aee876ca70b691 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eefd expref: 30 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143115.954767:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cf5e00, rc 0) 00000100:00100000:0.0:1746143115.954784:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858343808:12345-192.168.201.28@tcp:101:cat.0 Request processed in 81us (433us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143115.954789:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11615 00000100:00100000:0.0:1746143115.964881:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.969825:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.972342:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858344064:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 17767us (19531us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143115.972354:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5624 00002000:00100000:1.0:1746143115.972364:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880093b5a680 x1830962858344064/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/440 e 0 to 0 dl 1746143126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143115.972374:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5a680 with x1830962858344064 ext(3145728->4194303) 00002000:00010000:1.0:1746143115.972380:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5a680 00000100:00100000:0.0:1746143115.998157:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.998615:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.998745:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143115.999000:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143115.999665:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858344704 00000100:00100000:1.0:1746143115.999676:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858344704 00002000:00100000:1.0:1746143115.999737:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff880093b59180 x1830962858344704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/0 e 0 to 0 dl 1746143126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143115.999755:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59180 with x1830962858344704 ext(4194304->5206015) 00002000:00010000:1.0:1746143115.999762:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59180 00000100:00100000:1.0:1746143115.999795:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5625 00000100:00100000:1.0:1746143115.999805:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858344704:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143116.000254:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858345088 00000100:00100000:0.0:1746143116.000258:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858345088 00000100:00100000:0.0:1746143116.000287:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11619 00000100:00100000:0.0:1746143116.000293:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858344960:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143116.000302:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143116.000311:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cf5400/0x25aee876ca70b6ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ef20 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.000331:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cf5400/0x25aee876ca70b6ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef20 expref: 30 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143116.000341:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cf5400/0x25aee876ca70b6ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef20 expref: 30 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143116.000356:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cf5400, rc 0) 00000100:00100000:0.0:1746143116.001353:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1968:x1830962858344960:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1056us (2605us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143116.001360:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11619 00000100:00100000:0.0:1746143116.015814:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143116.018666:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143116.022931:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.023760:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858344704:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 23954us (25612us total) trans 0 rc 1011712/1011712 00000100:00100000:1.0:1746143116.023975:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5625 00002000:00100000:1.0:1746143116.023988:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff880093b59180 x1830962858344704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:266/0 lens 488/440 e 0 to 0 dl 1746143126 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.023999:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59180 with x1830962858344704 ext(4194304->5206015) 00002000:00010000:1.0:1746143116.024005:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59180 00000100:00080000:0.0:1746143116.025314:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143116.038663:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.038703:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.041098:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.041118:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858345856 00000100:00100000:1.0:1746143116.041121:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858345856 00000100:00100000:1.0:1746143116.041579:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11622 00000100:00100000:1.0:1746143116.041586:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858345728:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.041593:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.041601:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090ff1200/0x25aee876ca70b6d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ef3c expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.041620:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090ff1200/0x25aee876ca70b6d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef3c expref: 29 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.041630:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090ff1200/0x25aee876ca70b6d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef3c expref: 29 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.041650:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090ff1200, rc 0) 00000100:00100000:1.0:1746143116.041673:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858345728:12345-192.168.201.28@tcp:101:cat.0 Request processed in 88us (2969us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143116.041679:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11622 00000100:00100000:1.0:1746143116.041696:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11623 00000100:00100000:1.0:1746143116.042373:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858345856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.042390:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.042404:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090ff1000/0x25aee876ca70b6de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ef43 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.042427:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090ff1000/0x25aee876ca70b6de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef43 expref: 22 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.042437:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090ff1000/0x25aee876ca70b6de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef43 expref: 22 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.042446:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090ff1000, rc 0) 00000100:00100000:1.0:1746143116.042474:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858345856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 771us (1376us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143116.042480:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11623 00000100:00100000:0.0:1746143116.060017:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.060159:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.061017:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.061319:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858346240 00000100:00100000:0.0:1746143116.061322:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858346240 00000100:00100000:0.0:1746143116.061349:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11626 00000100:00100000:0.0:1746143116.061354:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858346240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143116.061362:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143116.061372:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092abde00/0x25aee876ca70b6f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ef58 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.061389:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092abde00/0x25aee876ca70b6f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef58 expref: 22 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143116.061396:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092abde00/0x25aee876ca70b6f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef58 expref: 22 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143116.061405:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092abde00, rc 0) 00000100:00100000:0.0:1746143116.061421:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858346240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 67us (405us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143116.061425:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11626 00000100:00100000:0.0:1746143116.120867:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.120919:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143116.121741:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143116.121745:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143116.129970:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.130077:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858346752 00000100:00100000:1.0:1746143116.130086:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858346752 00002000:00100000:1.0:1746143116.130138:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2084863) req@ffff88009194a680 x1830962858346752/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.130156:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194a680 with x1830962858346752 ext(1048576->2084863) 00002000:00010000:1.0:1746143116.130162:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194a680 00000100:00100000:1.0:1746143116.130184:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5626 00000100:00100000:1.0:1746143116.130193:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858346752:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143116.141765:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.142350:0:14792:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858346880 00000100:00100000:1.0:1746143116.142360:0:14792:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858346880 00000100:00100000:1.0:1746143116.142425:0:14792:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 224 00000100:00100000:1.0:1746143116.142434:0:14792:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1969:x1830962858346880:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:1.0:1746143116.142496:0:14792:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1969:x1830962858346880:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 63us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.142503:0:14792:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 224 00000100:00100000:1.0:1746143116.144806:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858346752:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14605us (14840us total) trans 0 rc 1036288/1036288 00000100:00100000:1.0:1746143116.144818:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5626 00002000:00100000:1.0:1746143116.144829:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2084863) req@ffff88009194a680 x1830962858346752/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.144840:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194a680 with x1830962858346752 ext(1048576->2084863) 00002000:00010000:1.0:1746143116.144846:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194a680 00000100:00100000:0.0:1746143116.156665:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.157223:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858347008 00000100:00100000:1.0:1746143116.157233:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858347008 00000100:00100000:1.0:1746143116.157343:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11629 00000100:00100000:1.0:1746143116.157351:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30566:x1830962858347008:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.157371:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.157389:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ef6d expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.157419:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4200/0x25aee876ca70b636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->2768895] (req 2097152->2449407) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb0 expref: 30 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.157428:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.157434:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143116.157435:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143116.157438:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 5/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2449408->3145727] (req 2449408->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.157463:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.157474:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 25 pid: 21048 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143116.157485:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861129856:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.159202:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4200/0x25aee876ca70b636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->2768895] (req 2097152->2449407) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb0 expref: 30 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.159217:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4200/0x25aee876ca70b636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->2768895] (req 2097152->2449407) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb0 expref: 30 pid: 754 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143116.159230:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861129984:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143116.160115:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.169659:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861129856:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143116.169683:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.169776:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861129984:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143116.169806:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143116.169808:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2449408->3145727] (req 2449408->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.169828:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090ff0a00, rc 0) 00000100:00100000:0.0:1746143116.169841:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858347136 00000100:00100000:0.0:1746143116.169847:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858347136 00000100:00100000:1.0:1746143116.169876:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30566:x1830962858347008:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12524us (13221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.169885:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11629 00002000:00100000:0.0:1746143116.169893:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2772992->3145727) req@ffff880091948700 x1830962858347136/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.169902:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948700 with x1830962858347136 ext(2772992->3145727) 00010000:00010000:0.0:1746143116.169909:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 26 pid: 21048 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143116.169923:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 26 pid: 21048 timeout: 998 lvb_type: 0 00002000:00010000:0.0:1746143116.169930:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091948700 00000100:00100000:0.0:1746143116.169952:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1863 00000100:00100000:0.0:1746143116.169959:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858347136:12345-192.168.201.28@tcp:4:cat.0 00000100:00080000:1.0:1746143116.170234:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143116.175044:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858347264 00000100:00100000:1.0:1746143116.175053:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858347264 00002000:00100000:1.0:1746143116.175092:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2449407) req@ffff88009fb54380 x1830962858347264/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.175102:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb54380 with x1830962858347264 ext(2097152->2449407) 00010000:00010000:1.0:1746143116.175112:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4200/0x25aee876ca70b636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->2768895] (req 2097152->2449407) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb0 expref: 30 pid: 754 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143116.175125:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4200/0x25aee876ca70b636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->2768895] (req 2097152->2449407) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb0 expref: 30 pid: 754 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746143116.175132:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb54380 00000100:00100000:1.0:1746143116.175160:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1864 00000100:00100000:1.0:1746143116.175168:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858347264:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143116.183507:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858347136:12345-192.168.201.28@tcp:4:cat.0 Request processed in 13535us (13688us total) trans 21474839895 rc 0/0 00000100:00100000:1.0:1746143116.183532:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1863 00002000:00100000:1.0:1746143116.183546:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (2772992->3145727) req@ffff880091948700 x1830962858347136/t21474839895(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/448 e 0 to 0 dl 1746143127 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.183557:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948700 with x1830962858347136 ext(2772992->3145727) 00010000:00010000:1.0:1746143116.183568:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 28 pid: 21048 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.183584:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b66cc00/0x25aee876ca70b5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee63 expref: 28 pid: 21048 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746143116.183590:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091948700 00000100:00100000:1.0:1746143116.186191:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858347264:12345-192.168.201.28@tcp:4:cat.0 Request processed in 11013us (11199us total) trans 21474839896 rc 0/0 00000100:00100000:1.0:1746143116.186203:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1864 00002000:00100000:1.0:1746143116.186214:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2449407) req@ffff88009fb54380 x1830962858347264/t21474839896(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/448 e 0 to 0 dl 1746143127 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.186222:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb54380 with x1830962858347264 ext(2097152->2449407) 00010000:00010000:1.0:1746143116.186233:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4200/0x25aee876ca70b636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->2768895] (req 2097152->2449407) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb0 expref: 32 pid: 754 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.186245:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a51b4200/0x25aee876ca70b636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->2768895] (req 2097152->2449407) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eeb0 expref: 32 pid: 754 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746143116.186256:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb54380 00000100:00100000:0.0:1746143116.192737:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.196963:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858347904 00000100:00100000:1.0:1746143116.196971:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858347904 00000100:00100000:1.0:1746143116.197177:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11630 00000100:00100000:1.0:1746143116.197185:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858347904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.197203:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.197219:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c474400/0x25aee876ca70b724 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ef7b expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143116.197282:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861130240:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143116.197563:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143116.197930:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.199293:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.204203:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.204228:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858348416 00000100:00100000:1.0:1746143116.204235:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858348416 00002000:00100000:1.0:1746143116.204276:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2449408->3145727) req@ffff88009a70b480 x1830962858348416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.204287:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70b480 with x1830962858348416 ext(2449408->3145727) 00002000:00010000:1.0:1746143116.204292:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a70b480 00000100:00100000:1.0:1746143116.204307:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5627 00000100:00100000:1.0:1746143116.204321:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858348416:12345-192.168.201.28@tcp:3:cat.0 00002000:00010000:0.0:1746143116.205677:0:21048:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143114 -> 1746143115 00000100:00100000:0.0:1746143116.205696:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861130240:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143116.205729:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c474400/0x25aee876ca70b724 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef7b expref: 29 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143116.205741:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c474400/0x25aee876ca70b724 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef7b expref: 29 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143116.205769:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c474400, rc 0) 00000100:00100000:0.0:1746143116.205993:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858347904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8807us (9142us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143116.206001:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11630 00000100:00100000:0.0:1746143116.217553:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.224019:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858348416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19692us (19812us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746143116.224053:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5627 00002000:00100000:1.0:1746143116.224065:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2449408->3145727) req@ffff88009a70b480 x1830962858348416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.224075:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70b480 with x1830962858348416 ext(2449408->3145727) 00002000:00010000:1.0:1746143116.224082:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a70b480 00000100:00100000:0.0:1746143116.237533:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.237821:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858348672 00000100:00100000:1.0:1746143116.237831:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858348672 00002000:00100000:1.0:1746143116.237878:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (2084864->2097151) req@ffff8801317b7b80 x1830962858348672/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 12776/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.237888:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b7b80 with x1830962858348672 ext(2084864->2097151) 00010000:00010000:1.0:1746143116.237898:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 31 pid: 8448 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.237912:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 31 pid: 8448 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746143116.237926:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317b7b80 00000100:00100000:1.0:1746143116.237962:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1865 00000100:00100000:1.0:1746143116.237972:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858348672:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143116.238623:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858348672:12345-192.168.201.28@tcp:4:cat.0 Request processed in 651us (1112us total) trans 21474839897 rc 0/0 00000100:00100000:1.0:1746143116.238631:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1865 00002000:00100000:1.0:1746143116.238637:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (2084864->2097151) req@ffff8801317b7b80 x1830962858348672/t21474839897(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 12776/448 e 0 to 0 dl 1746143127 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.238645:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b7b80 with x1830962858348672 ext(2084864->2097151) 00010000:00010000:1.0:1746143116.238650:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 33 pid: 8448 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.238661:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130cf5600/0x25aee876ca70b605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee94 expref: 33 pid: 8448 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746143116.238667:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317b7b80 00000100:00100000:0.0:1746143116.239263:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.249894:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.249974:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.260360:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.260416:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858349312 00000100:00100000:1.0:1746143116.260423:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858349312 00002000:00100000:1.0:1746143116.260665:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8801317b7480 x1830962858349312/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.260675:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b7480 with x1830962858349312 ext(1048576->2097151) 00002000:00010000:1.0:1746143116.260680:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b7480 00000100:00100000:1.0:1746143116.260701:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5628 00000100:00100000:1.0:1746143116.260708:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858349312:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143116.287726:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11635 00000100:00100000:1.0:1746143116.287738:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:30561:x1830962858349440:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143116.287757:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.287777:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ef9e expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.287807:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 22 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.287816:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092c6d800/0x25aee876ca70b5e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee78 expref: 6 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.287828:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132eb4e00/0x25aee876ca70b4ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eda6 expref: 39 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.287835:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.287836:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.287840:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [2027520->2097151] (req 2027520->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 39 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.287869:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132eb4e00/0x25aee876ca70b4ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eda6 expref: 39 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.287881:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132eb4e00/0x25aee876ca70b4ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eda6 expref: 39 pid: 8169 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143116.287893:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861130752:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.288051:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092c6d800/0x25aee876ca70b5e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee78 expref: 6 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.288061:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092c6d800/0x25aee876ca70b5e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee78 expref: 6 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143116.288071:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861130880:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.288116:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 22 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.288130:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 22 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143116.288138:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861131008:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143116.288927:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143116.293786:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.293824:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.293844:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858349568 00000100:00100000:0.0:1746143116.293851:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858349568 00010000:00010000:0.0:1746143116.293890:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092c6d800/0x25aee876ca70b5e9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee78 expref: 7 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746143116.293910:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858349696 00000100:00100000:0.0:1746143116.293913:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858349696 00010000:00010000:0.0:1746143116.293922:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 23 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746143116.293938:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6126 00000100:00100000:0.0:1746143116.293945:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858349568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143116.293959:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143116.293981:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092c6d800/0x25aee876ca70b5e9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee78 expref: 7 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.294059:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092c6d800/0x25aee876ca70b5e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee78 expref: 7 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.294090:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143116.294119:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858349568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 175us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143116.294126:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6126 00000100:00100000:0.0:1746143116.294168:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6127 00000100:00100000:0.0:1746143116.294173:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858349696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143116.294180:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143116.294188:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 23 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.294198:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 23 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.294210:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143116.294225:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858349696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143116.294231:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6127 00000100:00080000:0.0:1746143116.294322:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143116.294461:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861130752:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.294472:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092c6d800/0x25aee876ca70b5e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee78 expref: 6 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143116.294490:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861130880:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.294498:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132eb5200/0x25aee876ca70b4bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed7c expref: 22 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143116.294507:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861131008:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.294547:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [2027520->2097151] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 39 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.294558:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475000, rc 0) 00000100:00100000:1.0:1746143116.294585:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:30561:x1830962858349440:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6850us (7263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.294592:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11635 00000100:00100000:1.0:1746143116.295240:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858349312:12345-192.168.201.28@tcp:3:cat.0 Request processed in 34531us (34881us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143116.295252:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5628 00002000:00100000:1.0:1746143116.295260:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8801317b7480 x1830962858349312/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.295268:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b7480 with x1830962858349312 ext(1048576->2097151) 00002000:00010000:1.0:1746143116.295273:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b7480 00000100:00100000:0.0:1746143116.296071:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.298079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.302014:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.302632:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858350208 00000100:00100000:1.0:1746143116.302646:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858350208 00002000:00100000:1.0:1746143116.302682:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (2027520->2031615) req@ffff8801317b5180 x1830962858350208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.302692:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b5180 with x1830962858350208 ext(2027520->2031615) 00002000:00010000:1.0:1746143116.302697:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317b5180 00000100:00100000:1.0:1746143116.302719:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5629 00000100:00100000:1.0:1746143116.302725:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1970:x1830962858350208:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143116.304384:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1970:x1830962858350208:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1651us (2363us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143116.304394:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5629 00002000:00100000:1.0:1746143116.304401:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (2027520->2031615) req@ffff8801317b5180 x1830962858350208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/4536 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.304606:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b5180 with x1830962858350208 ext(2027520->2031615) 00002000:00010000:1.0:1746143116.304611:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317b5180 00000100:00100000:0.0:1746143116.312308:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.312360:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.313003:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858350464 00000100:00100000:1.0:1746143116.313013:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858350464 00002000:00100000:1.0:1746143116.313433:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8801317b7100 x1830962858350464/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.313450:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b7100 with x1830962858350464 ext(2097152->3145727) 00002000:00010000:1.0:1746143116.313453:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b7100 00000100:00100000:0.0:1746143116.313498:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5631 00000100:00100000:0.0:1746143116.313519:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858350464:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143116.317644:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.320470:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858350848 00000100:00100000:1.0:1746143116.320485:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858350848 00000100:00100000:1.0:1746143116.320557:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11636 00000100:00100000:1.0:1746143116.320564:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:30561:x1830962858350848:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143116.320587:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.320606:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164efa5 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.320756:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f762800/0x25aee876ca70b739 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef90 expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.320963:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.320965:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.320969:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->1859583] (req 1048576->1859583) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 33 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.321706:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f762800/0x25aee876ca70b739 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef90 expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.321721:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f762800/0x25aee876ca70b739 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef90 expref: 30 pid: 21048 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143116.321734:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861131392:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143116.322721:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143116.333625:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.333661:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861131392:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.333694:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->1859583] (req 1048576->1859583) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 33 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.333714:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475800, rc 0) 00000100:00100000:1.0:1746143116.335320:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:30561:x1830962858350848:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14747us (17676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.335329:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11636 00000100:00100000:0.0:1746143116.335846:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.338218:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858350464:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24711us (25919us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143116.338230:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5631 00002000:00100000:0.0:1746143116.338239:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8801317b7100 x1830962858350464/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.338248:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b7100 with x1830962858350464 ext(2097152->3145727) 00002000:00010000:0.0:1746143116.338253:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b7100 00000100:00100000:0.0:1746143116.352328:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.353704:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.353720:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858351232 00000100:00100000:0.0:1746143116.353723:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858351232 00010000:00010000:0.0:1746143116.353749:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092c6c400/0x25aee876ca70b5db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee6a expref: 6 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143116.353927:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.353938:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858351488 00000100:00100000:1.0:1746143116.353941:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858351488 00010000:00010000:1.0:1746143116.353953:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132eb5000/0x25aee876ca70b4b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed6e expref: 30 pid: 8449 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143116.353967:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6132 00000100:00100000:1.0:1746143116.353971:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858351488:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143116.353976:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143116.353983:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132eb5000/0x25aee876ca70b4b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed6e expref: 30 pid: 8449 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746143116.353990:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132eb5000/0x25aee876ca70b4b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed6e expref: 30 pid: 8449 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746143116.354093:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6133 00000100:00100000:0.0:1746143116.354100:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858351232:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143116.354106:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143116.354535:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132eb5000/0x25aee876ca70b4b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed6e expref: 29 pid: 8449 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746143116.354552:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143116.354567:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858351488:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 595us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.354572:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6132 00010000:00010000:0.0:1746143116.354615:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092c6c400/0x25aee876ca70b5db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee6a expref: 6 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.354624:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092c6c400/0x25aee876ca70b5db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee6a expref: 6 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.354638:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092c6c400/0x25aee876ca70b5db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee6a expref: 6 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.354651:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143116.354654:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143116.354661:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70b755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 954368->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efac expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.354669:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70b755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 954368->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efac expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.354699:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70b755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 954368->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efac expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143116.354710:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861132032:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143116.354757:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909b40 going to sleep for 11 seconds 00000100:00080000:0.0:1746143116.354770:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143116.361449:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858351872 00000100:00100000:0.0:1746143116.361453:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858351872 00002000:00100000:0.0:1746143116.361481:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (954368->958463) req@ffff88012baa0700 x1830962858351872/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.361490:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0700 with x1830962858351872 ext(954368->958463) 00002000:00010000:0.0:1746143116.361495:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0700 00000100:00100000:0.0:1746143116.361535:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5632 00000100:00100000:0.0:1746143116.361540:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858351872:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143116.361698:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858351872:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 157us (972us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143116.361704:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5632 00002000:00100000:0.0:1746143116.361708:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (954368->958463) req@ffff88012baa0700 x1830962858351872/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/4536 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.361720:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0700 with x1830962858351872 ext(954368->958463) 00002000:00010000:0.0:1746143116.361723:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0700 00000100:00100000:0.0:1746143116.362757:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.364715:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.367857:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.374249:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.378175:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.378216:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.378470:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6134 00000100:00100000:0.0:1746143116.378477:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858353024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143116.378491:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143116.378526:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132eb5600/0x25aee876ca70b4ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed75 expref: 24 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.378537:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132eb5600/0x25aee876ca70b4ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed75 expref: 24 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.379907:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132eb5600/0x25aee876ca70b4ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ed75 expref: 25 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143116.379934:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143116.379957:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858353024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1480us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143116.379965:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6134 00000100:00100000:0.0:1746143116.384734:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.384779:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.385109:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.409180:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.411171:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.412957:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.426933:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.427978:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.437711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.438295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143116.483192:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143116.557445:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.557575:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.557765:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11651 00000100:00100000:1.0:1746143116.557774:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858354688:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.557783:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.557794:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c474a00/0x25aee876ca70b7b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f00e expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143116.557839:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861133952:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143116.558656:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cce40 going to sleep for 11 seconds 00002000:00010000:1.0:1746143116.569296:0:20836:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143112 -> 1746143115 00002000:00010000:1.0:1746143116.569306:0:20836:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143110 -> 1746143115 00002000:00010000:1.0:1746143116.569309:0:20836:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143112 -> 1746143115 00000100:00100000:1.0:1746143116.569338:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861133952:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143116.569382:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c474a00/0x25aee876ca70b7b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f00e expref: 38 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.569401:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c474a00/0x25aee876ca70b7b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f00e expref: 38 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.569421:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c474a00, rc 0) 00000100:00100000:1.0:1746143116.569486:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858354688:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11711us (11909us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143116.569501:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11651 00000100:00100000:0.0:1746143116.576700:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.577064:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858354816 00000100:00100000:1.0:1746143116.577075:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858354816 00000100:00100000:1.0:1746143116.577362:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11652 00000100:00100000:1.0:1746143116.577372:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:30580:x1830962858354816:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.577593:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.577755:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f015 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.577793:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70b755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 954368->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efac expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.577801:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143116.577803:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143116.577807:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 33 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.577839:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70b755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 954368->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efac expref: 27 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.577852:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51b5400/0x25aee876ca70b755 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 954368->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efac expref: 27 pid: 21048 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143116.577866:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861134080:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143116.579073:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.581790:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861134080:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.581826:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 33 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.581847:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c474600, rc 0) 00000100:00100000:1.0:1746143116.583359:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:30580:x1830962858354816:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5980us (6663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.583370:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11652 00000100:00100000:0.0:1746143116.584445:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.593015:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.593359:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.593612:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858355200 00000100:00100000:0.0:1746143116.593621:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858355200 00000100:00100000:0.0:1746143116.593669:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11653 00000100:00100000:0.0:1746143116.593675:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:30579:x1830962858355200:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143116.593693:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143116.593711:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f01c expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.593740:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a51b4e00/0x25aee876ca70b740 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef97 expref: 36 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.593748:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a51b5200/0x25aee876ca70b763 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efba expref: 23 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.593754:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143116.593757:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143116.593760:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2146304->2543615] (req 2146304->2543615) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 23 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.593963:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a51b5200/0x25aee876ca70b763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efba expref: 23 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.593973:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a51b5200/0x25aee876ca70b763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efba expref: 23 pid: 21048 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143116.593983:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861134208:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143116.594075:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a51b4e00/0x25aee876ca70b740 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef97 expref: 36 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.594083:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a51b4e00/0x25aee876ca70b740 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef97 expref: 36 pid: 21048 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143116.594092:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861134336:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143116.594111:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143116.604996:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861134208:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143116.605008:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861134336:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143116.610337:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2146304->2543615] (req 2146304->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 23 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.610355:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bdbf800, rc 0) 00000100:00100000:1.0:1746143116.614306:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:30579:x1830962858355200:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 20628us (20945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.614315:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11653 00000100:00100000:0.0:1746143116.646023:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.646453:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858355968 00000100:00100000:1.0:1746143116.646463:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858355968 00010000:00010000:1.0:1746143116.646499:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f29400/0x25aee876ca70b716 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef74 expref: 12 pid: 1037 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143116.646538:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6140 00000100:00100000:1.0:1746143116.646546:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858355968:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143116.646561:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143116.646567:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f29400/0x25aee876ca70b716 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef74 expref: 12 pid: 1037 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.646577:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f29400/0x25aee876ca70b716 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef74 expref: 12 pid: 1037 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.646599:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f29400/0x25aee876ca70b716 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef74 expref: 12 pid: 1037 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.646625:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143116.646630:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093462e00/0x25aee876ca70b7e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143116.646638:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093462e00/0x25aee876ca70b7e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143116.646642:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093462e00/0x25aee876ca70b7e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143116.646647:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143116.646681:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858355968:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.646687:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6140 00000100:00100000:0.0:1746143116.646932:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143116.648252:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462e00/0x25aee876ca70b7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f023 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.648264:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143116.648266:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143116.648268:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093462e00, rc 0) 00000100:00100000:3.0:1746143116.648307:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30583:x1830962858355840:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 20036us (20142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143116.648314:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8021 00000100:00100000:0.0:1746143116.648757:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.648978:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858356352 00000100:00100000:3.0:1746143116.648983:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858356352 00002000:00100000:3.0:1746143116.649013:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2146304->2150399) req@ffff8800a531b100 x1830962858356352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143116.649022:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b100 with x1830962858356352 ext(2146304->2150399) 00002000:00010000:3.0:1746143116.649026:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a531b100 00000100:00100000:3.0:1746143116.649057:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5637 00000100:00100000:3.0:1746143116.649064:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858356352:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143116.650271:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858356352:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 916us (1224us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143116.650280:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5637 00002000:00100000:3.0:1746143116.650287:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2146304->2150399) req@ffff8800a531b100 x1830962858356352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/4536 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143116.650294:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b100 with x1830962858356352 ext(2146304->2150399) 00002000:00010000:3.0:1746143116.650299:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a531b100 00000100:00100000:1.0:1746143116.668808:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.678479:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801364b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.678650:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.678680:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.678698:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.678717:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.678806:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.678833:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858356736 00000100:00100000:1.0:1746143116.678842:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858356736 00000100:00100000:1.0:1746143116.678880:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858356992 00000100:00100000:1.0:1746143116.678882:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858356992 00000100:00100000:1.0:1746143116.678895:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858356608 00000100:00100000:1.0:1746143116.678897:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858356608 00000100:00100000:1.0:1746143116.678910:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858356864 00000100:00100000:1.0:1746143116.678911:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858356864 00000100:00100000:1.0:1746143116.678922:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858357120 00000100:00100000:1.0:1746143116.678925:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858357120 00000100:00100000:1.0:1746143116.678942:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11655 00000100:00100000:1.0:1746143116.678949:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858356736:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.678967:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.678986:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c474c00/0x25aee876ca70b7ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f038 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143116.679063:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861135104:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143116.679139:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.679158:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11656 00000100:00100000:1.0:1746143116.679164:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858356992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.679171:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.679178:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c474400/0x25aee876ca70b7f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f046 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.679196:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c474400/0x25aee876ca70b7f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f046 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.679206:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c474400/0x25aee876ca70b7f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f046 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.679221:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c474400, rc 0) 00000100:00100000:1.0:1746143116.679253:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858356992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 79us (562us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143116.679258:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11656 00000100:00100000:1.0:1746143116.679273:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11657 00000100:00100000:1.0:1746143116.679280:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858356608:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.679287:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.679297:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f031 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.679310:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.679313:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.679321:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.679334:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.679343:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475200, rc 0) 00000100:00100000:1.0:1746143116.679358:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858356608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 79us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.679363:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11657 00000100:00100000:1.0:1746143116.679373:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11658 00000100:00100000:1.0:1746143116.679377:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858356864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.679382:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.679388:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c475400/0x25aee876ca70b804 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f03f expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143116.679660:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861135232:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143116.679686:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.679704:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11659 00000100:00100000:1.0:1746143116.679710:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1970:x1830962858357120:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143116.679717:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.679724:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f04d expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.679734:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.679735:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.679740:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.679749:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.679755:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c474a00, rc 0) 00000100:00100000:1.0:1746143116.679974:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858357120:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 263us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.679980:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11659 00000100:00100000:0.0:1746143116.684011:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.684634:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.684663:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858357248 00000100:00100000:1.0:1746143116.684673:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858357248 00000100:00100000:1.0:1746143116.684719:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858357376 00000100:00100000:1.0:1746143116.684721:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858357376 00000100:00100000:1.0:1746143116.684739:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11660 00000100:00100000:1.0:1746143116.684746:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858357248:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143116.684748:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11661 00000100:00100000:3.0:1746143116.684754:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858357376:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143116.684765:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.684765:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143116.684780:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094215000/0x25aee876ca70b819 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f05b expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.684780:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092c6c400/0x25aee876ca70b812 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f054 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143116.684827:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861135360:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143116.684827:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861135488:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143116.684909:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.685255:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53ccd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143116.685649:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858357504 00000100:00100000:3.0:1746143116.685654:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858357504 00000100:00100000:3.0:1746143116.685680:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858357632 00000100:00100000:3.0:1746143116.685682:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858357632 00000100:00100000:3.0:1746143116.685698:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11662 00000100:00100000:3.0:1746143116.685703:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858357504:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143116.685713:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143116.685723:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094215a00/0x25aee876ca70b820 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f062 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143116.685749:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861135616:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143116.685768:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143116.685782:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11663 00000100:00100000:3.0:1746143116.685787:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858357632:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143116.685792:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143116.685798:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f069 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.685807:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143116.685809:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143116.685818:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f069 expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.685832:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f069 expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.685842:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094214c00, rc 0) 00000100:00100000:3.0:1746143116.685858:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858357632:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 71us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143116.685864:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11663 00000100:00100000:3.0:1746143116.686756:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.690484:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.690703:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861135104:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143116.690729:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c474c00/0x25aee876ca70b7ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f038 expref: 23 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.690738:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c474c00/0x25aee876ca70b7ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f038 expref: 23 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.690752:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c474c00, rc 0) 00000100:00100000:1.0:1746143116.690772:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858356736:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11824us (12128us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143116.690777:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11655 00000100:00100000:1.0:1746143116.690819:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861135232:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143116.691009:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c475400/0x25aee876ca70b804 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f03f expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.691020:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c475400/0x25aee876ca70b804 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f03f expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.691027:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475400, rc 0) 00000100:00100000:1.0:1746143116.691071:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858356864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11693us (12353us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143116.691075:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11658 00000100:00100000:3.0:1746143116.691217:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861135360:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143116.691235:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094215000/0x25aee876ca70b819 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f05b expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.691244:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094215000/0x25aee876ca70b819 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f05b expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.691261:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094215000, rc 0) 00000100:00100000:3.0:1746143116.691280:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858357376:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 6526us (6649us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143116.691285:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11661 00000100:00100000:1.0:1746143116.692653:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861135488:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143116.692674:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092c6c400/0x25aee876ca70b812 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f054 expref: 6 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.692685:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092c6c400/0x25aee876ca70b812 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f054 expref: 6 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143116.692694:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c6c400, rc 0) 00000100:00100000:1.0:1746143116.692722:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1971:x1830962858357248:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 7977us (8722us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143116.692729:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11660 00000100:00100000:3.0:1746143116.693387:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.693451:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861135616:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143116.693470:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094215a00/0x25aee876ca70b820 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f062 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.693486:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094215a00/0x25aee876ca70b820 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f062 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.693494:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094215a00, rc 0) 00000100:00100000:3.0:1746143116.693534:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858357504:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 7829us (8548us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143116.693540:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11662 00000100:00100000:0.0:1746143116.693699:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858358144 00000100:00100000:0.0:1746143116.693705:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858358144 00002000:00100000:0.0:1746143116.693737:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (2023424->2027519) req@ffff88009fb54000 x1830962858358144/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.693745:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb54000 with x1830962858358144 ext(2023424->2027519) 00002000:00010000:0.0:1746143116.693750:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb54000 00000100:00100000:0.0:1746143116.693766:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5638 00000100:00100000:0.0:1746143116.693773:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858358144:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143116.693919:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858358144:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 146us (532us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143116.693925:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5638 00002000:00100000:0.0:1746143116.693930:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (2023424->2027519) req@ffff88009fb54000 x1830962858358144/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/4536 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.693937:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb54000 with x1830962858358144 ext(2023424->2027519) 00002000:00010000:0.0:1746143116.693941:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb54000 00000100:00100000:0.0:1746143116.703536:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.703626:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858358656 00000100:00100000:1.0:1746143116.703636:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858358656 00002000:00100000:1.0:1746143116.703685:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800a531a300 x1830962858358656/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.703694:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531a300 with x1830962858358656 ext(0->1048575) 00002000:00010000:1.0:1746143116.703701:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531a300 00000100:00100000:1.0:1746143116.703723:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5639 00000100:00100000:1.0:1746143116.703731:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858358656:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143116.710847:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.710880:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858358784 00000100:00100000:3.0:1746143116.710887:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858358784 00000100:00100000:3.0:1746143116.710937:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11665 00000100:00100000:3.0:1746143116.710945:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:30582:x1830962858358784:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143116.710966:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143116.710984:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f07e expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.711016:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 34 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.711024:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f069 expref: 6 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.711045:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f762e00/0x25aee876ca70b72b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef82 expref: 31 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.711057:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143116.711059:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143116.711063:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->2482175] (req 2097152->2482175) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 34 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.711092:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f762e00/0x25aee876ca70b72b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef82 expref: 31 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.711104:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f762e00/0x25aee876ca70b72b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef82 expref: 31 pid: 10061 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746143116.711117:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861135744:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143116.711176:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f069 expref: 6 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143116.711183:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f069 expref: 6 pid: 4756 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746143116.711192:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861135872:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143116.711219:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 34 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.711226:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 34 pid: 21048 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143116.711240:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861136000:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143116.711240:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.711262:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858359040 00000100:00100000:0.0:1746143116.711265:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858359040 00000100:00100000:3.0:1746143116.711270:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00002000:00100000:0.0:1746143116.711296:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2539520->2543615) req@ffff8800a5318000 x1830962858359040/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.711306:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5318000 with x1830962858359040 ext(2539520->2543615) 00002000:00010000:0.0:1746143116.711316:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5318000 00000100:00100000:0.0:1746143116.711331:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5640 00000100:00100000:0.0:1746143116.711337:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858359040:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143116.711486:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858359040:12345-192.168.201.28@tcp:3:cat.0 Request processed in 148us (247us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143116.711493:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5640 00002000:00100000:0.0:1746143116.711499:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2539520->2543615) req@ffff8800a5318000 x1830962858359040/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/4536 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.712188:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5318000 with x1830962858359040 ext(2539520->2543615) 00002000:00010000:0.0:1746143116.712193:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5318000 00000100:00100000:3.0:1746143116.713565:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858358400 00000100:00100000:3.0:1746143116.713572:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858358400 00000100:00100000:3.0:1746143116.713607:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8022 00000100:00100000:3.0:1746143116.713612:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30583:x1830962858358400:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143116.713628:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143116.713642:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094214a00/0x25aee876ca70b83c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f077 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.713732:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094215a00/0x25aee876ca70b843 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.713746:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093462e00/0x25aee876ca70b7e1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f023 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.713753:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094215a00/0x25aee876ca70b843 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.713779:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093462e00/0x25aee876ca70b7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f023 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.713788:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462e00/0x25aee876ca70b7e1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f023 expref: 10 pid: 14796 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143116.713799:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861136128:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143116.713870:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143116.717198:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.717229:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858359296 00000100:00100000:3.0:1746143116.717236:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858359296 00000100:00100000:3.0:1746143116.717275:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3364 00000100:00100000:3.0:1746143116.717282:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5210450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30579:x1830962858359296:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143116.717603:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5210450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30579:x1830962858359296:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 319us (412us total) trans 8589942225 rc 0/0 00000100:00100000:3.0:1746143116.717610:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3364 00000100:00100000:0.0:1746143116.724002:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861136128:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143116.724061:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094215a00/0x25aee876ca70b843 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143116.725992:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.728255:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.728781:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858358656:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25048us (25255us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143116.728792:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5639 00002000:00100000:1.0:1746143116.728804:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800a531a300 x1830962858358656/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.728814:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531a300 with x1830962858358656 ext(0->1048575) 00002000:00010000:1.0:1746143116.728832:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531a300 00000100:00100000:0.0:1746143116.733371:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.733482:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6142 00000100:00100000:1.0:1746143116.733496:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858359424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143116.733524:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143116.733554:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f069 expref: 7 pid: 4756 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746143116.733568:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f069 expref: 7 pid: 4756 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746143116.733590:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094214c00/0x25aee876ca70b827 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f069 expref: 7 pid: 4756 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746143116.733614:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143116.733659:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858359424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 167us (7676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.733667:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6142 00000100:00100000:0.0:1746143116.734567:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.734586:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858359552 00000100:00100000:1.0:1746143116.734590:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858359552 00010000:00010000:1.0:1746143116.734609:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f762e00/0x25aee876ca70b72b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef82 expref: 30 pid: 10061 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143116.734631:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6144 00000100:00100000:1.0:1746143116.734638:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858359552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143116.734647:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143116.734661:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f762e00/0x25aee876ca70b72b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef82 expref: 30 pid: 10061 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746143116.734677:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f762e00/0x25aee876ca70b72b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef82 expref: 30 pid: 10061 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746143116.734691:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f762e00/0x25aee876ca70b72b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef82 expref: 30 pid: 10061 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746143116.734702:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143116.735267:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1968:x1830962858359552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 628us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.735274:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6144 00000100:00100000:1.0:1746143116.735288:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858359680 00000100:00100000:1.0:1746143116.735291:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858359680 00010000:00010000:1.0:1746143116.735307:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51b4200/0x25aee876ca70b771 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efc8 expref: 24 pid: 21048 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143116.735325:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6145 00000100:00100000:1.0:1746143116.735330:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858359680:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143116.735338:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143116.735353:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a51b4200/0x25aee876ca70b771 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efc8 expref: 24 pid: 21048 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.735363:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a51b4200/0x25aee876ca70b771 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efc8 expref: 24 pid: 21048 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.735378:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51b4200/0x25aee876ca70b771 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efc8 expref: 24 pid: 21048 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.735390:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.735392:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143116.735398:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 36 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.735407:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 36 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.735437:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 36 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143116.735654:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861136256:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143116.737511:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53ccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.738126:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.738656:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858359936 00000100:00100000:0.0:1746143116.738665:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858359936 00010000:00010000:0.0:1746143116.738700:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 34 pid: 21048 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143116.738729:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6146 00000100:00100000:0.0:1746143116.738736:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858359936:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143116.738750:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143116.738773:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 34 pid: 21048 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.738786:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 34 pid: 21048 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.738810:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090ff0a00/0x25aee876ca70b708 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef6d expref: 34 pid: 21048 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.739191:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143116.739194:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143116.739203:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 33 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.739213:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 33 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.739246:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 33 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143116.739257:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861136384:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143116.739345:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143116.740612:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.741322:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861136256:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143116.741342:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143116.741383:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858359680:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6051us (6817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.741396:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6145 00000100:00100000:0.0:1746143116.742054:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.742157:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861136384:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143116.742172:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143116.742191:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858359936:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3455us (4165us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143116.742198:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6146 00000100:00100000:3.0:1746143116.742346:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858360320 00000100:00100000:3.0:1746143116.742351:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858360320 00000100:00100000:3.0:1746143116.742377:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8023 00000100:00100000:3.0:1746143116.742594:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30583:x1830962858360320:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143116.742610:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143116.742612:0:14796:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143116.742634:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094215a00/0x25aee876ca70b843 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f077 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.742651:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143116.742654:0:14796:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143116.742663:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c400/0x25aee876ca70b858 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f08c expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.742762:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742775:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742785:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742799:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742806:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742812:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742817:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092c6dc00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143116.742820:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742826:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742833:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143116.742835:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143116.742838:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742842:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6dc00/0x25aee876ca70b85f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143116.742862:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c400/0x25aee876ca70b858 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f08c expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.742868:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092c6c400/0x25aee876ca70b858 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f08c expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.742876:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c6c400, rc 0) 00000100:00100000:3.0:1746143116.742899:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30583:x1830962858360320:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 306us (868us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143116.742904:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8023 00000100:00100000:0.0:1746143116.747852:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.747898:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.747945:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.748062:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858360832 00000100:00100000:1.0:1746143116.748072:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858360832 00002000:00100000:1.0:1746143116.748120:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2027519) req@ffff88009f35ad80 x1830962858360832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.748131:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35ad80 with x1830962858360832 ext(1048576->2027519) 00002000:00010000:1.0:1746143116.748136:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f35ad80 00000100:00100000:1.0:1746143116.748154:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858361088 00000100:00100000:1.0:1746143116.748157:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858361088 00002000:00100000:1.0:1746143116.748171:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1859584->2023423) req@ffff88009f359880 x1830962858361088/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.748178:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f359880 with x1830962858361088 ext(1859584->2023423) 00002000:00010000:1.0:1746143116.748182:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f359880 00000100:00100000:1.0:1746143116.748199:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858360576 00000100:00100000:1.0:1746143116.748202:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858360576 00002000:00100000:1.0:1746143116.748214:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009f359c00 x1830962858360576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.748221:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f359c00 with x1830962858360576 ext(1048576->2097151) 00002000:00010000:1.0:1746143116.748224:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f359c00 00000100:00100000:1.0:1746143116.748246:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5641 00000100:00100000:1.0:1746143116.748253:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1971:x1830962858360832:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143116.752258:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.752874:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858361344 00000100:00100000:0.0:1746143116.752884:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858361344 00002000:00100000:0.0:1746143116.752927:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009fb54700 x1830962858361344/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.752938:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb54700 with x1830962858361344 ext(1048576->2097151) 00002000:00010000:0.0:1746143116.752943:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb54700 00000100:00100000:0.0:1746143116.752978:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5644 00000100:00100000:0.0:1746143116.752987:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858361344:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143116.754641:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.756203:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858361600 00000100:00100000:1.0:1746143116.756215:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858361600 00002000:00100000:1.0:1746143116.756261:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2478080->2482175) req@ffff88009f35b480 x1830962858361600/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.756272:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35b480 with x1830962858361600 ext(2478080->2482175) 00002000:00010000:1.0:1746143116.756278:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f35b480 00000100:00100000:1.0:1746143116.756468:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5645 00000100:00100000:1.0:1746143116.756481:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858361600:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143116.756646:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858361600:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 166us (2008us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143116.757851:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5645 00002000:00100000:1.0:1746143116.757864:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2478080->2482175) req@ffff88009f35b480 x1830962858361600/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/4536 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.757873:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35b480 with x1830962858361600 ext(2478080->2482175) 00002000:00010000:1.0:1746143116.757879:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f35b480 00000100:00100000:0.0:1746143116.759877:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.760642:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858361856 00000100:00100000:3.0:1746143116.760658:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858361856 00000100:00100000:3.0:1746143116.760709:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3365 00000100:00100000:3.0:1746143116.760716:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30583:x1830962858361856:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143116.760952:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30583:x1830962858361856:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 234us (1082us total) trans 8589942227 rc 0/0 00000100:00100000:3.0:1746143116.760960:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3365 00000100:00100000:0.0:1746143116.773147:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1971:x1830962858360832:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 24881us (25294us total) trans 0 rc 978944/978944 00000100:00100000:0.0:1746143116.773161:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5641 00002000:00100000:0.0:1746143116.773173:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2027519) req@ffff88009f35ad80 x1830962858360832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 978944/978944 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.773183:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35ad80 with x1830962858360832 ext(1048576->2027519) 00002000:00010000:0.0:1746143116.773190:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f35ad80 00000100:00100000:0.0:1746143116.780181:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.780661:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858362112 00000100:00100000:3.0:1746143116.780670:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858362112 00000100:00100000:1.0:1746143116.780721:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.780999:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3366 00000100:00100000:3.0:1746143116.781008:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:30582:x1830962858362112:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:0.0:1746143116.781169:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858362240 00000100:00100000:0.0:1746143116.781173:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858362240 00000100:00100000:0.0:1746143116.781203:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11667 00000100:00100000:0.0:1746143116.781208:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30586:x1830962858362240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143116.781219:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143116.781236:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094215400/0x25aee876ca70b866 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f093 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.781262:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 38 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.781269:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143116.781271:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143116.781274:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094215400/0x25aee876ca70b866 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f093 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.781301:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 38 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.781312:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 38 pid: 10061 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143116.781323:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861136512:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143116.781470:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143116.781826:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:30582:x1830962858362112:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 818us (1656us total) trans 8589942228 rc 0/0 00000100:00100000:3.0:1746143116.781832:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3366 00000100:00100000:0.0:1746143116.784307:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.784574:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858362368 00000100:00100000:3.0:1746143116.784582:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858362368 00002000:00100000:3.0:1746143116.784621:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x304:0x0] (2027520->2097151) req@ffff88009f358a80 x1830962858362368/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143116.784630:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358a80 with x1830962858362368 ext(2027520->2097151) 00010000:00010000:3.0:1746143116.784638:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 37 pid: 10061 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143116.784655:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 37 pid: 10061 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746143116.784661:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f358a80 00000100:00100000:3.0:1746143116.784680:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1869 00000100:00100000:3.0:1746143116.784686:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1971:x1830962858362368:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143116.790716:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858362496 00000100:00100000:0.0:1746143116.790726:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858362496 00000100:00100000:0.0:1746143116.790770:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11668 00000100:00100000:0.0:1746143116.790780:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:30580:x1830962858362496:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143116.790801:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143116.790821:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094214e00/0x25aee876ca70b86d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f09a expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.790850:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143116.790857:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094214e00/0x25aee876ca70b86d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f09a expref: 40 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.790870:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094214e00/0x25aee876ca70b86d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f09a expref: 40 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.790881:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094214e00, rc 0) 00000100:00100000:0.0:1746143116.790939:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:30580:x1830962858362496:12345-192.168.201.28@tcp:101:cat.0 Request processed in 160us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143116.790946:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11668 00000100:00100000:3.0:1746143116.791663:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:1971:x1830962858362368:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 6973us (7361us total) trans 17179872649 rc 0/0 00000100:00100000:3.0:1746143116.791673:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1869 00002000:00100000:3.0:1746143116.791684:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x304:0x0] (2027520->2097151) req@ffff88009f358a80 x1830962858362368/t17179872649(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/448 e 0 to 0 dl 1746143127 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143116.791693:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358a80 with x1830962858362368 ext(2027520->2097151) 00010000:00010000:3.0:1746143116.791701:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 40 pid: 10061 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143116.791713:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c475000/0x25aee876ca70b747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ef9e expref: 40 pid: 10061 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746143116.791720:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f358a80 00000100:00100000:0.0:1746143116.793999:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.811689:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.812021:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.812370:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858363008 00000100:00100000:3.0:1746143116.812380:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858363008 00002000:00100000:3.0:1746143116.812432:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009f358380 x1830962858363008/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143116.812444:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358380 with x1830962858363008 ext(1048576->2097151) 00002000:00010000:3.0:1746143116.812452:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f358380 00000100:00100000:3.0:1746143116.812482:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858363136 00000100:00100000:3.0:1746143116.812485:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858363136 00002000:00100000:3.0:1746143116.812733:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009f358e00 x1830962858363136/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143116.812741:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358e00 with x1830962858363136 ext(1048576->2097151) 00002000:00010000:3.0:1746143116.812745:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f358e00 00000100:00100000:3.0:1746143116.812756:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5646 00000100:00100000:3.0:1746143116.812767:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858363008:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143116.843116:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1968:x1830962858363136:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 30331us (31083us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143116.843130:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5647 00002000:00100000:1.0:1746143116.843141:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009f358e00 x1830962858363136/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.843152:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358e00 with x1830962858363136 ext(1048576->2097151) 00002000:00010000:1.0:1746143116.843158:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f358e00 00000100:00100000:3.0:1746143116.844776:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858363008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32008us (33093us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143116.844787:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5646 00002000:00100000:3.0:1746143116.844795:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009f358380 x1830962858363008/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143116.844983:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358380 with x1830962858363008 ext(1048576->2097151) 00002000:00010000:3.0:1746143116.844988:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f358380 00000100:00100000:1.0:1746143116.876310:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143116.877716:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858363520 00000100:00100000:3.0:1746143116.877728:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858363520 00000100:00100000:3.0:1746143116.877778:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11669 00000100:00100000:3.0:1746143116.877788:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:30586:x1830962858363520:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143116.877809:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143116.878015:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0a1 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.880945:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 32 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.880959:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143116.880961:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143116.880964:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.880998:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 32 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143116.881011:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 32 pid: 10061 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143116.881025:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861136896:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143116.881110:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143116.886592:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861136896:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143116.886627:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.886646:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbc5800, rc 0) 00000100:00100000:0.0:1746143116.886700:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:30586:x1830962858363520:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8913us (10401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143116.886714:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11669 00000100:00100000:0.0:1746143116.889705:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.890828:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858363648 00000100:00100000:1.0:1746143116.890838:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858363648 00000100:00100000:1.0:1746143116.890916:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11670 00000100:00100000:1.0:1746143116.890924:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:30580:x1830962858363648:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143116.890955:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143116.890981:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090434a00/0x25aee876ca70b87b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0a8 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.891026:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 24 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143116.891515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.891541:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858363776 00000100:00100000:0.0:1746143116.891545:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858363776 00002000:00100000:0.0:1746143116.891580:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f35a680 x1830962858363776/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 504/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.891590:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35a680 with x1830962858363776 ext(1048576->2097151) 00010000:00010000:0.0:1746143116.891598:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 33 pid: 10061 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.891611:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 33 pid: 10061 timeout: 998 lvb_type: 0 00002000:00010000:0.0:1746143116.891619:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f35a680 00000100:00100000:0.0:1746143116.891636:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1870 00000100:00100000:0.0:1746143116.891643:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858363776:12345-192.168.201.28@tcp:4:cat.0 00010000:00010000:1.0:1746143116.891669:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143116.891673:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143116.891678:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090434a00/0x25aee876ca70b87b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a8 expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.891742:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 24 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.891755:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 24 pid: 20836 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143116.891777:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861137024:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143116.892080:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.899020:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.899066:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858363904 00000100:00100000:1.0:1746143116.899075:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858363904 00002000:00100000:1.0:1746143116.899121:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2146304->2543615) req@ffff88009c1e8000 x1830962858363904/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143116.899132:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8000 with x1830962858363904 ext(2146304->2543615) 00010000:00010000:1.0:1746143116.899143:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 25 pid: 20836 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143116.899157:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 25 pid: 20836 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746143116.899164:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1e8000 00000100:00100000:1.0:1746143116.899192:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1871 00000100:00100000:1.0:1746143116.899200:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858363904:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143116.899741:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861137024:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143116.899766:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090434a00/0x25aee876ca70b87b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a8 expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143116.899781:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090434a00, rc 0) 00000100:00100000:1.0:1746143116.899809:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:30580:x1830962858363648:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8886us (10114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.899817:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11670 00000100:00100000:0.0:1746143116.923665:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858363904:12345-192.168.201.28@tcp:4:cat.0 Request processed in 24451us (24643us total) trans 17179872650 rc 0/0 00000100:00100000:0.0:1746143116.923680:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1871 00002000:00100000:0.0:1746143116.923692:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2146304->2543615) req@ffff88009c1e8000 x1830962858363904/t17179872650(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/448 e 0 to 0 dl 1746143127 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.923703:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8000 with x1830962858363904 ext(2146304->2543615) 00010000:00010000:0.0:1746143116.923713:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 27 pid: 20836 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.923729:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 27 pid: 20836 timeout: 998 lvb_type: 0 00002000:00010000:0.0:1746143116.923736:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1e8000 00000100:00100000:0.0:1746143116.927690:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858363776:12345-192.168.201.28@tcp:4:cat.0 Request processed in 36035us (36164us total) trans 21474839899 rc 0/0 00000100:00100000:0.0:1746143116.927705:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1870 00002000:00100000:0.0:1746143116.927717:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f35a680 x1830962858363776/t21474839899(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 504/448 e 0 to 0 dl 1746143127 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.927727:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35a680 with x1830962858363776 ext(1048576->2097151) 00010000:00010000:0.0:1746143116.927738:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 35 pid: 10061 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.927751:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 35 pid: 10061 timeout: 998 lvb_type: 0 00002000:00010000:0.0:1746143116.927758:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f35a680 00000100:00100000:0.0:1746143116.931752:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.931785:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858364032 00000100:00100000:0.0:1746143116.931794:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858364032 00010000:00010000:0.0:1746143116.931833:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 27 pid: 20836 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143116.931865:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6148 00000100:00100000:0.0:1746143116.931873:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858364032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143116.931889:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143116.931907:0:9869:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143114 -> 1746143115 00002000:00010000:0.0:1746143116.931910:0:9869:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143114 -> 1746143115 00010000:00010000:0.0:1746143116.931917:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 27 pid: 20836 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.931929:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 27 pid: 20836 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.941894:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bdbf800/0x25aee876ca70b7c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2146304->3145727] (req 2146304->2543615) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f01c expref: 27 pid: 20836 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143116.941921:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143116.941923:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143116.941932:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090434a00/0x25aee876ca70b87b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a8 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.941941:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090434a00/0x25aee876ca70b87b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a8 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143116.941993:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090434a00/0x25aee876ca70b87b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a8 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143116.942007:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861137152:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143116.942089:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143116.942119:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143116.942184:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858364160 00000100:00100000:1.0:1746143116.942192:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858364160 00010000:00010000:1.0:1746143116.942221:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c475800/0x25aee876ca70b74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164efa5 expref: 35 pid: 10061 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143116.947422:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f35a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861137152:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143116.947442:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143116.947476:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858364032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 15603us (15735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143116.947486:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6148 00000100:00100000:1.0:1746143116.955227:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.955256:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858364416 00000100:00100000:0.0:1746143116.955265:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858364416 00000100:00100000:1.0:1746143116.955398:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861137280:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143116.955419:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143116.955471:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858364160:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 12027us (13352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143116.955482:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6149 00002000:00100000:0.0:1746143116.955496:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009c1eb100 x1830962858364416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.955518:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1eb100 with x1830962858364416 ext(2097152->3145727) 00002000:00010000:0.0:1746143116.955524:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1eb100 00000100:00100000:0.0:1746143116.955604:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5649 00000100:00100000:0.0:1746143116.955611:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:1968:x1830962858364416:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143116.963741:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143116.965281:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858364672 00000100:00100000:0.0:1746143116.965291:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858364672 00002000:00100000:0.0:1746143116.965331:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009fb57800 x1830962858364672/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/0 e 0 to 0 dl 1746143127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.965343:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb57800 with x1830962858364672 ext(1048576->2097151) 00002000:00010000:0.0:1746143116.965348:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb57800 00000100:00100000:0.0:1746143116.965368:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5650 00000100:00100000:0.0:1746143116.965375:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858364672:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143116.987417:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:1968:x1830962858364416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31793us (32188us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143116.987431:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5649 00002000:00100000:0.0:1746143116.987444:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009c1eb100 x1830962858364416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143116.987454:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1eb100 with x1830962858364416 ext(2097152->3145727) 00002000:00010000:0.0:1746143116.987460:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1eb100 00000100:00100000:1.0:1746143117.001800:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858364672:12345-192.168.201.28@tcp:3:cat.0 Request processed in 36415us (38057us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143117.001814:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5650 00002000:00100000:1.0:1746143117.001994:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009fb57800 x1830962858364672/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:267/0 lens 488/440 e 0 to 0 dl 1746143127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.002010:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb57800 with x1830962858364672 ext(1048576->2097151) 00002000:00010000:1.0:1746143117.002017:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb57800 00000100:00100000:3.0:1746143117.007885:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.007986:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.008015:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858364800 00000100:00100000:3.0:1746143117.008023:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858364800 00000100:00100000:3.0:1746143117.008080:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858365056 00000100:00100000:3.0:1746143117.008082:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858365056 00000100:00100000:3.0:1746143117.008100:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8024 00000100:00100000:3.0:1746143117.008108:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30592:x1830962858364800:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143117.008135:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.008157:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4800/0x25aee876ca70b882 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0af expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.008228:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008241:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008254:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008266:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008272:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008277:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008611:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008620:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008626:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143117.008659:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143117.008664:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143117.008681:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008690:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008697:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008703:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008710:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008715:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fbc4000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143117.008719:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008725:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008735:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143117.008738:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143117.008741:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008746:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4000/0x25aee876ca70b889 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008757:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008761:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008766:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008769:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fbc4600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143117.008772:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008776:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008782:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449a00) 00010000:00010000:3.0:1746143117.008783:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143117.008785:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008789:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4600/0x25aee876ca70b890 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.008983:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4800/0x25aee876ca70b882 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.008994:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 11 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.009000:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.009002:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143117.009005:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbc4200, rc 0) 00000100:00100000:3.0:1746143117.009070:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30592:x1830962858364800:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 962us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.009076:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8024 00000100:00100000:3.0:1746143117.009094:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8025 00000100:00100000:3.0:1746143117.009100:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30591:x1830962858365056:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143117.009111:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.009116:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5a00/0x25aee876ca70b89e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0b6 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.009160:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.009169:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.009176:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.009204:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.009216:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 10 pid: 1037 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143117.009228:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861137408:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.009300:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2497840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143117.015640:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.015669:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.017202:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858365184 00000100:00100000:1.0:1746143117.017211:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858365184 00000100:00100000:1.0:1746143117.017256:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858365440 00000100:00100000:1.0:1746143117.017258:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858365440 00000100:00100000:1.0:1746143117.017275:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11671 00000100:00100000:1.0:1746143117.017281:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:30586:x1830962858365184:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143117.017298:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143117.017315:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0bd expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.017342:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 34 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.017349:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143117.017351:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143117.017354:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.017379:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 34 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.017388:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 34 pid: 4758 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143117.017398:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861137536:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143117.017668:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11672 00000100:00100000:1.0:1746143117.017675:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858365440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143117.017682:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143117.017688:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090434800/0x25aee876ca70b8b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0cb expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.017709:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090434800/0x25aee876ca70b8b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0cb expref: 35 pid: 8448 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143117.017709:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143117.017717:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090434800/0x25aee876ca70b8b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0cb expref: 35 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143117.017725:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090434800, rc 0) 00000100:00100000:0.0:1746143117.017727:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.017745:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.017746:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858365440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 72us (2076us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143117.017752:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11672 00000100:00100000:1.0:1746143117.017764:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858365312 00000100:00100000:1.0:1746143117.017767:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858365312 00000100:00100000:1.0:1746143117.017780:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11673 00000100:00100000:0.0:1746143117.017782:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.017784:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858365312:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143117.017790:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143117.017796:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0c4 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143117.017797:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746143117.017806:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143117.017807:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143117.017814:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 35 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143117.017992:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 35 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143117.018001:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090434c00, rc 0) 00000100:00100000:1.0:1746143117.018018:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858365312:12345-192.168.201.28@tcp:101:cat.0 Request processed in 234us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.018024:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11673 00000100:00100000:1.0:1746143117.018056:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858365952 00000100:00100000:1.0:1746143117.018059:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858365952 00010000:00010000:1.0:1746143117.018076:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 11 pid: 1037 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143117.018095:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6150 00000100:00100000:1.0:1746143117.018100:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858365952:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143117.018109:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143117.018114:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 11 pid: 1037 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143117.018122:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 11 pid: 1037 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746143117.018138:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143117.018142:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143117.018150:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143117.018157:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143117.018169:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143117.018185:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858365952:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 85us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.018191:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6150 00000100:00100000:1.0:1746143117.018214:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cc900 going to sleep for 11 seconds 00010000:00010000:3.0:1746143117.018377:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b897 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0af expref: 10 pid: 1037 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143117.018389:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861137408:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.018408:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.018416:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.018421:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143117.018445:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143117.018605:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5a00/0x25aee876ca70b89e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0b6 expref: 15 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.018615:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0b6 expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.018622:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.018624:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143117.018626:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbc4400, rc 0) 00000100:00100000:3.0:1746143117.018662:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30591:x1830962858365056:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9562us (10676us total) trans 8589942229 rc 0/0 00000100:00100000:3.0:1746143117.018668:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8025 00000100:00100000:3.0:1746143117.018683:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858365696 00000100:00100000:3.0:1746143117.018686:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858365696 00000100:00100000:3.0:1746143117.018700:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858365824 00000100:00100000:3.0:1746143117.018702:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858365824 00000100:00100000:3.0:1746143117.018714:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8026 00000100:00100000:3.0:1746143117.018718:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:30594:x1830962858365696:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143117.018732:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.018739:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5000/0x25aee876ca70b8c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0d2 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.018804:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5600/0x25aee876ca70b8cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.018813:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5600/0x25aee876ca70b8cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.018823:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5600/0x25aee876ca70b8cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143117.018829:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143117.018872:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5000/0x25aee876ca70b8c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d2 expref: 207 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.018882:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5600/0x25aee876ca70b8cf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d2 expref: 206 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.018887:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.018889:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143117.018890:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbc5600, rc 0) 00000100:00100000:3.0:1746143117.018906:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:30594:x1830962858365696:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 188us (1198us total) trans 8589942230 rc 0/0 00000100:00100000:3.0:1746143117.018912:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8026 00000100:00100000:3.0:1746143117.018922:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8027 00000100:00100000:3.0:1746143117.018927:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30592:x1830962858365824:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143117.018933:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.018938:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4a00/0x25aee876ca70b8dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0d9 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.018964:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.018972:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0b6 expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.018982:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5600/0x25aee876ca70b8cf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d2 expref: 205 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.018987:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.019003:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5600/0x25aee876ca70b8cf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d2 expref: 205 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.019011:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5600/0x25aee876ca70b8cf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d2 expref: 205 pid: 1037 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143117.019020:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861137664:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.019080:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0b6 expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.019088:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4400/0x25aee876ca70b8a5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0b6 expref: 13 pid: 1037 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143117.019095:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861137792:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.019113:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a28480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143117.020000:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861137536:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143117.020018:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.020047:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090435e00, rc 0) 00000100:00100000:0.0:1746143117.021479:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:30586:x1830962858365184:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4188us (5838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143117.021489:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11671 00000100:00100000:3.0:1746143117.022089:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.022128:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858366080 00000100:00100000:3.0:1746143117.022136:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858366080 00002000:00100000:3.0:1746143117.022183:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2482175) req@ffff88009fb55c00 x1830962858366080/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.022193:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb55c00 with x1830962858366080 ext(2097152->2482175) 00010000:00010000:3.0:1746143117.022205:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 35 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.022217:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 35 pid: 4758 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746143117.022223:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb55c00 00000100:00100000:3.0:1746143117.022248:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1872 00000100:00100000:3.0:1746143117.022256:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858366080:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143117.066213:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.067079:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858366208 00000100:00100000:0.0:1746143117.067090:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858366208 00000100:00100000:0.0:1746143117.067152:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11674 00000100:00100000:0.0:1746143117.067163:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:30594:x1830962858366208:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143117.067185:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143117.067207:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0e0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.067244:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143117.067253:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.067259:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143117.067264:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2351104->2785279] (req 2351104->2785279) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 38 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.067307:0:4758:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.067322:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2351104->2785279] (req 2351104->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 38 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.067334:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a527c800, rc 0) 00000100:00100000:0.0:1746143117.067593:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:30594:x1830962858366208:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 430us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143117.067601:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11674 00000100:00100000:0.0:1746143117.068230:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.068308:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858366336 00000100:00100000:0.0:1746143117.068313:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858366336 00000100:00100000:0.0:1746143117.068354:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11675 00000100:00100000:0.0:1746143117.068361:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858366336:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143117.068371:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143117.068380:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b8f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0e7 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.068410:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b8f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e7 expref: 39 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143117.068660:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fbc4200/0x25aee876ca70b8f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e7 expref: 39 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143117.068671:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbc4200, rc 0) 00000100:00100000:0.0:1746143117.068704:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858366336:12345-192.168.201.28@tcp:101:cat.0 Request processed in 342us (476us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143117.068711:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11675 00000100:00100000:3.0:1746143117.070647:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858366080:12345-192.168.201.28@tcp:4:cat.0 Request processed in 48384us (48554us total) trans 21474839900 rc 0/0 00000100:00100000:3.0:1746143117.070659:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1872 00002000:00100000:3.0:1746143117.070672:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2482175) req@ffff88009fb55c00 x1830962858366080/t21474839900(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/448 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.070682:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb55c00 with x1830962858366080 ext(2097152->2482175) 00010000:00010000:3.0:1746143117.070692:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 38 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.070703:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 38 pid: 4758 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746143117.070709:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb55c00 00000100:00100000:3.0:1746143117.070772:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861137664:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.070787:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861137792:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.070810:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:1.0:1746143117.080648:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.080680:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.080724:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.080879:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858366720 00000100:00100000:3.0:1746143117.080889:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858366720 00000100:00100000:3.0:1746143117.080931:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11676 00000100:00100000:3.0:1746143117.080938:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858366720:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.080959:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.080977:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a28aa00/0x25aee876ca70b8f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0ee expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.081009:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a28aa00/0x25aee876ca70b8f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0ee expref: 39 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.081018:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a28aa00/0x25aee876ca70b8f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0ee expref: 39 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.081046:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28aa00, rc 0) 00000100:00100000:3.0:1746143117.081094:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858366720:12345-192.168.201.28@tcp:101:cat.0 Request processed in 155us (368us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143117.081100:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11676 00000100:00100000:0.0:1746143117.081950:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.082078:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858366848 00000100:00100000:0.0:1746143117.082082:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858366848 00010000:00010000:0.0:1746143117.082099:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 38 pid: 4758 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143117.082116:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6153 00000100:00100000:0.0:1746143117.082121:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858366848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143117.082128:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143117.082148:0:9869:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143114 -> 1746143115 00010000:00010000:0.0:1746143117.082154:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 38 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143117.082162:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 38 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143117.082182:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094215c00/0x25aee876ca70b835 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->2482175) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f07e expref: 38 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143117.082193:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143117.082195:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143117.082201:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.082210:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.082241:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.082252:0:9869:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 30 pid: 4758 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143117.082263:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861138048:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143117.082324:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801369096c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143117.082751:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.082758:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143117.082803:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143117.082807:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143117.082824:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.082834:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143117.082858:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc4a00/0x25aee876ca70b8dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d9 expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.082871:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d9 expref: 11 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.082877:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.082880:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143117.082882:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbc5400, rc 0) 00000100:00100000:3.0:1746143117.082906:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30592:x1830962858365824:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 63979us (65123us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.082913:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8027 00000100:00100000:0.0:1746143117.090766:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861138048:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143117.090792:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143117.091074:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1969:x1830962858366848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8723us (8895us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143117.091086:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6153 00000100:00100000:0.0:1746143117.093749:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.093809:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.093950:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11678 00000100:00100000:0.0:1746143117.093956:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858367360:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143117.093963:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143117.093973:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5000/0x25aee876ca70b907 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f10a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.093994:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143117.094004:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5000/0x25aee876ca70b907 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f10a expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143117.094015:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5000/0x25aee876ca70b907 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f10a expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143117.094053:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbc5000, rc 0) 00000100:00100000:0.0:1746143117.094091:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858367360:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 135us (281us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143117.094097:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11678 00000100:00100000:0.0:1746143117.095151:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.095225:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.096586:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.097043:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858367488 00000100:00100000:3.0:1746143117.097048:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858367488 00000100:00100000:0.0:1746143117.097072:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.097075:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11679 00000100:00100000:3.0:1746143117.097083:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858366976:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143117.097101:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.097119:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f0f5 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.097143:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.097146:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.097154:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0f5 expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.097175:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0f5 expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.097185:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28a000, rc 0) 00000100:00100000:3.0:1746143117.097224:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858366976:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 142us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.097230:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11679 00000100:00100000:3.0:1746143117.097244:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11681 00000100:00100000:3.0:1746143117.097248:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858367488:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143117.097253:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.097259:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a28a200/0x25aee876ca70b91c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f111 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.097268:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.097269:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.097273:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28a200/0x25aee876ca70b91c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f111 expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.097280:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a28a200/0x25aee876ca70b91c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f111 expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.097286:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28a200, rc 0) 00000100:00100000:3.0:1746143117.097300:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858367488:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 51us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.097306:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11681 00000100:00100000:3.0:1746143117.097326:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858367744 00000100:00100000:3.0:1746143117.097329:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858367744 00002000:00100000:3.0:1746143117.097353:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009314c000 x1830962858367744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.097363:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c000 with x1830962858367744 ext(2097152->3145727) 00010000:00010000:3.0:1746143117.097370:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 31 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.097616:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 31 pid: 4758 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746143117.097623:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314c000 00000100:00100000:3.0:1746143117.097641:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1873 00000100:00100000:3.0:1746143117.097648:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858367744:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143117.108136:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.108199:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858367872 00000100:00100000:0.0:1746143117.108199:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858368128 00000100:00100000:1.0:1746143117.108208:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858367872 00000100:00100000:0.0:1746143117.108208:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858368128 00000100:00100000:1.0:1746143117.108249:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11682 00000100:00100000:0.0:1746143117.108249:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8028 00000100:00100000:1.0:1746143117.108257:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30591:x1830962858367872:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:0.0:1746143117.108257:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30592:x1830962858368128:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143117.108273:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143117.108273:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143117.108289:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496200/0x25aee876ca70b92a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f11f expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.108290:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f118 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.108321:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 19 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.108329:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0f5 expref: 7 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143117.108335:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093462200/0x25aee876ca70b851 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f085 expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.108345:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143117.108347:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143117.108350:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.108376:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093462200/0x25aee876ca70b851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f085 expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.108387:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093462200/0x25aee876ca70b851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f085 expref: 11 pid: 4758 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143117.108398:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861138176:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143117.108398:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.108409:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.108420:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.108430:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.108435:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.108653:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143117.108681:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0f5 expref: 7 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143117.108689:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0f5 expref: 7 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746143117.108697:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861138304:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143117.108722:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 19 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.108730:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 19 pid: 20836 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746143117.108742:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861138432:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143117.108758:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53ccd80 going to sleep for 11 seconds 00010000:00010000:0.0:1746143117.108764:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497200/0x25aee876ca70b93f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.108772:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497200/0x25aee876ca70b93f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.108778:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497200/0x25aee876ca70b93f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143117.108787:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143117.108878:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109491:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109510:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109516:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5497c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143117.109521:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109529:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109541:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143117.109544:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143117.109548:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109553:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497c00/0x25aee876ca70b931 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109572:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109578:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109582:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109587:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5496c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143117.109590:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109595:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109606:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008fddff00) 00010000:00010000:0.0:1746143117.109609:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143117.109611:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109616:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496c00/0x25aee876ca70b938 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143117.109659:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496200/0x25aee876ca70b92a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f11f expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.109670:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497200/0x25aee876ca70b93f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f11f expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.109676:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143117.109679:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143117.109681:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497200, rc 0) 00000100:00100000:0.0:1746143117.109726:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30592:x1830962858368128:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1468us (1602us total) trans 8589942231 rc 0/0 00000100:00100000:0.0:1746143117.109734:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8028 00000100:00080000:0.0:1746143117.109761:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143117.112532:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858367744:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14871us (15446us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143117.112544:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1873 00002000:00100000:3.0:1746143117.112556:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009314c000 x1830962858367744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.112567:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c000 with x1830962858367744 ext(2097152->3145727) 00010000:00010000:3.0:1746143117.112578:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 31 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.112592:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090435e00/0x25aee876ca70b8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0bd expref: 31 pid: 4758 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746143117.112600:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314c000 00000100:00100000:0.0:1746143117.113999:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.114018:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.114069:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.114091:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858368256 00000100:00100000:0.0:1746143117.114097:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858368256 00010000:00010000:0.0:1746143117.114126:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093462200/0x25aee876ca70b851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f085 expref: 12 pid: 4758 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143117.114151:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858368512 00000100:00100000:0.0:1746143117.114153:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858368512 00010000:00010000:0.0:1746143117.114162:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0f5 expref: 8 pid: 20836 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746143117.114172:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858368384 00000100:00100000:0.0:1746143117.114174:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858368384 00010000:00010000:0.0:1746143117.114183:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 20 pid: 20836 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746143117.114196:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6154 00000100:00100000:0.0:1746143117.114202:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858368256:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143117.114216:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143117.114234:0:7112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746143117.114239:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093462200/0x25aee876ca70b851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f085 expref: 12 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143117.114249:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093462200/0x25aee876ca70b851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f085 expref: 12 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143117.114269:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093462200/0x25aee876ca70b851 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f085 expref: 12 pid: 4758 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143117.114282:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143117.114311:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858368256:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 109us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143117.114320:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6154 00000100:00100000:0.0:1746143117.114362:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6155 00000100:00100000:0.0:1746143117.114366:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858368512:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143117.114373:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143117.114381:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0f5 expref: 8 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143117.114388:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a28a000/0x25aee876ca70b90e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0f5 expref: 8 pid: 20836 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746143117.114400:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143117.114414:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858368512:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 47us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143117.114419:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6155 00000100:00100000:0.0:1746143117.114428:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6156 00000100:00100000:0.0:1746143117.114431:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858368384:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143117.114437:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143117.114443:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 20 pid: 20836 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143117.114450:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093463000/0x25aee876ca70b7e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f02a expref: 20 pid: 20836 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746143117.114462:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143117.114464:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143117.114471:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.114479:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.114522:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143117.114533:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861138560:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143117.114574:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143117.116069:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.116099:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.117164:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.117352:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858368896 00000100:00100000:1.0:1746143117.117358:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858368896 00000100:00100000:1.0:1746143117.117408:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 605 00000100:00100000:1.0:1746143117.117414:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1969:x1830962858368896:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143117.117428:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143117.117452:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5497200/0x25aee876ca70b93f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f11f expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.117474:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143117.117478:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143117.117537:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858368896:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 121us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.117543:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 605 00000100:00100000:1.0:1746143117.119914:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11684 00000100:00100000:1.0:1746143117.119925:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858368768:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143117.119934:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143117.119945:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090434200/0x25aee876ca70b954 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f12d expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.119958:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143117.119967:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090434200/0x25aee876ca70b954 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f12d expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143117.119981:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090434200/0x25aee876ca70b954 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f12d expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143117.119990:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090434200, rc 0) 00000100:00100000:1.0:1746143117.120013:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858368768:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 91us (2851us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143117.120019:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11684 00000100:00100000:0.0:1746143117.122101:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.122321:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858369024 00000100:00100000:3.0:1746143117.122328:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858369024 00000100:00100000:3.0:1746143117.122361:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11685 00000100:00100000:3.0:1746143117.122366:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30586:x1830962858369024:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.122379:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.122392:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a28aa00/0x25aee876ca70b95b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f134 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.122413:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.122414:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.122423:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28aa00/0x25aee876ca70b95b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f134 expref: 11 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.122437:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a28aa00/0x25aee876ca70b95b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f134 expref: 11 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.122446:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28aa00, rc 0) 00000100:00100000:3.0:1746143117.122491:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30586:x1830962858369024:12345-192.168.201.28@tcp:101:cat.0 Request processed in 123us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.122507:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11685 00000100:00100000:0.0:1746143117.123970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.124011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.124023:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858369280 00000100:00100000:3.0:1746143117.124027:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858369280 00002000:00100000:3.0:1746143117.124078:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1875968->1880063) req@ffff88012d3d4700 x1830962858369280/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.124088:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d4700 with x1830962858369280 ext(1875968->1880063) 00002000:00010000:3.0:1746143117.124093:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3d4700 00000100:00100000:3.0:1746143117.124118:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5651 00000100:00100000:3.0:1746143117.124124:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858369280:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143117.125059:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858369280:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 933us (1089us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143117.125066:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5651 00002000:00100000:3.0:1746143117.125072:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1875968->1880063) req@ffff88012d3d4700 x1830962858369280/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.125080:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d4700 with x1830962858369280 ext(1875968->1880063) 00002000:00010000:3.0:1746143117.125083:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3d4700 00000100:00100000:0.0:1746143117.127977:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.128122:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858369664 00000100:00100000:1.0:1746143117.128130:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858369664 00000100:00100000:1.0:1746143117.128173:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8029 00000100:00100000:1.0:1746143117.128181:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30592:x1830962858369664:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:0.0:1746143117.128344:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858369920 00000100:00100000:0.0:1746143117.128347:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858369920 00000100:00100000:3.0:1746143117.128354:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861138816:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143117.128373:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746143117.128378:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2351104->2355199) req@ffff88012baa0000 x1830962858369920/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.128387:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0000 with x1830962858369920 ext(2351104->2355199) 00002000:00010000:0.0:1746143117.128391:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0000 00000100:00100000:0.0:1746143117.128402:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858370176 00000100:00100000:0.0:1746143117.128404:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858370176 00000100:00100000:3.0:1746143117.128408:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858369408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4274us (4397us total) trans 0 rc 0/0 00002000:00100000:0.0:1746143117.128415:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88012baa2680 x1830962858370176/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143117.128417:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6157 00002000:00100000:0.0:1746143117.128426:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa2680 with x1830962858370176 ext(2097152->3145727) 00002000:00010000:0.0:1746143117.128429:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa2680 00000100:00100000:0.0:1746143117.128438:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5652 00000100:00100000:3.0:1746143117.128442:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5653 00000100:00100000:0.0:1746143117.128443:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858369920:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143117.128447:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858370176:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143117.128586:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858369920:12345-192.168.201.28@tcp:3:cat.0 Request processed in 143us (340us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143117.128592:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5652 00002000:00100000:0.0:1746143117.128596:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2351104->2355199) req@ffff88012baa0000 x1830962858369920/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.128602:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0000 with x1830962858369920 ext(2351104->2355199) 00002000:00010000:0.0:1746143117.128605:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0000 00010000:00010000:1.0:1746143117.128778:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143117.128795:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090434400/0x25aee876ca70b962 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f13b expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.128881:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128895:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128905:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128915:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128921:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128928:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128933:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090435200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143117.128936:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128942:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128951:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143117.128953:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143117.128956:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128961:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090435200/0x25aee876ca70b969 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143117.128982:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090434400/0x25aee876ca70b962 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f13b expref: 13 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.128989:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090434400/0x25aee876ca70b962 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f13b expref: 13 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.128996:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090434400, rc 0) 00000100:00100000:1.0:1746143117.129017:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30592:x1830962858369664:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 837us (1051us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143117.129022:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8029 00000100:00100000:1.0:1746143117.138611:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.139005:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.139322:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858370432 00000100:00100000:3.0:1746143117.139343:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858370432 00000100:00100000:3.0:1746143117.139756:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3367 00000100:00100000:3.0:1746143117.139766:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30592:x1830962858370432:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:3.0:1746143117.141263:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30592:x1830962858370432:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 1494us (2660us total) trans 8589942232 rc 0/0 00000100:00100000:3.0:1746143117.141276:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3367 00000100:00100000:1.0:1746143117.141758:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.141883:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858370816 00000100:00100000:0.0:1746143117.141889:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858370816 00002000:00100000:0.0:1746143117.141922:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2781184->2785279) req@ffff88009c1e9180 x1830962858370816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.141932:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9180 with x1830962858370816 ext(2781184->2785279) 00002000:00010000:0.0:1746143117.141937:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e9180 00000100:00100000:0.0:1746143117.141953:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5654 00000100:00100000:0.0:1746143117.141958:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858370816:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143117.142120:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858370816:12345-192.168.201.28@tcp:3:cat.0 Request processed in 160us (362us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143117.142126:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5654 00002000:00100000:0.0:1746143117.142132:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2781184->2785279) req@ffff88009c1e9180 x1830962858370816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.142139:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9180 with x1830962858370816 ext(2781184->2785279) 00002000:00010000:0.0:1746143117.142141:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e9180 00000100:00100000:3.0:1746143117.144137:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858370176:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 15684us (15856us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143117.144146:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5653 00002000:00100000:3.0:1746143117.144153:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88012baa2680 x1830962858370176/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.144162:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa2680 with x1830962858370176 ext(2097152->3145727) 00002000:00010000:3.0:1746143117.144166:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa2680 00000100:00100000:0.0:1746143117.147981:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.149856:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858371072 00000100:00100000:3.0:1746143117.150097:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858371072 00000100:00100000:3.0:1746143117.150163:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3368 00000100:00100000:3.0:1746143117.150172:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:30594:x1830962858371072:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143117.150515:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:30594:x1830962858371072:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 343us (2541us total) trans 8589942233 rc 0/0 00000100:00100000:3.0:1746143117.150523:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3368 00000100:00100000:0.0:1746143117.150681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.150744:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858371200 00000100:00100000:3.0:1746143117.150748:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858371200 00010000:00010000:3.0:1746143117.150770:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b52a2800/0x25aee876ca70b900 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0fc expref: 7 pid: 754 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746143117.150791:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6158 00000100:00100000:3.0:1746143117.150795:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858371200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.150804:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143117.150821:0:7112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2077 -> 2079 00010000:00010000:3.0:1746143117.150827:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b52a2800/0x25aee876ca70b900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0fc expref: 7 pid: 754 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746143117.152173:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b52a2800/0x25aee876ca70b900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0fc expref: 7 pid: 754 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746143117.152198:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b52a2800/0x25aee876ca70b900 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0fc expref: 7 pid: 754 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746143117.152209:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143117.152229:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858371200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1433us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.152235:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6158 00000100:00100000:0.0:1746143117.154449:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.155302:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.155406:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858371328 00000100:00100000:3.0:1746143117.155415:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858371328 00010000:00010000:3.0:1746143117.155445:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094214e00/0x25aee876ca70b86d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f09a expref: 19 pid: 8448 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143117.155471:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858371456 00000100:00100000:3.0:1746143117.155472:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858371456 00010000:00010000:3.0:1746143117.155481:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094215400/0x25aee876ca70b866 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f093 expref: 12 pid: 8448 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746143117.155939:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6159 00000100:00100000:3.0:1746143117.155946:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858371328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.155958:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143117.155979:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094214e00/0x25aee876ca70b86d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f09a expref: 19 pid: 8448 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.155993:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094214e00/0x25aee876ca70b86d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f09a expref: 19 pid: 8448 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.156014:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094214e00/0x25aee876ca70b86d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f09a expref: 19 pid: 8448 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.156047:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143117.156081:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858371328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.156087:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6159 00000100:00100000:3.0:1746143117.156100:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6160 00000100:00100000:3.0:1746143117.156104:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858371456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.156110:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143117.156118:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094215400/0x25aee876ca70b866 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f093 expref: 12 pid: 8448 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.156126:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094215400/0x25aee876ca70b866 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f093 expref: 12 pid: 8448 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.156138:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094215400/0x25aee876ca70b866 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f093 expref: 12 pid: 8448 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746143117.156146:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.156148:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.156155:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.156164:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.156192:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.156203:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861139328:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143117.156259:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143117.160218:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.164550:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.164839:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861139328:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143117.164860:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143117.164867:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.164911:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858371456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8804us (9608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.164922:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6160 00000100:00100000:3.0:1746143117.165002:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858371968 00000100:00100000:3.0:1746143117.165008:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858371968 00002000:00100000:3.0:1746143117.165068:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1347584->1351679) req@ffff88012d3d6300 x1830962858371968/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.165077:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d6300 with x1830962858371968 ext(1347584->1351679) 00002000:00010000:3.0:1746143117.165082:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3d6300 00000100:00100000:3.0:1746143117.165142:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5655 00000100:00100000:3.0:1746143117.165150:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858371968:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143117.165325:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858371968:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 177us (457us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143117.165336:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5655 00002000:00100000:3.0:1746143117.165341:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1347584->1351679) req@ffff88012d3d6300 x1830962858371968/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.165348:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d6300 with x1830962858371968 ext(1347584->1351679) 00002000:00010000:3.0:1746143117.165351:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3d6300 00000100:00100000:0.0:1746143117.167175:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.169205:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.169297:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858372352 00000100:00100000:3.0:1746143117.169302:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858372352 00000100:00100000:3.0:1746143117.169341:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11689 00000100:00100000:3.0:1746143117.169346:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858372352:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.169361:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.169604:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a28be00/0x25aee876ca70b985 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f157 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.169632:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a28be00/0x25aee876ca70b985 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f157 expref: 31 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.169641:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a28be00/0x25aee876ca70b985 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f157 expref: 31 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.169654:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28be00, rc 0) 00000100:00100000:3.0:1746143117.169695:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858372352:12345-192.168.201.28@tcp:101:cat.0 Request processed in 349us (494us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143117.169701:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11689 00000100:00100000:0.0:1746143117.173948:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.205634:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.205727:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.205805:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858372608 00000100:00100000:3.0:1746143117.205815:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858372608 00000100:00100000:3.0:1746143117.205854:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858372736 00000100:00100000:3.0:1746143117.205856:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858372736 00000100:00100000:3.0:1746143117.205883:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11691 00000100:00100000:3.0:1746143117.205891:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858372608:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.205909:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.205928:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a28b800/0x25aee876ca70b993 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f165 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.205985:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861139584:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143117.207343:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143117.207823:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:3.0:1746143117.210905:0:8448:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143115 -> 1746143116 00002000:00010000:3.0:1746143117.210909:0:8448:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143115 -> 1746143116 00000100:00100000:3.0:1746143117.210920:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861139584:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143117.210936:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a28b800/0x25aee876ca70b993 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f165 expref: 19 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.210945:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a28b800/0x25aee876ca70b993 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f165 expref: 19 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.210956:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28b800, rc 0) 00000100:00100000:3.0:1746143117.212002:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858372608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6106us (6373us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143117.212011:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11691 00000100:00100000:0.0:1746143117.228945:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.229223:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858372992 00000100:00100000:3.0:1746143117.229233:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858372992 00000100:00100000:3.0:1746143117.229822:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11694 00000100:00100000:3.0:1746143117.229830:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30602:x1830962858372992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.229851:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.229870:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f17a expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.229902:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.229910:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.229912:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.229916:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.229945:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.229957:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 10 pid: 8450 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.229970:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861139840:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.230092:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143117.233636:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.233751:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861139840:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.233782:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.233802:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28a800, rc 0) 00000100:00100000:3.0:1746143117.233852:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30602:x1830962858372992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4021us (4916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.233862:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11694 00000100:00100000:1.0:1746143117.235256:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858373120 00000100:00100000:1.0:1746143117.235266:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858373120 00002000:00100000:1.0:1746143117.235307:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x303:0x0] (1875968->2097151) req@ffff88012d3d5c00 x1830962858373120/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.235317:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d5c00 with x1830962858373120 ext(1875968->2097151) 00010000:00010000:1.0:1746143117.235324:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 11 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.235557:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 11 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143117.235565:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3d5c00 00000100:00100000:1.0:1746143117.235591:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1874 00000100:00100000:1.0:1746143117.235597:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858373120:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143117.241591:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858373120:12345-192.168.201.28@tcp:4:cat.0 Request processed in 5980us (7956us total) trans 17179872651 rc 0/0 00000100:00100000:1.0:1746143117.241604:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1874 00002000:00100000:1.0:1746143117.241616:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x303:0x0] (1875968->2097151) req@ffff88012d3d5c00 x1830962858373120/t17179872651(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/448 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.241625:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d5c00 with x1830962858373120 ext(1875968->2097151) 00010000:00010000:1.0:1746143117.241635:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.241650:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143117.241658:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3d5c00 00000100:00100000:0.0:1746143117.245365:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.245429:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858373248 00000100:00100000:3.0:1746143117.245439:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858373248 00010000:00010000:3.0:1746143117.245475:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.245961:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6161 00000100:00100000:3.0:1746143117.245970:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858373248:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.245988:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143117.246012:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.246023:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.246623:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090435800/0x25aee876ca70b923 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f118 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.246943:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.246946:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.246955:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 18 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.246964:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 18 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.247000:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 18 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.247013:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861139968:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143117.247825:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143117.251593:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861139968:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143117.251617:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143117.251671:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858373248:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5701us (6314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.251682:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6161 00000100:00100000:3.0:1746143117.312210:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.312242:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858373760 00000100:00100000:3.0:1746143117.312249:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858373760 00000100:00100000:3.0:1746143117.312288:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8030 00000100:00100000:3.0:1746143117.312295:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:30606:x1830962858373760:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143117.312319:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.312337:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28b000/0x25aee876ca70b9af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f181 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.312648:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a600/0x25aee876ca70b9b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143117.312663:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d9 expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.312670:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a600/0x25aee876ca70b9b6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143117.312691:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d9 expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.312703:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d9 expref: 12 pid: 1037 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.312713:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861140224:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.312786:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143117.317187:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861140096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143117.317254:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143117.317289:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143117.317295:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1830962861140608:0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.317317:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143117.317337:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3301:1830962861140352:0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.317360:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143117.317382:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143117.317388:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1830962861140480:0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.317635:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143117.317666:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861140096 00000100:00100000:1.0:1746143117.317673:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861140096 00000100:00100000:1.0:1746143117.317718:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1746143117.317726:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830962861140096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746143117.317750:0:8451:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 450428928 pending 35782656 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746143117.317785:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830962861140096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.317792:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1746143117.317861:0:14791:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861140352 00000100:00100000:1.0:1746143117.317864:0:14791:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861140352 00000100:00100000:1.0:1746143117.317882:0:14791:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1746143117.317886:0:14791:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3301:x1830962861140352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.317913:0:14791:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3301:x1830962861140352:12345-0@lo:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.317918:0:14791:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1746143117.317938:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861140608 00000100:00100000:1.0:1746143117.317940:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861140608 00000100:00100000:1.0:1746143117.317958:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861140480 00000100:00100000:1.0:1746143117.317960:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861140480 00000100:00100000:1.0:1746143117.317972:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1746143117.317976:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1830962861140608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.318001:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1830962861140608:12345-0@lo:400:kworker.0 Request processed in 24us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.318006:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1746143117.318014:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1746143117.318018:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830962861140480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.318053:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830962861140480:12345-0@lo:400:kworker.0 Request processed in 34us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.318057:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1746143117.318096:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1830962861140608:0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.318103:0:3300:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839874 gen 2 00000004:00080000:1.0:1746143117.318108:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad5ad80, transno 21474839807 00000004:00080000:1.0:1746143117.318114:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad5aa00, transno 21474839808 00000004:00080000:1.0:1746143117.318116:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad58700, transno 21474839809 00000004:00080000:1.0:1746143117.318118:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad5b800, transno 21474839810 00000004:00080000:1.0:1746143117.318120:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad59500, transno 21474839811 00000004:00080000:1.0:1746143117.318122:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad58380, transno 21474839812 00000004:00080000:1.0:1746143117.318124:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad58000, transno 21474839813 00000004:00080000:1.0:1746143117.318126:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad58a80, transno 21474839814 00000004:00080000:1.0:1746143117.318129:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dea00, transno 21474839815 00000004:00080000:1.0:1746143117.318132:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919de300, transno 21474839819 00000004:00080000:1.0:1746143117.318133:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919ddf80, transno 21474839820 00000004:00080000:1.0:1746143117.318136:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919ded80, transno 21474839821 00000004:00080000:1.0:1746143117.318138:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094516a00, transno 21474839822 00000004:00080000:1.0:1746143117.318141:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80f100, transno 21474839823 00000004:00080000:1.0:1746143117.318143:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919df480, transno 21474839824 00000004:00080000:1.0:1746143117.318145:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aece00, transno 21474839825 00000004:00080000:1.0:1746143117.318147:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919df100, transno 21474839826 00000004:00080000:1.0:1746143117.318149:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dd880, transno 21474839827 00000004:00080000:1.0:1746143117.318152:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe79880, transno 21474839828 00000004:00080000:1.0:1746143117.318154:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe79f80, transno 21474839829 00000004:00080000:1.0:1746143117.318156:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800942c4e00, transno 21474839830 00000004:00080000:1.0:1746143117.318158:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7aa00, transno 21474839831 00000004:00080000:1.0:1746143117.318160:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7b800, transno 21474839832 00000004:00080000:1.0:1746143117.318162:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800942c5c00, transno 21474839833 00000004:00080000:1.0:1746143117.318164:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7bb80, transno 21474839834 00000004:00080000:1.0:1746143117.318165:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe78000, transno 21474839835 00000004:00080000:1.0:1746143117.318167:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800942c6a00, transno 21474839836 00000004:00080000:1.0:1746143117.318169:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a531b800, transno 21474839845 00000004:00080000:1.0:1746143117.318171:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80c380, transno 21474839846 00000004:00080000:1.0:1746143117.318173:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80fb80, transno 21474839847 00000004:00080000:1.0:1746143117.318174:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80d180, transno 21474839848 00000004:00080000:1.0:1746143117.318176:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80c700, transno 21474839849 00000004:00080000:1.0:1746143117.318178:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fed80, transno 21474839850 00000004:00080000:1.0:1746143117.318180:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad59880, transno 21474839851 00000004:00080000:1.0:1746143117.318181:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80d500, transno 21474839852 00000004:00080000:1.0:1746143117.318183:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f359500, transno 21474839853 00000004:00080000:1.0:1746143117.318185:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c47100, transno 21474839857 00000004:00080000:1.0:1746143117.318187:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c45180, transno 21474839858 00000004:00080000:1.0:1746143117.318189:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c47b80, transno 21474839859 00000004:00080000:1.0:1746143117.318191:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c47800, transno 21474839860 00000004:00080000:1.0:1746143117.318194:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c44e00, transno 21474839861 00000004:00080000:1.0:1746143117.318196:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c44700, transno 21474839862 00000004:00080000:1.0:1746143117.318198:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c44380, transno 21474839863 00000004:00080000:1.0:1746143117.318200:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c47480, transno 21474839864 00000004:00080000:1.0:1746143117.318201:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c45880, transno 21474839865 00000004:00080000:1.0:1746143117.318203:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314ed80, transno 21474839866 00000004:00080000:1.0:1746143117.318205:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314ea00, transno 21474839867 00000004:00080000:1.0:1746143117.318207:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314f800, transno 21474839868 00000004:00080000:1.0:1746143117.318210:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f394000, transno 21474839869 00000004:00080000:1.0:1746143117.318212:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314f480, transno 21474839870 00000004:00080000:1.0:1746143117.318214:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314ca80, transno 21474839871 00000004:00080000:1.0:1746143117.318216:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314f100, transno 21474839872 00000004:00080000:1.0:1746143117.318218:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314fb80, transno 21474839873 00000004:00080000:1.0:1746143117.318220:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314dc00, transno 21474839874 00000100:00100000:1.0:1746143117.318226:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861140096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143117.318249:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1830962861140480:0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.318254:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3301:1830962861140352:0@lo:400:kworker.0 00000100:00080000:0.0:1746143117.321970:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143117.321978:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143117.321980:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746143117.322407:0:14835:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 54 done 00010000:00010000:3.0:1746143117.326646:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbc5400/0x25aee876ca70b8e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0d9 expref: 12 pid: 1037 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.326661:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861140224:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.326676:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a600/0x25aee876ca70b9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143117.326683:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a600/0x25aee876ca70b9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143117.326688:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a600/0x25aee876ca70b9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143117.326706:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143117.326824:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28b000/0x25aee876ca70b9af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f181 expref: 209 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.326834:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a600/0x25aee876ca70b9b6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f181 expref: 208 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.326840:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.326843:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143117.326846:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28a600, rc 0) 00000100:00100000:3.0:1746143117.326878:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:30606:x1830962858373760:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14583us (14676us total) trans 8589942235 rc 0/0 00000100:00100000:3.0:1746143117.326885:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8030 00000100:00100000:3.0:1746143117.326898:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858374144 00000100:00100000:3.0:1746143117.326901:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858374144 00000100:00100000:3.0:1746143117.326920:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8031 00000100:00100000:3.0:1746143117.326924:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30607:x1830962858374144:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143117.326936:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.326943:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a400/0x25aee876ca70b9cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f18f expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.327005:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a000/0x25aee876ca70b9d2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143117.327013:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a000/0x25aee876ca70b9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143117.327019:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a000/0x25aee876ca70b9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143117.327025:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143117.327082:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a400/0x25aee876ca70b9cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f18f expref: 17 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.327091:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a000/0x25aee876ca70b9d2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f18f expref: 16 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.327096:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.327098:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143117.327101:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28a000, rc 0) 00000100:00100000:3.0:1746143117.327117:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30607:x1830962858374144:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 192us (1580us total) trans 8589942236 rc 0/0 00000100:00100000:3.0:1746143117.327122:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8031 00000100:00100000:1.0:1746143117.327426:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143117.327440:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830962861140864:0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.327480:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143117.328257:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861140864 00000100:00100000:1.0:1746143117.328261:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861140864 00000100:00100000:1.0:1746143117.328281:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1746143117.328286:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1830962861140864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.328316:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1830962861140864:12345-0@lo:400:kworker.0 Request processed in 30us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.328323:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1746143117.328349:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830962861140864:0@lo:400:kworker.0 00000100:00100000:1.0:1746143117.362453:0:25353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861141120 00000100:00100000:1.0:1746143117.362460:0:25353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861141120 00000100:00100000:1.0:1746143117.362509:0:25353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1746143117.362517:0:25353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1830962861141120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746143117.362542:0:25353:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 455409664 pending 5111808 free 3851419648 avail 3830448128 00000100:00100000:1.0:1746143117.362583:0:25353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1830962861141120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.362589:0:25353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1746143117.362630:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861141120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143117.363080:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858374400:12345-192.168.201.28@tcp:4:cat.0 Request processed in 17430us (17606us total) trans 17179872652 rc 0/0 00000100:00100000:1.0:1746143117.363088:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1875 00002000:00100000:1.0:1746143117.363097:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1351679) req@ffff8801317b4e00 x1830962858374400/t17179872652(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/448 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.363107:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b4e00 with x1830962858374400 ext(1048576->1351679) 00010000:00010000:1.0:1746143117.363117:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 14 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.363131:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 14 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143117.363137:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801317b4e00 00000100:00100000:3.0:1746143117.377121:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858374528 00000100:00100000:3.0:1746143117.377131:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858374528 00010000:00010000:3.0:1746143117.377168:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 14 pid: 8450 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.378425:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6163 00000100:00100000:3.0:1746143117.378436:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858374528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.378450:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143117.378474:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 14 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.378487:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 14 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.379103:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f07a00/0x25aee876ca70b970 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f142 expref: 14 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.379118:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.379120:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.379128:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.379136:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.379175:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 19 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.379187:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861141248:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143117.379281:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143117.385587:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861141248:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143117.385609:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143117.385703:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858374528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7267us (8636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.385714:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6163 00000100:00100000:0.0:1746143117.400927:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.400960:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.400987:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858374784 00000100:00100000:0.0:1746143117.400996:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858374784 00002000:00100000:0.0:1746143117.401060:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012d3d7480 x1830962858374784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.401071:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d7480 with x1830962858374784 ext(1048576->2097151) 00002000:00010000:0.0:1746143117.401077:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3d7480 00000100:00100000:0.0:1746143117.401093:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858375040 00000100:00100000:0.0:1746143117.401095:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858375040 00002000:00100000:0.0:1746143117.401108:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800a531b800 x1830962858375040/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.401115:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b800 with x1830962858375040 ext(1048576->2097151) 00002000:00010000:0.0:1746143117.401118:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531b800 00000100:00100000:0.0:1746143117.401130:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5657 00000100:00100000:0.0:1746143117.401136:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858374784:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143117.402056:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5658 00000100:00100000:0.0:1746143117.402061:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858375040:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143117.429863:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858375040:12345-192.168.201.28@tcp:3:cat.0 Request processed in 27796us (28896us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143117.429873:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5658 00002000:00100000:0.0:1746143117.429886:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800a531b800 x1830962858375040/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.429896:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b800 with x1830962858375040 ext(1048576->2097151) 00002000:00010000:0.0:1746143117.429902:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531b800 00000100:00100000:0.0:1746143117.438644:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.438702:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858375424 00000100:00100000:3.0:1746143117.438713:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858375424 00000100:00100000:3.0:1746143117.438752:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11698 00000100:00100000:3.0:1746143117.438759:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1970:x1830962858375424:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.438777:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.438795:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a28b000/0x25aee876ca70b9ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1a4 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.439056:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a28b000/0x25aee876ca70b9ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1a4 expref: 31 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.439068:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a28b000/0x25aee876ca70b9ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1a4 expref: 31 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.439081:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28b000, rc 0) 00000100:00100000:3.0:1746143117.439124:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1970:x1830962858375424:12345-192.168.201.28@tcp:101:cat.0 Request processed in 366us (737us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143117.439131:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11698 00000100:00100000:0.0:1746143117.443902:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858374784:12345-192.168.201.28@tcp:3:cat.0 Request processed in 42749us (42970us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143117.443919:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5657 00002000:00100000:0.0:1746143117.443936:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012d3d7480 x1830962858374784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.443948:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d7480 with x1830962858374784 ext(1048576->2097151) 00002000:00010000:0.0:1746143117.443955:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3d7480 00000100:00100000:0.0:1746143117.463078:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858375936 00000100:00100000:0.0:1746143117.463087:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858375936 00002000:00100000:0.0:1746143117.463136:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009314f800 x1830962858375936/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.463147:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314f800 with x1830962858375936 ext(1048576->2097151) 00002000:00010000:0.0:1746143117.463154:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314f800 00000100:00100000:0.0:1746143117.463175:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5659 00000100:00100000:0.0:1746143117.463183:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858375936:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143117.477677:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.477763:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858376064 00000100:00100000:3.0:1746143117.478087:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858376064 00000100:00100000:3.0:1746143117.478134:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11699 00000100:00100000:3.0:1746143117.478142:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:30602:x1830962858376064:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.479117:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.479136:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a28b800/0x25aee876ca70b9f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1ab expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.479169:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2351104->3145727] (req 2351104->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 38 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.479177:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.479179:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.479182:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a28b800/0x25aee876ca70b9f5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ab expref: 38 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.479210:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2351104->3145727] (req 2351104->2785279) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 38 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.479222:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2351104->3145727] (req 2351104->2785279) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 38 pid: 4758 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.479234:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861141376:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.479336:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3a600 going to sleep for 11 seconds 00010000:00010000:0.0:1746143117.486153:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143117.489655:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858375680:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26129us (26875us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143117.489668:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5660 00002000:00100000:0.0:1746143117.489680:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009314ea00 x1830962858375680/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.489690:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314ea00 with x1830962858375680 ext(1048576->2097151) 00002000:00010000:0.0:1746143117.489697:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314ea00 00000100:00100000:0.0:1746143117.494687:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858375936:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31492us (31645us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143117.494701:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5659 00002000:00100000:0.0:1746143117.494713:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009314f800 x1830962858375936/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.494722:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314f800 with x1830962858375936 ext(1048576->2097151) 00002000:00010000:0.0:1746143117.494729:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314f800 00000100:00100000:3.0:1746143117.496793:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861141376:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.496827:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a28b800/0x25aee876ca70b9f5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ab expref: 38 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.496847:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a28b800, rc 0) 00000100:00100000:3.0:1746143117.498269:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:30602:x1830962858376064:12345-192.168.201.28@tcp:101:cat.0 Request processed in 20118us (20590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.498280:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11699 00000100:00100000:0.0:1746143117.499675:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858376192 00000100:00100000:0.0:1746143117.499680:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858376192 00002000:00100000:0.0:1746143117.499868:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2351104->2785279) req@ffff88009314f480 x1830962858376192/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.499878:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314f480 with x1830962858376192 ext(2351104->2785279) 00010000:00010000:0.0:1746143117.499887:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2351104->3145727] (req 2351104->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 38 pid: 4758 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143117.499898:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2351104->3145727] (req 2351104->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 38 pid: 4758 timeout: 999 lvb_type: 0 00002000:00010000:0.0:1746143117.499904:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314f480 00000100:00100000:0.0:1746143117.499919:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1876 00000100:00100000:0.0:1746143117.499924:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858376192:12345-192.168.201.28@tcp:4:cat.0 00000001:00080000:3.0:1746143117.513008:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839899 is committed 00000001:00080000:3.0:1746143117.513066:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839895 is committed 00000001:00080000:3.0:1746143117.513137:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839900 is committed 00000001:00080000:3.0:1746143117.513146:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839898 is committed 00000100:00100000:0.0:1746143117.525107:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.525336:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.525431:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858376448 00000100:00100000:1.0:1746143117.525440:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858376448 00010000:00010000:1.0:1746143117.525478:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a000/0x25aee876ca70b9d2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f18f expref: 16 pid: 17079 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143117.525534:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6164 00000100:00100000:1.0:1746143117.525542:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858376448:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143117.525557:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143117.525564:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a000/0x25aee876ca70b9d2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f18f expref: 16 pid: 17079 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.525574:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a000/0x25aee876ca70b9d2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f18f expref: 16 pid: 17079 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.525596:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a28a000/0x25aee876ca70b9d2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f18f expref: 16 pid: 17079 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.525623:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143117.525628:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143117.525639:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143117.525648:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143117.525654:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143117.525697:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858376448:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 156us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.525703:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6164 00000100:00100000:3.0:1746143117.525771:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858376576 00000100:00100000:3.0:1746143117.525775:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858376576 00000100:00100000:3.0:1746143117.525799:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11700 00000100:00100000:3.0:1746143117.525804:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30610:x1830962858376576:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.525820:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.525834:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec51c00/0x25aee876ca70ba18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1b9 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.525854:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.525858:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec51c00/0x25aee876ca70ba18 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b9 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.525868:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec51c00/0x25aee876ca70ba18 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b9 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.525877:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec51c00, rc 0) 00000100:00100000:3.0:1746143117.525894:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30610:x1830962858376576:12345-192.168.201.28@tcp:101:cat.0 Request processed in 91us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.525899:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11700 00000100:00100000:3.0:1746143117.529351:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858376704 00000100:00100000:3.0:1746143117.529355:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858376704 00000100:00100000:3.0:1746143117.529383:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11701 00000100:00100000:3.0:1746143117.529390:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30606:x1830962858376704:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143117.529405:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.529420:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1c0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.529443:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cf5a00/0x25aee876ca70b55d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee01 expref: 19 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.529452:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092abd800/0x25aee876ca70b660 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eed3 expref: 10 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.529457:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143117.529460:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143117.529463:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4001792->4194303] (req 4001792->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 19 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.529499:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092abd800/0x25aee876ca70b660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eed3 expref: 10 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.529510:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092abd800/0x25aee876ca70b660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eed3 expref: 10 pid: 20836 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.529520:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861141760:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.529586:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cf5a00/0x25aee876ca70b55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee01 expref: 19 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.529600:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cf5a00/0x25aee876ca70b55d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee01 expref: 19 pid: 20836 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.529608:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861141888:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.529625:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143117.531810:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861141760:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.531823:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861141888:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.533166:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4001792->4194303] (req 4001792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 19 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.533186:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec51200, rc 0) 00000100:00100000:3.0:1746143117.533231:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30606:x1830962858376704:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3841us (4516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.533240:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11701 00010000:00010000:3.0:1746143117.535639:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535648:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:3.0:1746143117.535696:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143117.535701:0:14795:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143117.535718:0:14795:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535729:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535740:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26400/0x25aee876ca70ba03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535747:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26400/0x25aee876ca70ba03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535754:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26400/0x25aee876ca70ba03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535759:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff26400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143117.535764:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26400/0x25aee876ca70ba03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535771:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26400/0x25aee876ca70ba03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535780:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143117.535783:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143117.535787:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26400/0x25aee876ca70ba03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535792:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26400/0x25aee876ca70ba03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535806:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff27600/0x25aee876ca70ba0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535811:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff27600/0x25aee876ca70ba0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535817:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff27600/0x25aee876ca70ba0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535821:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff27600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143117.535824:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff27600/0x25aee876ca70ba0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535829:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff27600/0x25aee876ca70ba0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535835:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531300) 00010000:00010000:3.0:1746143117.535837:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143117.535839:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff27600/0x25aee876ca70ba0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535844:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff27600/0x25aee876ca70ba0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.535876:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26800/0x25aee876ca70b9fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b2 expref: 14 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.535887:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b2 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.535894:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.535897:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143117.535899:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff26200, rc 0) 00000100:00100000:3.0:1746143117.535932:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30611:x1830962858376320:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 37101us (37200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.535939:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8032 00000100:00100000:0.0:1746143117.536114:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.539850:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858376192:12345-192.168.201.28@tcp:4:cat.0 Request processed in 39914us (41173us total) trans 21474839901 rc 0/0 00000100:00100000:1.0:1746143117.539862:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1876 00002000:00100000:1.0:1746143117.539874:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2351104->2785279) req@ffff88009314f480 x1830962858376192/t21474839901(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/448 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.539884:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314f480 with x1830962858376192 ext(2351104->2785279) 00010000:00010000:1.0:1746143117.539893:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2351104->3145727] (req 2351104->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 18 pid: 4758 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.539905:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a527c800/0x25aee876ca70b8eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2351104->3145727] (req 2351104->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0e0 expref: 18 pid: 4758 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143117.539911:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314f480 00000100:00100000:0.0:1746143117.545254:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.545295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.548156:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858377216 00000100:00100000:3.0:1746143117.548170:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858377216 00000100:00100000:3.0:1746143117.548331:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11703 00000100:00100000:3.0:1746143117.548338:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858377088:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143117.548348:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.548357:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec50200/0x25aee876ca70ba2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1c7 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.548368:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.548369:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.548376:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec50200/0x25aee876ca70ba2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c7 expref: 9 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.548391:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec50200/0x25aee876ca70ba2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c7 expref: 9 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.548402:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec50200, rc 0) 00000100:00100000:3.0:1746143117.548647:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858377088:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 308us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.548653:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11703 00000100:00100000:1.0:1746143117.549254:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.549286:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.549325:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.549597:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858377344 00000100:00100000:3.0:1746143117.549601:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858377344 00000100:00100000:3.0:1746143117.549621:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11704 00000100:00100000:3.0:1746143117.549627:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858377344:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143117.549638:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.549648:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec51400/0x25aee876ca70ba34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1d5 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.549670:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec51400/0x25aee876ca70ba34 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1d5 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.549684:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec51400/0x25aee876ca70ba34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1d5 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.549695:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec51400, rc 0) 00000100:00100000:3.0:1746143117.549721:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858377344:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 94us (434us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143117.549726:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11704 00000100:00100000:0.0:1746143117.557364:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.557736:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858377856 00000100:00100000:1.0:1746143117.557746:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858377856 00002000:00100000:1.0:1746143117.557792:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5e38a80 x1830962858377856/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.557805:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e38a80 with x1830962858377856 ext(2097152->3145727) 00002000:00010000:1.0:1746143117.557811:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e38a80 00000100:00100000:1.0:1746143117.557840:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5661 00000100:00100000:0.0:1746143117.557841:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.557848:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858377856:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143117.558953:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.559003:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858378368 00000100:00100000:3.0:1746143117.559008:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858378368 00000100:00100000:0.0:1746143117.559015:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:3.0:1746143117.559028:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5e3a300 x1830962858378368/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.559058:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3a300 with x1830962858378368 ext(2097152->3145727) 00000100:00100000:0.0:1746143117.559062:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858378496 00002000:00010000:3.0:1746143117.559063:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3a300 00000100:00100000:0.0:1746143117.559065:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858378496 00000100:00100000:3.0:1746143117.559077:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5662 00002000:00100000:0.0:1746143117.559078:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4001792->4005887) req@ffff8800a5e38700 x1830962858378496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143117.559082:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858378368:12345-192.168.201.28@tcp:3:multiop.0 00002000:00100000:0.0:1746143117.559085:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e38700 with x1830962858378496 ext(4001792->4005887) 00002000:00010000:0.0:1746143117.559089:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e38700 00000100:00100000:0.0:1746143117.559099:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5663 00000100:00100000:0.0:1746143117.559104:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858378496:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143117.559231:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858378496:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 125us (214us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143117.559238:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5663 00002000:00100000:0.0:1746143117.559243:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4001792->4005887) req@ffff8800a5e38700 x1830962858378496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.559250:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e38700 with x1830962858378496 ext(4001792->4005887) 00002000:00010000:0.0:1746143117.559253:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e38700 00000100:00100000:3.0:1746143117.568523:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858378880 00000100:00100000:3.0:1746143117.568532:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858378880 00000100:00100000:3.0:1746143117.568572:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858379008 00000100:00100000:3.0:1746143117.568574:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858379008 00000100:00100000:3.0:1746143117.568680:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11706 00000100:00100000:3.0:1746143117.568686:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30607:x1830962858379008:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143117.568694:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.568699:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec51000/0x25aee876ca70ba50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1ea expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143117.568801:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861142400:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143117.568820:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70ba42 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.568859:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143117.568865:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 8/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3145728->3665919] (req 3145728->3665919) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.568871:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746143117.568873:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec51000/0x25aee876ca70ba50 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3387392->4194303] (req 3387392->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ea expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.569095:0:8448:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3145728->3665919] (req 3145728->3665919) gid 0 flags: 0x60000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.569107:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec51000/0x25aee876ca70ba50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3387392->4194303] (req 3387392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ea expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.571192:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec51000, rc 0) 00000100:00100000:3.0:1746143117.571247:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30607:x1830962858379008:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 2559us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.571256:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11706 00000100:00100000:3.0:1746143117.571292:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858378752 00000100:00100000:3.0:1746143117.571297:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858378752 00010000:00010000:3.0:1746143117.571321:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b2 expref: 15 pid: 14795 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.571343:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6169 00000100:00100000:3.0:1746143117.571347:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1969:x1830962858378752:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.571360:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143117.571366:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b2 expref: 15 pid: 14795 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.571597:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b2 expref: 15 pid: 14795 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.571618:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff26200/0x25aee876ca70ba11 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b2 expref: 15 pid: 14795 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.571679:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.571684:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70ba42 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.571693:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70ba42 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.571699:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70ba42 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.571716:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143117.571959:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70ba42 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.571969:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70ba42 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:0.0:1746143117.571989:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:3.0:1746143117.572975:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858378752:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1623us (4713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.572985:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6169 00000100:00100000:3.0:1746143117.573225:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861142528:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.573787:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861142656:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.573795:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861142912:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.573802:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861143040:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.575164:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858378368:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 16080us (16210us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143117.575174:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5662 00002000:00100000:3.0:1746143117.575184:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5e3a300 x1830962858378368/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.575193:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3a300 with x1830962858378368 ext(2097152->3145727) 00002000:00010000:3.0:1746143117.575198:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3a300 00010000:00010000:0.0:1746143117.576901:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2bc00/0x25aee876ca70ba3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1dc expref: 15 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.576931:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70ba42 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1dc expref: 14 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.576940:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143117.576942:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143117.576946:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2a400, rc 0) 00000100:00100000:0.0:1746143117.577197:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30611:x1830962858378240:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 17591us (19355us total) trans 8589942237 rc 0/0 00000100:00100000:0.0:1746143117.577205:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8033 00000100:00100000:3.0:1746143117.577304:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.577659:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.577673:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.577691:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858379264 00000100:00100000:3.0:1746143117.577697:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858379264 00010000:00010000:3.0:1746143117.577723:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70b66e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eee1 expref: 22 pid: 20836 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.577742:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858379136 00000100:00100000:3.0:1746143117.577744:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858379136 00010000:00010000:3.0:1746143117.577753:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29e00/0x25aee876ca70b675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eee8 expref: 16 pid: 20836 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.577764:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858379392 00000100:00100000:3.0:1746143117.577765:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858379392 00010000:00010000:3.0:1746143117.577773:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28a200/0x25aee876ca70b91c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f111 expref: 8 pid: 20836 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143117.577786:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6170 00000100:00100000:3.0:1746143117.577791:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858379264:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.577804:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143117.577828:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70b66e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 9 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eee1 expref: 22 pid: 20836 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.577838:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70b66e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 9 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eee1 expref: 22 pid: 20836 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.577857:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70b66e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 9 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eee1 expref: 22 pid: 20836 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.577870:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143117.578954:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6171 00000100:00100000:0.0:1746143117.578967:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858379136:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143117.578980:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143117.578994:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29e00/0x25aee876ca70b675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eee8 expref: 16 pid: 20836 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143117.579008:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29e00/0x25aee876ca70b675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eee8 expref: 16 pid: 20836 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143117.579025:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29e00/0x25aee876ca70b675 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164eee8 expref: 16 pid: 20836 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.579202:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858379264:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1407us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.579209:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6170 00000100:00100000:1.0:1746143117.579296:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861143168:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143117.579345:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 9 type: EXT [3145728->3665919] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.579356:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2ac00, rc 0) 00000100:00100000:3.0:1746143117.579379:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6172 00000100:00100000:3.0:1746143117.579386:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858379392:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143117.579390:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30606:x1830962858378880:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10787us (11076us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143117.579394:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143117.579397:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11705 00010000:00010000:3.0:1746143117.579404:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a28a200/0x25aee876ca70b91c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f111 expref: 8 pid: 20836 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143117.579416:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a28a200/0x25aee876ca70b91c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f111 expref: 8 pid: 20836 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143117.579429:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a28a200/0x25aee876ca70b91c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f111 expref: 8 pid: 20836 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143117.579437:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143117.579459:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858379392:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 73us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.579465:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6172 00010000:00010000:0.0:1746143117.579566:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143117.579588:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858379136:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 627us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143117.579594:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6171 00000100:00100000:0.0:1746143117.581076:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.582292:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.582321:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.582342:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858379904 00000100:00100000:0.0:1746143117.582346:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858379904 00000100:00100000:0.0:1746143117.582374:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8034 00000100:00100000:0.0:1746143117.582380:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30611:x1830962858379904:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143117.582399:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143117.582401:0:14795:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143117.582417:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70ba42 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1dc expref: 14 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.582429:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143117.582433:0:14795:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143117.582445:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe400/0x25aee876ca70ba5e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1f1 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.583116:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858377856:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25267us (25759us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143117.583126:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5661 00002000:00100000:3.0:1746143117.583136:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5e38a80 x1830962858377856/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.583145:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e38a80 with x1830962858377856 ext(2097152->3145727) 00002000:00010000:3.0:1746143117.583150:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e38a80 00010000:00010000:0.0:1746143117.583946:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.583960:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.583973:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.583985:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.583991:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.583997:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.584004:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dbe000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143117.584008:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.584014:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.584021:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143117.584024:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143117.584026:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.584045:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe000/0x25aee876ca70ba65 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143117.584071:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe400/0x25aee876ca70ba5e lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1f1 expref: 14 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.584078:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe400/0x25aee876ca70ba5e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1f1 expref: 14 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143117.584089:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbe400, rc 0) 00000100:00100000:0.0:1746143117.584110:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30611:x1830962858379904:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 1730us (1788us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143117.584116:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8034 00000100:00100000:0.0:1746143117.587228:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.587540:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858380032 00000100:00100000:1.0:1746143117.587549:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858380032 00000100:00100000:1.0:1746143117.587608:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11707 00000100:00100000:1.0:1746143117.587617:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30602:x1830962858380032:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143117.587635:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143117.587654:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cade00/0x25aee876ca70ba6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1f8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.587681:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143117.587683:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143117.587688:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cade00/0x25aee876ca70ba6c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1f8 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.587706:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cade00/0x25aee876ca70ba6c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1f8 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.587718:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cade00, rc 0) 00000100:00100000:1.0:1746143117.587766:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30602:x1830962858380032:12345-192.168.201.28@tcp:101:cat.0 Request processed in 150us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.587779:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11707 00000100:00100000:0.0:1746143117.593533:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.600196:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.600713:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858380416 00000100:00100000:3.0:1746143117.600723:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858380416 00000100:00100000:3.0:1746143117.600777:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11708 00000100:00100000:3.0:1746143117.600785:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30610:x1830962858380416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.600803:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.600822:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec50400/0x25aee876ca70ba73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f1ff expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.600851:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.600857:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec50400/0x25aee876ca70ba73 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ff expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.600868:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec50400/0x25aee876ca70ba73 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ff expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.600878:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec50400, rc 0) 00000100:00100000:3.0:1746143117.600931:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30610:x1830962858380416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 147us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.600938:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11708 00000100:00100000:0.0:1746143117.603746:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.604536:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858380672 00000100:00100000:3.0:1746143117.604545:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858380672 00002000:00100000:3.0:1746143117.604585:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3661824->3665919) req@ffff8800a5e39c00 x1830962858380672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.604595:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39c00 with x1830962858380672 ext(3661824->3665919) 00010000:00010000:3.0:1746143117.604604:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 20 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.604618:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 20 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143117.604625:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5e39c00 00000100:00100000:3.0:1746143117.604653:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1877 00000100:00100000:3.0:1746143117.604662:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858380672:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143117.605240:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858380672:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 579us (1501us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143117.605247:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1877 00002000:00100000:3.0:1746143117.605254:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3661824->3665919) req@ffff8800a5e39c00 x1830962858380672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.605260:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39c00 with x1830962858380672 ext(3661824->3665919) 00010000:00010000:3.0:1746143117.605264:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 20 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.605279:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 20 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143117.605285:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5e39c00 00000100:00100000:0.0:1746143117.608578:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.609005:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.609148:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858380928 00000100:00100000:3.0:1746143117.609157:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858380928 00002000:00100000:3.0:1746143117.609196:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3665919) req@ffff8800a5e39180 x1830962858380928/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.609206:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39180 with x1830962858380928 ext(3145728->3665919) 00010000:00010000:3.0:1746143117.609214:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 20 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.609227:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 20 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143117.609233:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5e39180 00000100:00100000:3.0:1746143117.609613:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1878 00000100:00100000:3.0:1746143117.609622:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858380928:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:3.0:1746143117.620463:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858380928:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 10831us (11883us total) trans 17179872653 rc 0/0 00000100:00100000:3.0:1746143117.620476:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1878 00002000:00100000:3.0:1746143117.620498:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3665919) req@ffff8800a5e39180 x1830962858380928/t17179872653(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/448 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.620507:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39180 with x1830962858380928 ext(3145728->3665919) 00010000:00010000:3.0:1746143117.620519:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 22 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.620536:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fe2ac00/0x25aee876ca70ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1e3 expref: 22 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143117.620544:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5e39180 00000100:00100000:0.0:1746143117.624126:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.628402:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861143424:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143117.628409:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861143552:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143117.628413:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861143680:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143117.628428:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143117.628445:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858381312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4024us (4332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.628451:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6175 00000100:00100000:0.0:1746143117.629815:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.635049:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.642559:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.642591:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858382208 00000100:00100000:1.0:1746143117.642602:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858382208 00000100:00100000:1.0:1746143117.642661:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11709 00000100:00100000:1.0:1746143117.642670:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30607:x1830962858382208:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143117.642689:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143117.642707:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f206 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.642737:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 16 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.642746:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143117.642748:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143117.642751:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4194304->4251647] (req 4194304->4251647) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.642781:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 16 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.642798:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 16 pid: 22204 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143117.642809:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861143808:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143117.642883:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143117.654804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.654855:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.654859:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858382336 00000100:00100000:3.0:1746143117.654868:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858382336 00002000:00100000:3.0:1746143117.654904:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4001792->4194303) req@ffff88009c1e9880 x1830962858382336/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.654917:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9880 with x1830962858382336 ext(4001792->4194303) 00010000:00010000:3.0:1746143117.654927:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 17 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.654944:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 17 pid: 22204 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143117.654952:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1e9880 00000100:00100000:3.0:1746143117.654968:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1879 00000100:00100000:3.0:1746143117.654974:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858382336:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:3.0:1746143117.655207:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858382464 00000100:00100000:3.0:1746143117.655210:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858382464 00000100:00100000:3.0:1746143117.655231:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11710 00000100:00100000:3.0:1746143117.655235:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30610:x1830962858382464:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.655242:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.655255:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f20d expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.655274:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.655276:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.655279:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.655287:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.655295:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eaa000, rc 0) 00000100:00100000:3.0:1746143117.655310:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30610:x1830962858382464:12345-192.168.201.28@tcp:101:cat.0 Request processed in 74us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.655314:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11710 00000100:00100000:3.0:1746143117.665627:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858382336:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 10444us (10620us total) trans 21474839902 rc 0/0 00000100:00100000:3.0:1746143117.665642:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1879 00002000:00100000:3.0:1746143117.665656:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4001792->4194303) req@ffff88009c1e9880 x1830962858382336/t21474839902(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/448 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.665671:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9880 with x1830962858382336 ext(4001792->4194303) 00010000:00010000:3.0:1746143117.665682:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 19 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.665698:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 19 pid: 22204 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143117.665705:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1e9880 00000100:00100000:0.0:1746143117.665930:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.667063:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858382592 00000100:00100000:3.0:1746143117.667072:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858382592 00000100:00100000:3.0:1746143117.668276:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11711 00000100:00100000:3.0:1746143117.668288:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30602:x1830962858382592:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.668305:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.668324:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f214 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.668352:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.668359:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.668370:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.668380:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136768000, rc 0) 00000100:00100000:3.0:1746143117.669158:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30602:x1830962858382592:12345-192.168.201.28@tcp:101:cat.0 Request processed in 870us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.669168:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11711 00000100:00100000:3.0:1746143117.672019:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858382720 00000100:00100000:3.0:1746143117.672055:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858382720 00010000:00010000:3.0:1746143117.672091:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 20 pid: 22204 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.672125:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6176 00000100:00100000:3.0:1746143117.672132:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858382720:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.672145:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143117.672168:0:7112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143114 -> 1746143116 00002000:00010000:3.0:1746143117.672171:0:7112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143114 -> 1746143116 00010000:00010000:3.0:1746143117.672177:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 20 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.672190:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 20 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.672214:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec51200/0x25aee876ca70ba1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4001792->5206015] (req 4001792->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c0 expref: 20 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.672244:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.672246:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.672254:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.672261:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.672271:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.672272:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.672275:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 11 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.672283:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 11 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.672289:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.672291:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.672294:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.672300:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.672330:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.672342:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861143936:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143117.672429:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 11 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.672438:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861144064:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143117.672466:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.672478:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861144192:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143117.672511:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143117.681892:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861143936:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143117.681908:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861144064:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143117.682553:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.683276:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.683582:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858382976 00000100:00100000:1.0:1746143117.683588:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858382976 00002000:00100000:1.0:1746143117.683627:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2f800 x1830962858382976/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.683636:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2f800 with x1830962858382976 ext(3145728->4194303) 00002000:00010000:1.0:1746143117.683641:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2f800 00000100:00100000:1.0:1746143117.683655:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858383232 00000100:00100000:1.0:1746143117.683657:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858383232 00002000:00100000:1.0:1746143117.683668:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (4247552->4251647) req@ffff88009ae2d880 x1830962858383232/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.683674:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2d880 with x1830962858383232 ext(4247552->4251647) 00002000:00010000:1.0:1746143117.683677:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2d880 00000100:00100000:1.0:1746143117.683695:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5667 00000100:00100000:1.0:1746143117.683702:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858382976:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143117.685551:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5668 00000100:00100000:0.0:1746143117.685562:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858383232:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143117.685723:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858383232:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 163us (2447us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143117.685729:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5668 00002000:00100000:0.0:1746143117.685735:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4247552->4251647) req@ffff88009ae2d880 x1830962858383232/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.685749:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2d880 with x1830962858383232 ext(4247552->4251647) 00002000:00010000:0.0:1746143117.685753:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2d880 00000100:00100000:0.0:1746143117.685788:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.685801:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858383488 00000100:00100000:0.0:1746143117.685805:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858383488 00002000:00100000:0.0:1746143117.685820:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2c000 x1830962858383488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.685826:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c000 with x1830962858383488 ext(3145728->4194303) 00002000:00010000:0.0:1746143117.685829:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2c000 00000100:00100000:0.0:1746143117.685843:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5669 00000100:00100000:0.0:1746143117.685846:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858383488:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143117.686112:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.686972:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858383744 00000100:00100000:3.0:1746143117.686977:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858383744 00002000:00100000:3.0:1746143117.687006:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3387391) req@ffff88009ae2ea00 x1830962858383744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.687014:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2ea00 with x1830962858383744 ext(3145728->3387391) 00002000:00010000:3.0:1746143117.687018:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae2ea00 00000100:00100000:3.0:1746143117.687047:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5670 00000100:00100000:3.0:1746143117.687053:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858383744:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143117.694126:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.694889:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858384000 00000100:00100000:3.0:1746143117.694898:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858384000 00000100:00100000:3.0:1746143117.694950:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3372 00000100:00100000:3.0:1746143117.694972:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30607:x1830962858384000:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143117.695241:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30607:x1830962858384000:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 284us (1126us total) trans 8589942240 rc 0/0 00000100:00100000:3.0:1746143117.695247:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3372 00000100:00100000:1.0:1746143117.699429:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858382976:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 15715us (16866us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143117.699446:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5667 00002000:00100000:1.0:1746143117.699458:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2f800 x1830962858382976/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.699469:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2f800 with x1830962858382976 ext(3145728->4194303) 00002000:00010000:1.0:1746143117.699476:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2f800 00000100:00100000:1.0:1746143117.703221:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858383488:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 17361us (17420us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143117.703234:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5669 00002000:00100000:1.0:1746143117.703247:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2c000 x1830962858383488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.703256:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c000 with x1830962858383488 ext(3145728->4194303) 00002000:00010000:1.0:1746143117.703263:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2c000 00000100:00100000:0.0:1746143117.705622:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.714123:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.714227:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858384256 00000100:00100000:3.0:1746143117.714238:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858384256 00000100:00100000:3.0:1746143117.714365:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11713 00000100:00100000:3.0:1746143117.714375:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858384256:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143117.714379:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143117.714397:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.714416:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136769a00/0x25aee876ca70ba96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f222 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143117.714444:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858384384 00000100:00100000:0.0:1746143117.714448:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858384384 00010000:00010000:3.0:1746143117.714460:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136769a00/0x25aee876ca70ba96 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f222 expref: 13 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.714473:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136769a00/0x25aee876ca70ba96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f222 expref: 13 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143117.714474:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11714 00000100:00100000:0.0:1746143117.714479:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858384384:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143117.714497:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.714502:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136769a00, rc 0) 00010000:00010000:0.0:1746143117.714509:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70ba9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f229 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143117.714550:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861144448:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143117.714555:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858384256:12345-192.168.201.28@tcp:101:cat.0 Request processed in 181us (444us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143117.714562:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11713 00000100:00100000:0.0:1746143117.714612:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143117.719648:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.721720:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858384512 00000100:00100000:1.0:1746143117.721740:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858384512 00002000:00100000:1.0:1746143117.721999:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3387392->4194303) req@ffff88009ae2ed80 x1830962858384512/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.722009:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2ed80 with x1830962858384512 ext(3387392->4194303) 00010000:00010000:1.0:1746143117.722019:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec51000/0x25aee876ca70ba50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ea expref: 15 pid: 8448 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.722052:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec51000/0x25aee876ca70ba50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ea expref: 15 pid: 8448 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143117.722065:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ae2ed80 00000100:00100000:1.0:1746143117.722101:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1880 00000100:00100000:1.0:1746143117.722109:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858384512:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:3.0:1746143117.723373:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858384640 00000100:00100000:3.0:1746143117.723378:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858384640 00000100:00100000:3.0:1746143117.723408:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11715 00000100:00100000:3.0:1746143117.723415:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30610:x1830962858384640:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.723427:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.723683:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136768800/0x25aee876ca70baa4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f230 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.723713:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.723721:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.723722:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.723727:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136768800/0x25aee876ca70baa4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4251648->5210111] (req 4251648->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f230 expref: 13 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.723758:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.723768:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.723780:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861144576:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.723862:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143117.727058:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861144576:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.727087:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136768800/0x25aee876ca70baa4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4251648->5210111] (req 4251648->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f230 expref: 13 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.727101:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136768800, rc 0) 00000100:00100000:3.0:1746143117.727146:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30610:x1830962858384640:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3730us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.727155:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11715 00000100:00100000:0.0:1746143117.727518:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.728102:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858384768 00000100:00100000:3.0:1746143117.728108:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858384768 00002000:00100000:3.0:1746143117.728138:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4251647) req@ffff88008f576d80 x1830962858384768/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.728147:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576d80 with x1830962858384768 ext(4194304->4251647) 00010000:00010000:3.0:1746143117.728154:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.728168:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 13 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143117.728174:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f576d80 00000100:00100000:3.0:1746143117.728195:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1881 00000100:00100000:3.0:1746143117.728201:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858384768:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143117.744826:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858384768:12345-192.168.201.28@tcp:4:cat.0 Request processed in 16613us (17298us total) trans 21474839903 rc 0/0 00000100:00100000:3.0:1746143117.744839:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1881 00002000:00100000:3.0:1746143117.744852:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4251647) req@ffff88008f576d80 x1830962858384768/t21474839903(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/448 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.744862:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576d80 with x1830962858384768 ext(4194304->4251647) 00010000:00010000:3.0:1746143117.744873:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 15 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.744888:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5241200/0x25aee876ca70ba7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5201919] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f206 expref: 15 pid: 8450 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143117.744895:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f576d80 00000100:00100000:0.0:1746143117.750709:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.752309:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858384512:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 30196us (32663us total) trans 17179872654 rc 0/0 00000100:00100000:1.0:1746143117.752322:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1880 00002000:00100000:1.0:1746143117.752334:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3387392->4194303) req@ffff88009ae2ed80 x1830962858384512/t17179872654(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/448 e 0 to 0 dl 1746143128 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.752344:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2ed80 with x1830962858384512 ext(3387392->4194303) 00010000:00010000:1.0:1746143117.752354:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec51000/0x25aee876ca70ba50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ea expref: 17 pid: 8448 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.752368:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec51000/0x25aee876ca70ba50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ea expref: 17 pid: 8448 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143117.752375:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ae2ed80 00000100:00100000:0.0:1746143117.767156:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.767317:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.767439:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858385152 00000100:00100000:1.0:1746143117.767447:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858385152 00002000:00100000:1.0:1746143117.767516:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4251648->5206015) req@ffff88008f574380 x1830962858385152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.767526:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574380 with x1830962858385152 ext(4251648->5206015) 00002000:00010000:1.0:1746143117.767533:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f574380 00000100:00100000:3.0:1746143117.768511:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5671 00000100:00100000:3.0:1746143117.768520:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858385152:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143117.776961:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.779618:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858385536 00000100:00100000:1.0:1746143117.779631:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858385536 00002000:00100000:1.0:1746143117.779674:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008f576a00 x1830962858385536/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.779684:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576a00 with x1830962858385536 ext(3145728->4194303) 00002000:00010000:1.0:1746143117.779690:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f576a00 00000100:00100000:1.0:1746143117.779712:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5672 00000100:00100000:1.0:1746143117.779717:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858385536:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143117.783711:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858385152:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15179us (16548us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746143117.783727:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5671 00002000:00100000:3.0:1746143117.783739:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4251648->5206015) req@ffff88008f574380 x1830962858385152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.783749:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574380 with x1830962858385152 ext(4251648->5206015) 00002000:00010000:3.0:1746143117.783755:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f574380 00000100:00100000:0.0:1746143117.800298:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.803443:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858385536:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 23718us (26481us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143117.803455:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5672 00002000:00100000:1.0:1746143117.803469:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008f576a00 x1830962858385536/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.803478:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576a00 with x1830962858385536 ext(3145728->4194303) 00002000:00010000:1.0:1746143117.803491:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f576a00 00000100:00100000:3.0:1746143117.804283:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858385664 00000100:00100000:3.0:1746143117.804293:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858385664 00000100:00100000:3.0:1746143117.804344:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11716 00000100:00100000:3.0:1746143117.804351:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858385664:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143117.804369:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.804390:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ffac00/0x25aee876ca70baab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f237 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.804414:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.804416:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.804424:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ffac00/0x25aee876ca70baab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f237 expref: 17 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.804440:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ffac00/0x25aee876ca70baab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f237 expref: 17 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143117.804452:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ffac00, rc 0) 00000100:00100000:3.0:1746143117.804475:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858385664:12345-192.168.201.28@tcp:101:cat.0 Request processed in 126us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.804481:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11716 00000100:00100000:0.0:1746143117.811843:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.826345:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.826503:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858386048 00000100:00100000:1.0:1746143117.826513:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858386048 00002000:00100000:1.0:1746143117.826559:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008f574000 x1830962858386048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.826570:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574000 with x1830962858386048 ext(4194304->5210111) 00002000:00010000:1.0:1746143117.826576:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f574000 00000100:00100000:1.0:1746143117.826610:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5673 00000100:00100000:1.0:1746143117.826618:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858386048:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143117.859809:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858386048:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33176us (33461us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143117.859830:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5673 00002000:00100000:1.0:1746143117.859845:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008f574000 x1830962858386048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/440 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143117.859856:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574000 with x1830962858386048 ext(4194304->5210111) 00002000:00010000:1.0:1746143117.859863:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f574000 00000100:00100000:0.0:1746143117.861045:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.902473:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.909617:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.909650:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.909671:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858386560 00000100:00100000:3.0:1746143117.909679:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858386560 00010000:00010000:3.0:1746143117.909713:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec50400/0x25aee876ca70ba73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ff expref: 17 pid: 22204 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.909745:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858386688 00000100:00100000:3.0:1746143117.909747:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858386688 00000100:00100000:1.0:1746143117.909750:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6179 00010000:00010000:3.0:1746143117.909758:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cade00/0x25aee876ca70ba6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1f8 expref: 24 pid: 8450 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143117.909760:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858386560:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143117.909773:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6180 00010000:00010000:1.0:1746143117.909773:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143117.909777:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858386688:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.909784:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143117.909795:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cade00/0x25aee876ca70ba6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1f8 expref: 24 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.909795:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec50400/0x25aee876ca70ba73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ff expref: 17 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.909805:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cade00/0x25aee876ca70ba6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1f8 expref: 24 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.909850:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec50400/0x25aee876ca70ba73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ff expref: 17 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.909872:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cade00/0x25aee876ca70ba6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1f8 expref: 24 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.909882:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec50400/0x25aee876ca70ba73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ff expref: 17 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143117.909898:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143117.909900:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143117.909932:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858386688:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 154us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.909938:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6180 00000100:00100000:1.0:1746143117.909975:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858386560:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 217us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.909981:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6179 00000100:00100000:0.0:1746143117.911897:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.913191:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858386816 00000100:00100000:1.0:1746143117.913200:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858386816 00010000:00010000:1.0:1746143117.913234:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ffac00/0x25aee876ca70baab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f237 expref: 16 pid: 754 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143117.913279:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6181 00000100:00100000:1.0:1746143117.913287:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858386816:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143117.913301:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143117.913323:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ffac00/0x25aee876ca70baab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f237 expref: 16 pid: 754 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143117.913334:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ffac00/0x25aee876ca70baab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f237 expref: 16 pid: 754 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143117.913356:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ffac00/0x25aee876ca70baab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f237 expref: 16 pid: 754 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143117.913370:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143117.913652:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858386816:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 365us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.913659:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6181 00000100:00100000:0.0:1746143117.924834:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.925006:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858386944 00000100:00100000:1.0:1746143117.925016:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858386944 00010000:00010000:1.0:1746143117.925085:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012caa5c00/0x25aee876ca70ba8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f21b expref: 22 pid: 22204 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143117.925127:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6182 00000100:00100000:1.0:1746143117.925136:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858386944:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143117.925151:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143117.925175:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012caa5c00/0x25aee876ca70ba8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f21b expref: 22 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.925188:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012caa5c00/0x25aee876ca70ba8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f21b expref: 22 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.925212:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012caa5c00/0x25aee876ca70ba8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f21b expref: 22 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.925230:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143117.925232:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143117.925239:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.925247:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143117.925282:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143117.925294:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861145472:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143117.925465:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143117.932890:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.932952:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858387456 00000100:00100000:3.0:1746143117.932961:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858387456 00000100:00100000:0.0:1746143117.933005:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.933013:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8036 00000100:00100000:3.0:1746143117.933021:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30620:x1830962858387456:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143117.933070:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143117.933078:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858387200 00000100:00100000:0.0:1746143117.933081:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858387200 00010000:00010000:3.0:1746143117.933089:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffb200/0x25aee876ca70bad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f253 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746143117.933109:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3096576->3100671) req@ffff88008f577b80 x1830962858387200/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143117.933118:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577b80 with x1830962858387200 ext(3096576->3100671) 00002000:00010000:0.0:1746143117.933123:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f577b80 00000100:00100000:0.0:1746143117.933135:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5674 00000100:00100000:0.0:1746143117.933140:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858387200:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:3.0:1746143117.933187:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.933201:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143117.933211:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:3.0:1746143117.933222:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:0.0:1746143117.933307:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858387200:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 165us (302us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143117.933313:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5674 00002000:00100000:0.0:1746143117.933319:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3096576->3100671) req@ffff88008f577b80 x1830962858387200/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143117.933320:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffb200/0x25aee876ca70bad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 19 pid: 14795 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746143117.933326:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577b80 with x1830962858387200 ext(3096576->3100671) 00002000:00010000:0.0:1746143117.933329:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f577b80 00010000:00010000:3.0:1746143117.933336:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 18 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.933345:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143117.933348:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143117.933351:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ffa600, rc 0) 00000100:00100000:3.0:1746143117.933369:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30620:x1830962858387456:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 349us (492us total) trans 8589942242 rc 0/0 00000100:00100000:3.0:1746143117.933374:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8036 00000100:00100000:1.0:1746143117.933554:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861145472:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143117.933572:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143117.933595:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858386944:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8461us (8772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.933602:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6182 00000100:00100000:0.0:1746143117.939136:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.951497:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.951531:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143117.951555:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143117.951558:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858387840 00000100:00100000:1.0:1746143117.951568:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858387840 00000100:00100000:0.0:1746143117.951596:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143117.951606:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 14 pid: 8448 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143117.951613:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858387712 00000100:00100000:0.0:1746143117.951616:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858387712 00010000:00010000:0.0:1746143117.951633:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 22 pid: 8450 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143117.951639:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858387968 00000100:00100000:1.0:1746143117.951641:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858387968 00000100:00100000:0.0:1746143117.951649:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858388096 00010000:00010000:1.0:1746143117.951651:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcee00/0x25aee876ca70bab2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f23e expref: 23 pid: 22204 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746143117.951651:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858388096 00010000:00010000:0.0:1746143117.951660:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136768800/0x25aee876ca70baa4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4251648->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f230 expref: 15 pid: 754 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143117.951665:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6183 00000100:00100000:1.0:1746143117.951672:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858387840:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143117.951673:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6184 00000100:00100000:0.0:1746143117.951678:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858387712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143117.951686:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143117.951686:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143117.951708:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 12 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 15 pid: 8448 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143117.951708:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 12 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 23 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143117.951719:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 23 pid: 8450 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.951768:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6185 00000100:00100000:3.0:1746143117.951776:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858387968:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143117.951786:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143117.951814:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 12 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 15 pid: 8448 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.951839:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094eaa000/0x25aee876ca70ba81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 12 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f20d expref: 15 pid: 8448 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.951858:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143117.951901:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858387840:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 229us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.951908:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6183 00000100:00100000:1.0:1746143117.951923:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6186 00000100:00100000:1.0:1746143117.951929:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858388096:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143117.951937:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143117.951944:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136768800/0x25aee876ca70baa4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 4251648->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f230 expref: 13 pid: 754 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.951952:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136768800/0x25aee876ca70baa4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 4251648->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f230 expref: 13 pid: 754 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143117.951962:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143117.951976:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858388096:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143117.951981:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6186 00010000:00010000:0.0:1746143117.952182:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136768000/0x25aee876ca70ba88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f214 expref: 23 pid: 8450 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143117.952197:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143117.952217:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858387712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 538us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143117.952223:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6184 00010000:00010000:3.0:1746143117.952304:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094bcee00/0x25aee876ca70bab2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f23e expref: 21 pid: 22204 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143117.952314:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094bcee00/0x25aee876ca70bab2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f23e expref: 21 pid: 22204 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143117.952324:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.952326:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143117.952333:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.952341:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.952373:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143117.952384:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861146112:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143117.952645:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d43c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143117.953203:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bcee00/0x25aee876ca70bab2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f23e expref: 21 pid: 22204 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143117.953218:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091980000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861145856:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.953228:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136768800/0x25aee876ca70baa4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4251648->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f230 expref: 12 pid: 754 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.953241:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091982a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861145984:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.953288:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.953296:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8200, rc 0) 00000100:00100000:3.0:1746143117.953982:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30617:x1830962858387584:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14690us (14855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.953990:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11719 00000100:00100000:3.0:1746143117.954896:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861146112:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143117.954907:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143117.956239:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858387968:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4459us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.956251:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6185 00000100:00100000:0.0:1746143117.957365:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.957662:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858388352 00000100:00100000:3.0:1746143117.957670:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858388352 00002000:00100000:3.0:1746143117.957714:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3436544->3440639) req@ffff88008f575880 x1830962858388352/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/0 e 0 to 0 dl 1746143128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.957725:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575880 with x1830962858388352 ext(3436544->3440639) 00002000:00010000:3.0:1746143117.957731:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f575880 00000100:00100000:3.0:1746143117.957749:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5675 00000100:00100000:3.0:1746143117.957755:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858388352:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143117.958683:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858388352:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 926us (1320us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143117.958695:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5675 00002000:00100000:3.0:1746143117.958701:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3436544->3440639) req@ffff88008f575880 x1830962858388352/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:268/0 lens 488/4536 e 0 to 0 dl 1746143128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143117.958710:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575880 with x1830962858388352 ext(3436544->3440639) 00002000:00010000:3.0:1746143117.958713:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f575880 00000100:00100000:0.0:1746143117.992210:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143117.992398:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858388480 00000100:00100000:3.0:1746143117.992409:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858388480 00000100:00100000:3.0:1746143117.992455:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11720 00000100:00100000:3.0:1746143117.992463:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30620:x1830962858388480:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143117.992510:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143117.992529:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f261 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.992561:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.992569:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.992571:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143117.993061:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2801664->3145727] (req 2801664->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 16 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.993094:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.993107:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 20 pid: 22204 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143117.993130:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861146240:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143117.995374:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143117.999117:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861146240:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143117.999148:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2801664->3145727] (req 2801664->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 16 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143117.999166:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ffb200, rc 0) 00000100:00100000:3.0:1746143117.999205:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30620:x1830962858388480:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6742us (7004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143117.999214:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11720 00000100:00100000:0.0:1746143118.003930:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.004134:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858388608 00000100:00100000:3.0:1746143118.004144:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858388608 00002000:00100000:3.0:1746143118.004209:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3096576->3145727) req@ffff880094e97b80 x1830962858388608/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.004220:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97b80 with x1830962858388608 ext(3096576->3145727) 00010000:00010000:3.0:1746143118.004230:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 21 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.004243:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 21 pid: 22204 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143118.004250:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094e97b80 00000100:00100000:3.0:1746143118.004272:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1882 00000100:00100000:3.0:1746143118.004279:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858388608:12345-192.168.201.28@tcp:4:multiop.0 00000100:00080000:1.0:1746143118.004311:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143118.008393:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858388608:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 4104us (4464us total) trans 17179872655 rc 0/0 00000100:00100000:3.0:1746143118.008406:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1882 00002000:00100000:3.0:1746143118.008416:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3096576->3145727) req@ffff880094e97b80 x1830962858388608/t17179872655(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/448 e 0 to 0 dl 1746143129 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.008426:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97b80 with x1830962858388608 ext(3096576->3145727) 00010000:00010000:3.0:1746143118.008437:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 23 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.008451:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 23 pid: 22204 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143118.008459:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094e97b80 00000100:00100000:0.0:1746143118.010129:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.010399:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858388736 00000100:00100000:3.0:1746143118.010408:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858388736 00010000:00010000:3.0:1746143118.010443:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 23 pid: 22204 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143118.011285:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6187 00000100:00100000:3.0:1746143118.011294:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858388736:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143118.011307:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143118.011328:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 23 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.011339:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 23 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.011363:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bcea00/0x25aee876ca70bace lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f24c expref: 23 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.011393:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.011395:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.011402:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.011412:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.011444:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.011456:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861146368:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143118.012896:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.016894:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861146368:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143118.016916:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143118.016959:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858388736:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5666us (6836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.016971:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6187 00000100:00100000:0.0:1746143118.017702:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.018052:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858388992 00000100:00100000:3.0:1746143118.018058:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858388992 00002000:00100000:3.0:1746143118.018097:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2801664->2805759) req@ffff880094e94000 x1830962858388992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.018114:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e94000 with x1830962858388992 ext(2801664->2805759) 00002000:00010000:3.0:1746143118.018119:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e94000 00000100:00100000:3.0:1746143118.018148:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5676 00000100:00100000:3.0:1746143118.018155:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858388992:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143118.018335:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858388992:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 180us (634us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143118.018342:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5676 00002000:00100000:3.0:1746143118.018347:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2801664->2805759) req@ffff880094e94000 x1830962858388992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/4536 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.018354:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e94000 with x1830962858388992 ext(2801664->2805759) 00002000:00010000:3.0:1746143118.018357:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e94000 00000100:00100000:0.0:1746143118.042745:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.042873:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858389120 00000100:00100000:3.0:1746143118.042883:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858389120 00000100:00100000:3.0:1746143118.042931:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11721 00000100:00100000:3.0:1746143118.042939:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858389120:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.042967:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.042987:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70baf8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f268 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.043131:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70baf8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f268 expref: 13 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.043143:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70baf8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f268 expref: 13 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.043176:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e13600, rc 0) 00000100:00100000:3.0:1746143118.043222:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858389120:12345-192.168.201.28@tcp:101:cat.0 Request processed in 284us (491us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.043229:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11721 00000100:00100000:0.0:1746143118.045963:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.051742:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea803c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.055894:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.055961:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858389376 00000100:00100000:1.0:1746143118.055969:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858389376 00002000:00100000:1.0:1746143118.056058:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3440639) req@ffff880094e95c00 x1830962858389376/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.056069:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95c00 with x1830962858389376 ext(3145728->3440639) 00010000:00010000:1.0:1746143118.056078:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 19 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143118.056094:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 19 pid: 22204 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143118.056102:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e95c00 00000100:00100000:1.0:1746143118.056123:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1883 00000100:00100000:1.0:1746143118.056131:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858389376:12345-192.168.201.28@tcp:4:multiop.0 00000100:00080000:0.0:1746143118.056626:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143118.056705:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.056766:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858389632 00000100:00100000:1.0:1746143118.056769:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858389632 00002000:00100000:1.0:1746143118.056786:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2801663) req@ffff880094e95f80 x1830962858389632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.056794:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95f80 with x1830962858389632 ext(2097152->2801663) 00002000:00010000:1.0:1746143118.056797:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e95f80 00000100:00100000:3.0:1746143118.056847:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091983100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861146496:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.056892:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->3219455] (req 3145728->3219455) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 13 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.056907:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d9600, rc 0) 00000100:00100000:3.0:1746143118.056949:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30620:x1830962858389248:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9696us (10995us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.056957:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11722 00000100:00100000:3.0:1746143118.063271:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858389376:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 7130us (7378us total) trans 21474839904 rc 0/0 00000100:00100000:3.0:1746143118.063284:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1883 00002000:00100000:3.0:1746143118.063306:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3440639) req@ffff880094e95c00 x1830962858389376/t21474839904(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/448 e 0 to 0 dl 1746143129 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.063316:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95c00 with x1830962858389376 ext(3145728->3440639) 00010000:00010000:3.0:1746143118.063326:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.063341:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143118.063348:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e95c00 00000100:00100000:0.0:1746143118.068089:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.068331:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858389760 00000100:00100000:3.0:1746143118.068342:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858389760 00010000:00010000:3.0:1746143118.068607:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143118.068636:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6188 00000100:00100000:3.0:1746143118.068645:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858389760:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143118.068659:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143118.068682:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.068694:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.068720:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8200/0x25aee876ca70baea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5177343] (req 3145728->3440639) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f25a expref: 21 pid: 22204 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143118.068763:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.068765:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.068774:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.068784:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.068829:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 12 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.068844:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861146624:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143118.068926:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.072693:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861146624:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143118.072719:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143118.072759:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858389760:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4114us (4677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.072771:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6188 00000100:00100000:0.0:1746143118.073220:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.095171:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.095227:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.096261:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5680 00000100:00100000:1.0:1746143118.096270:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858390528:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143118.128667:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.129172:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858390528:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32900us (33941us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143118.129184:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5680 00002000:00100000:1.0:1746143118.129198:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094e97100 x1830962858390528/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/440 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.129208:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97100 with x1830962858390528 ext(3145728->4194303) 00002000:00010000:1.0:1746143118.129215:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e97100 00000100:00100000:3.0:1746143118.129255:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858390656 00000100:00100000:3.0:1746143118.129264:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858390656 00000100:00100000:3.0:1746143118.129319:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11723 00000100:00100000:3.0:1746143118.129326:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858390656:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.129342:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.129360:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5496600/0x25aee876ca70bb06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f276 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.129393:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5496600/0x25aee876ca70bb06 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f276 expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.129404:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5496600/0x25aee876ca70bb06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f276 expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.129429:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5496600, rc 0) 00000100:00100000:3.0:1746143118.129451:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858390656:12345-192.168.201.28@tcp:101:cat.0 Request processed in 126us (798us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.129457:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11723 00000100:00100000:3.0:1746143118.132206:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858390784 00000100:00100000:3.0:1746143118.132211:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858390784 00000100:00100000:3.0:1746143118.132239:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11724 00000100:00100000:3.0:1746143118.132246:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858390784:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.132259:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.132274:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5496400/0x25aee876ca70bb0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f27d expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.132320:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861146752:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143118.132614:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.145243:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:3.0:1746143118.149559:0:754:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143116 -> 1746143117 00000100:00100000:3.0:1746143118.149590:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861146752:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143118.149625:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5496400/0x25aee876ca70bb0d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f27d expref: 23 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.149639:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5496400/0x25aee876ca70bb0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f27d expref: 23 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.149655:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5496400, rc 0) 00000100:00100000:3.0:1746143118.149697:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858390784:12345-192.168.201.28@tcp:101:cat.0 Request processed in 17451us (18608us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.149706:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11724 00000100:00100000:3.0:1746143118.154758:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858391168 00000100:00100000:3.0:1746143118.154768:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858391168 00000100:00100000:3.0:1746143118.154820:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11725 00000100:00100000:3.0:1746143118.154828:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858391168:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.154848:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.154867:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5497000/0x25aee876ca70bb14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f284 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.154904:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5497000/0x25aee876ca70bb14 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f284 expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.154916:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497000/0x25aee876ca70bb14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f284 expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.154944:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497000, rc 0) 00000100:00100000:3.0:1746143118.154993:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858391168:12345-192.168.201.28@tcp:101:cat.0 Request processed in 165us (920us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.154999:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11725 00000100:00100000:3.0:1746143118.175582:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858391296 00000100:00100000:3.0:1746143118.175591:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858391296 00000100:00100000:3.0:1746143118.175643:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11726 00000100:00100000:3.0:1746143118.175652:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30624:x1830962858391296:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.175671:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.175690:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f28b expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.175721:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 14 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.175732:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.175734:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.175738:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4206592->5210111] (req 4206592->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f28b expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.175967:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 14 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.175979:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 14 pid: 754 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.175991:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861146880:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.179783:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.179824:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861146880:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143118.179841:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143118.179856:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4206592->5210111] (req 4206592->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f28b expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.179882:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497a00, rc 0) 00000100:00100000:3.0:1746143118.179938:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30624:x1830962858391296:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4286us (4723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.179948:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11726 00000100:00100000:0.0:1746143118.188200:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.188242:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.188267:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858391552 00000100:00100000:0.0:1746143118.188275:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858391552 00000100:00100000:0.0:1746143118.188321:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858391680 00000100:00100000:0.0:1746143118.188324:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858391680 00000100:00100000:0.0:1746143118.188348:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11728 00000100:00100000:0.0:1746143118.188355:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858391680:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143118.188365:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143118.188379:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094445e00/0x25aee876ca70bb29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f299 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143118.188431:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130766a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861147008:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143118.188496:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.201681:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.201989:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.202638:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858391936 00000100:00100000:3.0:1746143118.202647:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858391936 00010000:00010000:3.0:1746143118.202681:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 16 pid: 754 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.202732:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6189 00000100:00100000:3.0:1746143118.202755:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858391936:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143118.202766:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143118.202786:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 16 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.202998:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 16 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.203022:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70baff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5201919] (req 3145728->3219455) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f26f expref: 16 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.203047:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.203049:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.203055:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4206592->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f28b expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.203064:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4206592->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f28b expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.203094:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4206592->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f28b expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.203106:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861147264:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143118.203180:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.208193:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.208224:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.208976:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861147264:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143118.208999:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143118.209059:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858391936:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6319us (7068us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.209068:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6189 00000100:00100000:0.0:1746143118.224187:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.225079:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858392448 00000100:00100000:3.0:1746143118.225089:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858392448 00000100:00100000:3.0:1746143118.225136:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11730 00000100:00100000:3.0:1746143118.225144:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30630:x1830962858392448:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143118.225160:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.225174:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f2a7 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.225198:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.225201:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.225205:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->4194303] (req 3940352->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.225216:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->4194303] (req 3940352->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.225225:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d70800, rc 0) 00000100:00100000:3.0:1746143118.225276:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30630:x1830962858392448:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 132us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.225282:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11730 00000100:00100000:0.0:1746143118.251890:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.251954:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858392576 00000100:00100000:3.0:1746143118.251971:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858392576 00010000:00010000:3.0:1746143118.252005:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 18 pid: 22204 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.252051:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6190 00000100:00100000:3.0:1746143118.252058:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858392576:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143118.252074:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143118.252095:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 18 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.252108:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 18 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.252135:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70baf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f261 expref: 18 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.252153:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.252155:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.252162:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.252170:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.252178:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.252179:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.252183:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.252188:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.252220:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 23 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.252232:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861147392:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143118.252307:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 23 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.252314:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861147520:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143118.252332:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.257183:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.258441:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861147520:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143118.262208:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.262259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.262596:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5684 00000100:00100000:3.0:1746143118.262603:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858393216:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143118.262707:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858393216:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 105us (447us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143118.262714:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5684 00002000:00100000:3.0:1746143118.262720:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3940352->3944447) req@ffff880130767b80 x1830962858393216/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/4536 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.262726:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767b80 with x1830962858393216 ext(3940352->3944447) 00002000:00010000:3.0:1746143118.262729:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130767b80 00000100:00100000:3.0:1746143118.262764:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861147392:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143118.262785:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143118.262805:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858392576:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10748us (10921us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.262813:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6190 00002000:00010000:3.0:1746143118.263548:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143116 -> 1746143117 00002000:00010000:3.0:1746143118.263552:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143116 -> 1746143117 00000100:00100000:3.0:1746143118.263560:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091983100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861147648:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143118.263583:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5376a00/0x25aee876ca70bb3e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2ae expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.263593:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5376a00/0x25aee876ca70bb3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2ae expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.263603:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5376a00, rc 0) 00000100:00100000:3.0:1746143118.263622:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858392704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5483us (6446us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.263628:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11731 00000100:00100000:0.0:1746143118.266178:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.266253:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858393344 00000100:00100000:3.0:1746143118.266259:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858393344 00000100:00100000:3.0:1746143118.266291:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11732 00000100:00100000:3.0:1746143118.266298:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30630:x1830962858393344:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143118.266311:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.266325:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f2b5 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.266347:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4206592->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f28b expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.266359:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.266360:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.266364:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4194304->4308991] (req 4194304->4308991) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.266390:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4206592->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f28b expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.266402:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bb1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4206592->5210111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f28b expref: 14 pid: 22204 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.266413:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861147776:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.266466:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.270979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.280026:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861147776:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.280068:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [4194304->4308991] (req 4194304->4308991) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.280084:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d71000, rc 0) 00000100:00100000:3.0:1746143118.280123:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30630:x1830962858393344:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 13824us (13949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.280131:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11732 00000100:00100000:3.0:1746143118.312748:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858393600 00000100:00100000:3.0:1746143118.312758:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858393600 00000100:00100000:3.0:1746143118.312805:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11734 00000100:00100000:3.0:1746143118.312812:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30628:x1830962858393600:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.312826:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.312840:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f2c3 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.312862:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.312864:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.312871:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.312884:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.312894:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d70a00, rc 0) 00000100:00100000:3.0:1746143118.312950:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30628:x1830962858393600:12345-192.168.201.28@tcp:101:cat.0 Request processed in 138us (20563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.312956:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11734 00000100:00100000:3.0:1746143118.344292:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.345389:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858393984:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 14172us (14297us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143118.345399:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5685 00002000:00100000:0.0:1746143118.345404:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880091980700 x1830962858393984/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/440 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143118.345411:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980700 with x1830962858393984 ext(3145728->4194303) 00002000:00010000:0.0:1746143118.345414:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091980700 00000100:00100000:0.0:1746143118.354189:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.358671:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858394496 00000100:00100000:1.0:1746143118.358680:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858394496 00000100:00100000:0.0:1746143118.358711:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091981880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861148160:192.168.201.28@tcp:104: 00002000:00100000:1.0:1746143118.358718:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3940352->4194303) req@ffff880091983b80 x1830962858394496/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.358725:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091983b80 with x1830962858394496 ext(3940352->4194303) 00010000:00010000:1.0:1746143118.358732:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 26 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.358733:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4fb400/0x25aee876ca70bb5a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2ca expref: 26 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143118.358743:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 26 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.358746:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4fb400, rc 0) 00002000:00010000:1.0:1746143118.358750:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091983b80 00000100:00100000:1.0:1746143118.358767:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1886 00000100:00100000:1.0:1746143118.358774:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858394496:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143118.358778:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30628:x1830962858394368:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4461us (4597us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143118.358784:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11735 00000100:00100000:1.0:1746143118.368853:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858394496:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 10070us (10445us total) trans 17179872657 rc 0/0 00000100:00100000:1.0:1746143118.368865:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1886 00002000:00100000:1.0:1746143118.368875:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3940352->4194303) req@ffff880091983b80 x1830962858394496/t17179872657(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/448 e 0 to 0 dl 1746143129 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.368884:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091983b80 with x1830962858394496 ext(3940352->4194303) 00010000:00010000:1.0:1746143118.368893:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 27 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143118.368907:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d70800/0x25aee876ca70bb37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3940352->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a7 expref: 27 pid: 754 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746143118.368913:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091983b80 00000100:00100000:0.0:1746143118.371971:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.379252:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.379320:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858394880 00000100:00100000:1.0:1746143118.379327:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858394880 00002000:00100000:1.0:1746143118.379361:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094424380 x1830962858394880/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.379557:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094424380 with x1830962858394880 ext(3145728->4194303) 00002000:00010000:1.0:1746143118.379561:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094424380 00000100:00100000:1.0:1746143118.380162:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5687 00000100:00100000:1.0:1746143118.380171:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858394880:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143118.397894:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.402588:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.402877:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.402941:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858395264 00000100:00100000:3.0:1746143118.402944:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858395264 00000100:00100000:3.0:1746143118.402982:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11737 00000100:00100000:3.0:1746143118.402989:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858395264:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.402999:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.403013:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d71800/0x25aee876ca70bb68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f2d8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.403061:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d71800/0x25aee876ca70bb68 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d8 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.403077:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d71800/0x25aee876ca70bb68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d8 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.403094:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d71800, rc 0) 00000100:00100000:3.0:1746143118.404738:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858395264:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1745us (2152us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.404744:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11737 00000100:00100000:0.0:1746143118.409753:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091981880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861148416:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143118.409764:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091983100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861148544:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143118.409771:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861148672:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143118.409803:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4fa400/0x25aee876ca70bb61 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d1 expref: 18 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.410014:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4fa400, rc 0) 00000100:00100000:1.0:1746143118.416528:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.417793:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.417824:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.417946:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858395648 00000100:00100000:0.0:1746143118.417956:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858395648 00010000:00010000:0.0:1746143118.417999:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec50200/0x25aee876ca70ba2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c7 expref: 7 pid: 22204 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143118.418020:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858395520 00000100:00100000:0.0:1746143118.418022:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858395520 00010000:00010000:0.0:1746143118.418046:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b430ee00/0x25aee876ca70b9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f196 expref: 18 pid: 754 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143118.418060:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858395776 00000100:00100000:0.0:1746143118.418062:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858395776 00010000:00010000:0.0:1746143118.418071:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 26 pid: 8448 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143118.418085:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6193 00000100:00100000:0.0:1746143118.418091:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858395648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143118.418102:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143118.418120:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec50200/0x25aee876ca70ba2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c7 expref: 7 pid: 22204 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.418130:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec50200/0x25aee876ca70ba2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c7 expref: 7 pid: 22204 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.418149:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec50200/0x25aee876ca70ba2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1c7 expref: 7 pid: 22204 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.418167:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143118.418202:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858395648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 111us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143118.418208:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6193 00000100:00100000:0.0:1746143118.418222:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6194 00000100:00100000:0.0:1746143118.418226:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858395520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143118.418233:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143118.418241:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b430ee00/0x25aee876ca70b9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f196 expref: 18 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.418249:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b430ee00/0x25aee876ca70b9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f196 expref: 18 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.418259:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b430ee00/0x25aee876ca70b9e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f196 expref: 18 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.418268:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143118.418281:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858395520:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 55us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143118.418286:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6194 00000100:00100000:0.0:1746143118.418294:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6195 00000100:00100000:0.0:1746143118.418299:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858395776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143118.418304:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143118.418312:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 26 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.418320:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 26 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.418331:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a28a800/0x25aee876ca70b9a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f17a expref: 26 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.418338:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.418340:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.418345:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fa400/0x25aee876ca70bb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d1 expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.418353:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4fa400/0x25aee876ca70bb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d1 expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.418380:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4fa400/0x25aee876ca70bb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d1 expref: 16 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143118.418391:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861148800:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143118.418652:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801369099c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746143118.419682:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143118.430465:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.430531:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.430594:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858396160 00000100:00100000:3.0:1746143118.430603:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858396160 00000100:00100000:3.0:1746143118.430639:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11738 00000100:00100000:3.0:1746143118.430646:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30628:x1830962858396160:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.430658:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.430673:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f2df expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.430691:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.430693:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.430699:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.430711:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.430720:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d70600, rc 0) 00000100:00100000:3.0:1746143118.430962:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30628:x1830962858396160:12345-192.168.201.28@tcp:101:cat.0 Request processed in 315us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.430969:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11738 00000100:00100000:0.0:1746143118.436158:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.444806:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.446417:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.446584:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858396800 00000100:00100000:3.0:1746143118.446588:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858396800 00000100:00100000:0.0:1746143118.447199:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.447212:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858396544 00000100:00100000:0.0:1746143118.447215:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858396544 00000100:00100000:0.0:1746143118.447241:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11741 00000100:00100000:0.0:1746143118.447246:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30632:x1830962858396544:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143118.447254:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143118.447261:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f2e6 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.447279:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.447286:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b200/0x25aee876ca70ba26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ce expref: 5 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.447293:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b430fe00/0x25aee876ca70b9e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f19d expref: 20 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.447298:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.447300:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.447303:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->1622015] (req 1048576->1622015) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.447332:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b430fe00/0x25aee876ca70b9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f19d expref: 20 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.447343:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b430fe00/0x25aee876ca70b9e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f19d expref: 20 pid: 754 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143118.447554:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861148928:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143118.447935:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.448001:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143118.450323:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b200/0x25aee876ca70ba26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ce expref: 5 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.450335:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b200/0x25aee876ca70ba26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ce expref: 5 pid: 8450 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143118.450348:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094427800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861149184:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143118.450395:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 26 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.450403:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 26 pid: 754 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143118.450411:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861149312:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143118.450427:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00002000:00010000:3.0:1746143118.450625:0:8448:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143116 -> 1746143117 00002000:00010000:3.0:1746143118.450629:0:8448:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143116 -> 1746143117 00002000:00010000:3.0:1746143118.450631:0:8448:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143116 -> 1746143117 00000100:00100000:3.0:1746143118.450654:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861149056:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143118.450679:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4fba00/0x25aee876ca70bb8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2fb expref: 26 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.450688:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fba00/0x25aee876ca70bb8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2fb expref: 26 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.450701:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4fba00, rc 0) 00000100:00100000:3.0:1746143118.450724:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858396928:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2635us (2789us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.450731:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11742 00000100:00100000:0.0:1746143118.464797:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.464839:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.464862:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.464949:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858397312 00000100:00100000:1.0:1746143118.464959:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858397312 00010000:00010000:1.0:1746143118.464993:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b430fe00/0x25aee876ca70b9e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f19d expref: 19 pid: 754 timeout: 1000 lvb_type: 1 00000100:00100000:1.0:1746143118.465018:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858397184 00000100:00100000:1.0:1746143118.465020:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858397184 00010000:00010000:1.0:1746143118.465047:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b200/0x25aee876ca70ba26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ce expref: 6 pid: 8450 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143118.465104:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.465699:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6196 00000100:00100000:1.0:1746143118.465708:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858397312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143118.465719:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143118.465739:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b430fe00/0x25aee876ca70b9e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f19d expref: 19 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.465750:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b430fe00/0x25aee876ca70b9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f19d expref: 19 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.465775:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b430fe00/0x25aee876ca70b9e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f19d expref: 19 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.465794:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143118.465840:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858397312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 133us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143118.465846:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6196 00000100:00100000:1.0:1746143118.465861:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6197 00000100:00100000:1.0:1746143118.465866:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858397184:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143118.465872:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143118.465881:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b200/0x25aee876ca70ba26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ce expref: 6 pid: 8450 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.465888:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b200/0x25aee876ca70ba26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ce expref: 6 pid: 8450 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.465900:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b200/0x25aee876ca70ba26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ce expref: 6 pid: 8450 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.465907:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143118.465923:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858397184:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 57us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143118.465928:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6197 00000100:00100000:0.0:1746143118.466512:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.466681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.467236:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858397824 00000100:00100000:0.0:1746143118.467241:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858397824 00010000:00010000:0.0:1746143118.467257:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 25 pid: 754 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143118.467275:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6198 00000100:00100000:0.0:1746143118.467281:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858397824:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143118.467287:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143118.467297:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 25 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.467306:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 25 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.467318:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f07c00/0x25aee876ca70b9bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f188 expref: 25 pid: 754 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.467331:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.467333:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.467339:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 17 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.467346:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 17 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.467374:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 17 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143118.467386:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861149440:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143118.467434:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.468115:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858397440 00000100:00100000:3.0:1746143118.468120:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858397440 00000100:00100000:3.0:1746143118.468144:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858397568 00000100:00100000:3.0:1746143118.468146:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858397568 00000100:00100000:3.0:1746143118.468157:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858397696 00000100:00100000:3.0:1746143118.468159:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858397696 00000100:00100000:3.0:1746143118.468179:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11744 00000100:00100000:3.0:1746143118.468185:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858397440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.468198:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.468209:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d71400/0x25aee876ca70bb99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f309 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.468238:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861149568:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143118.471428:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.473635:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861149568:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143118.473658:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d71400/0x25aee876ca70bb99 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f309 expref: 27 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.473670:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d71400/0x25aee876ca70bb99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f309 expref: 27 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.473694:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d71400, rc 0) 00000100:00100000:3.0:1746143118.474142:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858397440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5956us (9278us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.474149:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11744 00000100:00100000:0.0:1746143118.483371:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.483857:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858398336 00000100:00100000:3.0:1746143118.483864:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858398336 00002000:00100000:3.0:1746143118.483895:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1863679) req@ffff880094425180 x1830962858398336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.483903:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425180 with x1830962858398336 ext(1048576->1863679) 00002000:00010000:3.0:1746143118.483907:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094425180 00000100:00100000:3.0:1746143118.483932:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5691 00000100:00100000:3.0:1746143118.483939:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858398336:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:1.0:1746143118.487899:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143118.498008:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.503193:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858398336:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19245us (19820us total) trans 0 rc 815104/815104 00000100:00100000:3.0:1746143118.503205:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5691 00002000:00100000:3.0:1746143118.503215:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1863679) req@ffff880094425180 x1830962858398336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/440 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.503224:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425180 with x1830962858398336 ext(1048576->1863679) 00002000:00010000:3.0:1746143118.503229:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094425180 00000100:00100000:0.0:1746143118.513886:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.515117:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858398592 00000100:00100000:3.0:1746143118.515129:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858398592 00002000:00100000:3.0:1746143118.515173:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x304:0x0] (1622016->2097151) req@ffff880091980000 x1830962858398592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.515184:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980000 with x1830962858398592 ext(1622016->2097151) 00002000:00010000:3.0:1746143118.515189:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091980000 00000100:00100000:3.0:1746143118.515222:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5693 00000100:00100000:3.0:1746143118.515230:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858398592:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143118.528089:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858398592:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12850us (14205us total) trans 0 rc 475136/475136 00000100:00100000:3.0:1746143118.528101:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5693 00002000:00100000:3.0:1746143118.528111:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x304:0x0] (1622016->2097151) req@ffff880091980000 x1830962858398592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/440 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 475136/475136 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.528121:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980000 with x1830962858398592 ext(1622016->2097151) 00002000:00010000:3.0:1746143118.528127:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091980000 00000100:00100000:0.0:1746143118.539150:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.539352:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858398848 00000100:00100000:3.0:1746143118.539363:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858398848 00002000:00100000:3.0:1746143118.539407:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880091983100 x1830962858398848/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.539422:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091983100 with x1830962858398848 ext(2097152->3145727) 00002000:00010000:3.0:1746143118.539426:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091983100 00000100:00100000:3.0:1746143118.539461:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5694 00000100:00100000:3.0:1746143118.539469:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858398848:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143118.574985:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858398848:12345-192.168.201.28@tcp:3:cat.0 Request processed in 35505us (35834us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143118.574998:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5694 00002000:00100000:3.0:1746143118.575011:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880091983100 x1830962858398848/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/440 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.575020:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091983100 with x1830962858398848 ext(2097152->3145727) 00002000:00010000:3.0:1746143118.575027:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091983100 00000100:00100000:0.0:1746143118.592952:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.606797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.606849:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.608120:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5696 00000100:00100000:1.0:1746143118.608135:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858399488:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143118.646869:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858399488:12345-192.168.201.28@tcp:3:cat.0 Request processed in 38726us (40005us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143118.646882:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5696 00002000:00100000:1.0:1746143118.646895:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009310d500 x1830962858399488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/440 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.646905:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310d500 with x1830962858399488 ext(3145728->4194303) 00002000:00010000:1.0:1746143118.646911:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310d500 00000100:00100000:0.0:1746143118.662309:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.671305:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.674285:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.674408:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858399744 00000100:00100000:3.0:1746143118.674633:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858399744 00000100:00100000:3.0:1746143118.674677:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858399872 00000100:00100000:3.0:1746143118.674679:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858399872 00000100:00100000:3.0:1746143118.674700:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11749 00000100:00100000:3.0:1746143118.674707:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30645:x1830962858399744:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143118.674723:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.674738:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f32c expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143118.675063:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11750 00000100:00100000:1.0:1746143118.675075:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30638:x1830962858399872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143118.675091:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143118.675106:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f333 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143118.675132:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143118.675139:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143118.675141:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143118.675144:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143118.675171:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143118.675188:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 22 pid: 8450 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143118.675200:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861149824:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143118.675672:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143118.677543:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861149824:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143118.677567:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143118.677584:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cf9a00, rc 0) 00000100:00100000:1.0:1746143118.677624:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30638:x1830962858399872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2552us (3348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143118.677632:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11750 00000100:00100000:0.0:1746143118.678221:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143118.678410:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fb400/0x25aee876ca70bb5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2ca expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.678430:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x25aee876ca70bb7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2f4 expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.678437:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.678439:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.678443:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3244032->3289087] (req 3244032->3289087) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 19 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.678496:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x25aee876ca70bb7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2f4 expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.678509:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x25aee876ca70bb7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2f4 expref: 19 pid: 8450 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143118.678522:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861149952:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.678617:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4fb400/0x25aee876ca70bb5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2ca expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.678625:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4fb400/0x25aee876ca70bb5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2ca expref: 23 pid: 754 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.678633:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861150080:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.678651:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143118.679125:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858400000 00000100:00100000:1.0:1746143118.679133:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858400000 00002000:00100000:1.0:1746143118.679167:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4308991) req@ffff88009310c700 x1830962858400000/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.679178:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310c700 with x1830962858400000 ext(4194304->4308991) 00010000:00010000:1.0:1746143118.679185:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 23 pid: 8450 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143118.679197:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 23 pid: 8450 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746143118.679209:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310c700 00000100:00100000:1.0:1746143118.679225:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1887 00000100:00100000:1.0:1746143118.679232:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858400000:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143118.685707:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.688265:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861149952:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.688281:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fb400/0x25aee876ca70bb5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2ca expref: 23 pid: 754 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.688308:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861150080:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.688335:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->3289087] (req 3244032->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 19 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.688346:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b14dcc00, rc 0) 00000100:00100000:3.0:1746143118.688853:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30645:x1830962858399744:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14145us (17561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.688861:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11749 00000100:00100000:1.0:1746143118.688961:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.689104:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858400256 00000100:00100000:0.0:1746143118.689108:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858400256 00010000:00010000:0.0:1746143118.689124:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x25aee876ca70bb7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2f4 expref: 19 pid: 8450 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143118.689642:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6200 00000100:00100000:0.0:1746143118.689649:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858400256:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143118.689659:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143118.689671:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x25aee876ca70bb7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2f4 expref: 19 pid: 8450 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.689681:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x25aee876ca70bb7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2f4 expref: 19 pid: 8450 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.689694:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x25aee876ca70bb7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2f4 expref: 19 pid: 8450 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143118.689707:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.689709:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.689717:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.689726:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.689752:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143118.689765:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861150208:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143118.690070:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.690372:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858400384 00000100:00100000:3.0:1746143118.690376:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858400384 00000100:00100000:3.0:1746143118.690398:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11751 00000100:00100000:3.0:1746143118.690404:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30640:x1830962858400384:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143118.690416:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.690430:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f33a expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.690448:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a28b800/0x25aee876ca70b9f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ab expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.690456:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec51c00/0x25aee876ca70ba18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b9 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.690462:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.690484:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746143118.690486:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746143118.690489:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 26 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.690505:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.690515:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 26 pid: 8450 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.690523:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861150336:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.690569:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec51c00/0x25aee876ca70ba18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b9 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.690578:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec51c00/0x25aee876ca70ba18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1b9 expref: 15 pid: 8450 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.690586:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861150464:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.690615:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a28b800/0x25aee876ca70b9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ab expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.690621:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a28b800/0x25aee876ca70b9f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f1ab expref: 26 pid: 8450 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.690632:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861150592:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.690646:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143118.691493:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858400000:12345-192.168.201.28@tcp:4:cat.0 Request processed in 12260us (13272us total) trans 21474839906 rc 0/0 00000100:00100000:1.0:1746143118.691502:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1887 00002000:00100000:1.0:1746143118.691511:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4308991) req@ffff88009310c700 x1830962858400000/t21474839906(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/448 e 0 to 0 dl 1746143129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.691521:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310c700 with x1830962858400000 ext(4194304->4308991) 00010000:00010000:1.0:1746143118.691528:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 27 pid: 8450 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143118.691539:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 27 pid: 8450 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746143118.691546:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310c700 00000100:00100000:0.0:1746143118.692000:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861150208:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143118.692014:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143118.692065:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858400256:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2415us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143118.692073:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6200 00000100:00100000:1.0:1746143118.692806:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858400640 00000100:00100000:1.0:1746143118.692810:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858400640 00002000:00100000:1.0:1746143118.692838:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3244032->3248127) req@ffff8800a5319500 x1830962858400640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.692846:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5319500 with x1830962858400640 ext(3244032->3248127) 00002000:00010000:1.0:1746143118.692849:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5319500 00000100:00100000:1.0:1746143118.692872:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5697 00000100:00100000:1.0:1746143118.692878:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858400640:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143118.693012:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858400640:12345-192.168.201.28@tcp:3:cat.0 Request processed in 133us (1015us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143118.693019:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5697 00002000:00100000:1.0:1746143118.693024:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3244032->3248127) req@ffff8800a5319500 x1830962858400640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/4536 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143118.693066:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5319500 with x1830962858400640 ext(3244032->3248127) 00002000:00010000:1.0:1746143118.693069:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5319500 00000100:00100000:3.0:1746143118.696479:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861150336:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.696495:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861150464:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.696504:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861150592:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.696541:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 26 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.696560:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd2e00, rc 0) 00000100:00100000:3.0:1746143118.698020:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30640:x1830962858400384:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7609us (7926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.698041:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11751 00000100:00100000:0.0:1746143118.698746:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.699301:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.699654:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.699718:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858401024 00000100:00100000:3.0:1746143118.699722:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858401024 00002000:00100000:3.0:1746143118.699750:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3284992->3289087) req@ffff88009310df80 x1830962858401024/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.699759:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310df80 with x1830962858401024 ext(3284992->3289087) 00002000:00010000:3.0:1746143118.699763:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310df80 00000100:00100000:3.0:1746143118.699927:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5698 00000100:00100000:3.0:1746143118.699934:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858401024:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143118.701377:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858401024:12345-192.168.201.28@tcp:3:cat.0 Request processed in 1440us (2072us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143118.701389:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5698 00002000:00100000:3.0:1746143118.701396:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3284992->3289087) req@ffff88009310df80 x1830962858401024/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/4536 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.701403:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310df80 with x1830962858401024 ext(3284992->3289087) 00002000:00010000:3.0:1746143118.701407:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310df80 00000100:00100000:1.0:1746143118.702204:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.703363:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858401280 00000100:00100000:3.0:1746143118.703366:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858401280 00010000:00010000:3.0:1746143118.703380:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 25 pid: 8450 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.703404:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6203 00000100:00100000:3.0:1746143118.703409:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858401280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143118.703416:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143118.703425:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 25 pid: 8450 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.703433:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 25 pid: 8450 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.703445:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d71000/0x25aee876ca70bb45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->5193727] (req 4194304->4308991) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2b5 expref: 25 pid: 8450 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.703477:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.703479:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143118.703486:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 14 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.703501:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 14 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.703536:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 14 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.703547:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861150720:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143118.704688:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143118.704934:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.705011:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858401408 00000100:00100000:0.0:1746143118.705016:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858401408 00010000:00010000:0.0:1746143118.705052:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 25 pid: 8450 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143118.705083:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6204 00000100:00100000:0.0:1746143118.705089:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858401408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143118.705097:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143118.705108:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 25 pid: 8450 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.705118:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 25 pid: 8450 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.705133:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d70a00/0x25aee876ca70bb53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2c3 expref: 25 pid: 8450 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.705145:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.705147:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.705152:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.705158:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.705179:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143118.705187:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861150848:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143118.705701:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.709765:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861150720:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143118.709789:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143118.710006:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858401280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6594us (7801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.710016:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6203 00000100:00100000:0.0:1746143118.710274:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861150848:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143118.710285:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143118.710301:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858401408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5213us (5370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143118.710307:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6204 00000100:00100000:0.0:1746143118.710365:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.710445:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.710464:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858401664 00000100:00100000:0.0:1746143118.710480:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858401664 00002000:00100000:0.0:1746143118.710513:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff88009310dc00 x1830962858401664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143118.710521:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310dc00 with x1830962858401664 ext(4194304->5206015) 00002000:00010000:0.0:1746143118.710526:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310dc00 00000100:00100000:0.0:1746143118.710540:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858401920 00000100:00100000:0.0:1746143118.710543:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858401920 00002000:00100000:0.0:1746143118.710551:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2256896->2260991) req@ffff88009310fb80 x1830962858401920/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143118.710557:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310fb80 with x1830962858401920 ext(2256896->2260991) 00002000:00010000:0.0:1746143118.710560:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310fb80 00000100:00100000:0.0:1746143118.710569:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5699 00000100:00100000:0.0:1746143118.710574:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858401664:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143118.712009:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5700 00000100:00100000:3.0:1746143118.712019:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858401920:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143118.712170:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858401920:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 154us (1725us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143118.712175:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5700 00002000:00100000:3.0:1746143118.712179:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (2256896->2260991) req@ffff88009310fb80 x1830962858401920/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/4536 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.712186:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310fb80 with x1830962858401920 ext(2256896->2260991) 00002000:00010000:3.0:1746143118.712191:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310fb80 00000100:00100000:0.0:1746143118.728223:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.738636:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.738686:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.739621:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858402304 00000100:00100000:3.0:1746143118.739630:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858402304 00000100:00100000:3.0:1746143118.739679:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858402432 00000100:00100000:3.0:1746143118.739682:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858402432 00000100:00100000:3.0:1746143118.739698:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11752 00000100:00100000:3.0:1746143118.739705:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858402304:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.739721:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.739737:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bbd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f341 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.739764:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bbd1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f341 expref: 16 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.739774:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bbd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f341 expref: 16 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.739787:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3c00, rc 0) 00000100:00100000:3.0:1746143118.739828:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858402304:12345-192.168.201.28@tcp:101:cat.0 Request processed in 123us (1199us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.739833:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11752 00000100:00100000:3.0:1746143118.739847:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11753 00000100:00100000:3.0:1746143118.739852:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858402432:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.739858:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.739866:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3400/0x25aee876ca70bbd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f348 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.739901:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861150976:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143118.739948:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.743953:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861150976:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143118.743979:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3400/0x25aee876ca70bbd8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f348 expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.743992:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3400/0x25aee876ca70bbd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f348 expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.744134:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3400, rc 0) 00000100:00100000:3.0:1746143118.744274:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858402432:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4420us (5586us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.744281:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11753 00000100:00100000:0.0:1746143118.746227:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.746284:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858402560 00000100:00100000:3.0:1746143118.746291:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858402560 00000100:00100000:3.0:1746143118.746338:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11754 00000100:00100000:3.0:1746143118.746345:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858402560:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.746359:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.746376:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2800/0x25aee876ca70bbdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f34f expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.746418:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861151104:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143118.746492:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.748729:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.748782:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.749017:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.749675:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11755 00000100:00100000:1.0:1746143118.749689:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858402688:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143118.749709:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143118.749727:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305b8400/0x25aee876ca70bbe6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f356 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143118.749779:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861151232:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143118.750493:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.751231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.751268:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.751893:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858402944 00000100:00100000:3.0:1746143118.751900:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858402944 00000100:00100000:3.0:1746143118.751923:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858402816 00000100:00100000:3.0:1746143118.751925:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858402816 00000100:00100000:3.0:1746143118.751940:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11758 00000100:00100000:3.0:1746143118.751946:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858402944:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.751956:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.751965:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3400/0x25aee876ca70bbfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f364 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143118.751995:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861151488:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143118.752026:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861151104:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143118.752047:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143118.752061:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2800/0x25aee876ca70bbdf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f34f expref: 28 pid: 22204 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143118.752066:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11759 00000100:00100000:3.0:1746143118.752073:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858402816:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143118.752074:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2800/0x25aee876ca70bbdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f34f expref: 28 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.752081:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143118.752086:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd2800, rc 0) 00010000:00010000:3.0:1746143118.752089:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2000/0x25aee876ca70bc02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f35d expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143118.752104:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858402560:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5760us (5886us total) trans 0 rc 301/301 00010000:00010000:3.0:1746143118.752105:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2000/0x25aee876ca70bc02 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f35d expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143118.752111:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11754 00010000:00010000:3.0:1746143118.752114:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2000/0x25aee876ca70bc02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f35d expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.752133:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd2000, rc 0) 00000100:00100000:3.0:1746143118.752153:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858402816:12345-192.168.201.28@tcp:101:cat.0 Request processed in 80us (884us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.752159:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11759 00000100:00100000:1.0:1746143118.755613:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861151232:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143118.755632:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305b8400/0x25aee876ca70bbe6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f356 expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143118.755641:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305b8400/0x25aee876ca70bbe6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f356 expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143118.755661:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305b8400, rc 0) 00000100:00100000:1.0:1746143118.755679:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858402688:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5996us (6956us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143118.755685:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11755 00000100:00100000:3.0:1746143118.757065:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861151488:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143118.757087:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3400/0x25aee876ca70bbfb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f364 expref: 19 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.757097:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3400/0x25aee876ca70bbfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f364 expref: 19 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143118.757104:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3400, rc 0) 00000100:00100000:3.0:1746143118.757134:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858402944:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5188us (5903us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143118.757140:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11758 00000100:00100000:0.0:1746143118.767495:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.768455:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858403328 00000100:00100000:3.0:1746143118.768464:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858403328 00000100:00100000:3.0:1746143118.768523:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11760 00000100:00100000:3.0:1746143118.768531:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30649:x1830962858403328:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.768549:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.768565:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f379 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.768591:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fa400/0x25aee876ca70bb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d1 expref: 17 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.768599:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.768601:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.768604:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.768634:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4fa400/0x25aee876ca70bb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d1 expref: 17 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.768649:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4fa400/0x25aee876ca70bb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2d1 expref: 17 pid: 754 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.768661:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861151616:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.769224:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.772480:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861151616:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.772508:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.772523:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd2200, rc 0) 00000100:00100000:3.0:1746143118.772584:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30649:x1830962858403328:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4053us (5096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.772593:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11760 00000100:00100000:0.0:1746143118.774029:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.786130:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.801535:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.828359:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.828487:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858403968 00000100:00100000:3.0:1746143118.828499:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858403968 00000100:00100000:3.0:1746143118.828568:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11761 00000100:00100000:3.0:1746143118.828577:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30649:x1830962858403968:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.828593:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.828607:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f380 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.828631:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.828642:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.828644:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.828647:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.829603:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.829616:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 18 pid: 22204 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.829630:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861151872:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.829731:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.832878:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.834147:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861151872:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.834175:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.834191:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3800, rc 0) 00000100:00100000:3.0:1746143118.836196:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30649:x1830962858403968:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7614us (7841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.836204:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11761 00000100:00100000:0.0:1746143118.881064:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143118.881327:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 21 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143118.881357:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e57f600/0x25aee876ca70bb84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2e6 expref: 21 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143118.881391:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143118.881393:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143118.881401:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143118.881410:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143118.881446:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143118.881458:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861152000:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143118.881556:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea80180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143118.889901:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861152000:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143118.889928:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143118.890518:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858404224:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9242us (9491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143118.890529:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6206 00000100:00100000:0.0:1746143118.908630:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143118.908743:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858404480 00000100:00100000:2.0:1746143118.908960:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858404480 00002000:00100000:2.0:1746143118.909012:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094514000 x1830962858404480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143118.909121:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514000 with x1830962858404480 ext(1048576->2097151) 00002000:00010000:2.0:1746143118.909129:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094514000 00000100:00100000:2.0:1746143118.909309:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5703 00000100:00100000:2.0:1746143118.909318:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858404480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143118.932868:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858404480:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23539us (24239us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143118.932882:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5703 00002000:00100000:3.0:1746143118.932896:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094514000 x1830962858404480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/440 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.932907:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514000 with x1830962858404480 ext(1048576->2097151) 00002000:00010000:3.0:1746143118.932914:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094514000 00000100:00100000:0.0:1746143118.947370:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.948278:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858404608 00000100:00100000:3.0:1746143118.948291:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858404608 00000100:00100000:3.0:1746143118.948364:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11762 00000100:00100000:3.0:1746143118.948373:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30649:x1830962858404608:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143118.948392:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.948412:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f387 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.950138:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.950152:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.950154:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143118.950159:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.950199:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.950213:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.950228:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861152128:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.950351:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.955842:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861152128:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.955872:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.955888:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3c00, rc 0) 00000100:00100000:3.0:1746143118.955934:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30649:x1830962858404608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7562us (8569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.955942:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11762 00000100:00100000:0.0:1746143118.958461:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.963542:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858404736 00000100:00100000:3.0:1746143118.963553:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858404736 00002000:00100000:3.0:1746143118.963600:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2256896->2949119) req@ffff880094516a00 x1830962858404736/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.963609:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516a00 with x1830962858404736 ext(2256896->2949119) 00010000:00010000:3.0:1746143118.963618:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143118.963631:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143118.963637:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094516a00 00000100:00100000:3.0:1746143118.963666:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1890 00000100:00100000:3.0:1746143118.963672:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858404736:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143118.972234:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143118.972949:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858404864 00000100:00100000:3.0:1746143118.972960:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858404864 00000100:00100000:3.0:1746143118.973001:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11763 00000100:00100000:3.0:1746143118.973008:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30653:x1830962858404864:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143118.973028:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143118.973060:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f38e expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.973091:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.973099:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143118.973103:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.973108:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746143118.973112:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2375680->3067903] (req 2375680->3067903) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.973144:0:8448:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.973154:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.973163:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 16 pid: 4758 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143118.973174:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861152384:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143118.976836:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.979274:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.979316:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858404992 00000100:00100000:0.0:1746143118.979324:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858404992 00000100:00100000:0.0:1746143118.979373:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11764 00000100:00100000:0.0:1746143118.979386:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30655:x1830962858404992:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143118.979403:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143118.979421:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f395 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.979453:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.979474:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b52a3800/0x25aee876ca70b915 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f103 expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.979482:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 27 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.979490:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.979492:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.979495:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1409024->1470463] (req 1409024->1470463) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.979527:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 27 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.979538:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 27 pid: 8448 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143118.979550:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861152512:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143118.979620:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b52a3800/0x25aee876ca70b915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f103 expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.979628:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b52a3800/0x25aee876ca70b915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f103 expref: 6 pid: 754 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143118.979637:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861152640:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143118.979661:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.979669:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 16 pid: 4758 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143118.979677:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861152768:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143118.979691:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143118.984789:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.984993:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.985089:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861152512:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143118.985098:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861152640:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143118.985105:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861152768:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143118.985134:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1409024->1470463] (req 1409024->1470463) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143118.985151:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c044c00, rc 0) 00000100:00100000:1.0:1746143118.985196:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:30655:x1830962858404992:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5811us (5931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143118.985205:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11764 00000100:00100000:1.0:1746143118.985253:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858405120 00000100:00100000:1.0:1746143118.985259:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858405120 00010000:00010000:1.0:1746143118.985282:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 27 pid: 8448 timeout: 1000 lvb_type: 1 00000100:00100000:1.0:1746143118.985300:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858405248 00000100:00100000:1.0:1746143118.985301:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858405248 00010000:00010000:1.0:1746143118.985317:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52a3800/0x25aee876ca70b915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f103 expref: 7 pid: 754 timeout: 1000 lvb_type: 1 00000100:00100000:1.0:1746143118.985333:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6207 00000100:00100000:1.0:1746143118.985338:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858405120:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143118.985350:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143118.985369:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 27 pid: 8448 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.985378:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 27 pid: 8448 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.985399:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70b8ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0c4 expref: 27 pid: 8448 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.985414:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143118.985428:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858405120:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 90us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143118.985433:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6207 00000100:00100000:1.0:1746143118.985443:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6208 00000100:00100000:1.0:1746143118.985447:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858405248:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143118.985452:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143118.985457:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b52a3800/0x25aee876ca70b915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f103 expref: 7 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.985477:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b52a3800/0x25aee876ca70b915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f103 expref: 7 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.985494:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b52a3800/0x25aee876ca70b915 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f103 expref: 7 pid: 754 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143118.985506:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143118.985521:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858405248:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 73us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143118.985526:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6208 00000100:00080000:1.0:1746143118.985540:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143118.987478:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861152384:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143118.987510:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2375680->3067903] (req 2375680->3067903) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143118.987523:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3200, rc 0) 00000100:00100000:3.0:1746143118.988368:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30653:x1830962858404864:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 15355us (16740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143118.988376:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11763 00000100:00100000:0.0:1746143118.988508:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.989054:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.989080:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858405376 00000100:00100000:0.0:1746143118.989087:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858405376 00010000:00010000:0.0:1746143118.989116:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 16 pid: 4758 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143118.989135:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858405504 00000100:00100000:0.0:1746143118.989136:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858405504 00010000:00010000:0.0:1746143118.989144:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 17 pid: 4758 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143118.989157:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6209 00000100:00100000:0.0:1746143118.989162:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858405376:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143118.989176:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143118.989197:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 17 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.989207:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 17 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143118.989227:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fbc5800/0x25aee876ca70b874 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f0a1 expref: 17 pid: 4758 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143118.989300:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6210 00000100:00100000:1.0:1746143118.989308:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858405504:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143118.989315:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143118.989325:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 16 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143118.989333:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 16 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143118.989344:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70bbc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2949120->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f333 expref: 16 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143118.989354:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143118.989382:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858405504:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 75us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143118.989387:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6210 00010000:00010000:0.0:1746143118.991383:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.991388:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.991400:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.991408:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143118.991595:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143118.991657:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143118.991670:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861152896:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143118.991729:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143118.993091:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858404736:12345-192.168.201.28@tcp:4:cat.0 Request processed in 29413us (34630us total) trans 21474839907 rc 0/0 00000100:00100000:2.0:1746143118.993103:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1890 00002000:00100000:2.0:1746143118.993114:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2256896->2949119) req@ffff880094516a00 x1830962858404736/t21474839907(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/448 e 0 to 0 dl 1746143129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143118.993124:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516a00 with x1830962858404736 ext(2256896->2949119) 00010000:00010000:2.0:1746143118.993133:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 26 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143118.993146:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 26 pid: 22204 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143118.993152:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094516a00 00000100:00100000:1.0:1746143118.993770:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.993797:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.993811:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143118.993829:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858405632 00000100:00100000:1.0:1746143118.993835:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858405632 00000100:00100000:1.0:1746143118.993867:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858405760 00000100:00100000:1.0:1746143118.993869:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858405760 00000100:00100000:1.0:1746143118.993880:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858405888 00000100:00100000:1.0:1746143118.993882:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858405888 00000100:00100000:1.0:1746143118.993992:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858406016 00000100:00100000:1.0:1746143118.993995:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858406016 00000100:00100000:0.0:1746143118.994050:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11765 00000100:00100000:0.0:1746143118.994059:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858405632:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143118.994074:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143118.994090:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f39c expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.994108:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.994110:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.994118:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.994130:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.994138:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57e400, rc 0) 00000100:00100000:0.0:1746143118.994162:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962858405632:12345-192.168.201.28@tcp:101:cat.0 Request processed in 106us (2569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143118.994166:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11765 00000100:00100000:0.0:1746143118.994176:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11766 00000100:00100000:0.0:1746143118.994180:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858405760:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143118.994185:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143118.994190:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3a3 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143118.994198:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.994199:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143118.994202:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143118.994209:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143118.995003:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11767 00000100:00100000:2.0:1746143118.995011:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858405888:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143118.995019:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143118.995045:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a53f1200/0x25aee876ca70bc3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3aa expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143118.995079:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861153024:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143118.995121:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea80180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143118.995137:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11768 00000100:00100000:2.0:1746143118.995142:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858406016:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143118.995148:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143118.995154:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70bc41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3b1 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143118.995170:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70bc41 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3b1 expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143118.995178:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090434c00/0x25aee876ca70bc41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3b1 expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143118.995191:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090434c00, rc 0) 00000100:00100000:2.0:1746143118.995206:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858406016:12345-192.168.201.28@tcp:101:cat.0 Request processed in 64us (1394us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143118.995211:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11768 00010000:00010000:0.0:1746143118.995332:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57fe00, rc 0) 00000100:00100000:0.0:1746143118.995790:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858405760:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1254us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143118.995800:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11766 00000100:00100000:2.0:1746143118.996956:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.997015:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858406144 00000100:00100000:0.0:1746143118.997022:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858406144 00000100:00100000:0.0:1746143118.997066:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11769 00000100:00100000:0.0:1746143118.997072:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858406144:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143118.997083:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143118.997095:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e57e600/0x25aee876ca70bc48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3b8 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143118.998005:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.998124:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861153152:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143118.998319:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861152896:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143118.998336:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143118.998358:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858405376:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9195us (9851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143118.998368:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6209 00000100:00100000:2.0:1746143118.998696:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143118.999192:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143118.999388:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858406400 00000100:00100000:3.0:1746143118.999393:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858406400 00002000:00100000:3.0:1746143118.999426:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (1409024->1413119) req@ffff8800a531b480 x1830962858406400/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/0 e 0 to 0 dl 1746143129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143118.999435:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b480 with x1830962858406400 ext(1409024->1413119) 00002000:00010000:3.0:1746143118.999440:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531b480 00002000:00010000:2.0:1746143119.000939:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143115 -> 1746143117 00002000:00010000:2.0:1746143119.000944:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143115 -> 1746143117 00002000:00010000:2.0:1746143119.000946:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143115 -> 1746143117 00000100:00100000:2.0:1746143119.000965:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861153024:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143119.000995:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a53f1200/0x25aee876ca70bc3a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3aa expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.001012:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f1200/0x25aee876ca70bc3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3aa expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.001022:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53f1200, rc 0) 00000100:00100000:2.0:1746143119.001073:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858405888:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6063us (7275us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.001080:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11767 00000100:00100000:3.0:1746143119.001222:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5704 00000100:00100000:3.0:1746143119.001230:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858406400:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143119.001379:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858406400:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 151us (3381us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143119.001384:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5704 00002000:00100000:3.0:1746143119.001390:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (1409024->1413119) req@ffff8800a531b480 x1830962858406400/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:269/0 lens 488/4536 e 0 to 0 dl 1746143129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.001396:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b480 with x1830962858406400 ext(1409024->1413119) 00002000:00010000:3.0:1746143119.001400:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531b480 00000100:00100000:1.0:1746143119.001701:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858406528 00000100:00100000:1.0:1746143119.001706:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858406528 00010000:00010000:1.0:1746143119.001729:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 26 pid: 22204 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143119.001749:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6211 00000100:00100000:1.0:1746143119.001753:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858406528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143119.001767:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143119.001781:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 26 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.001790:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 26 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.001809:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bbca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2256896->2949119] (req 2256896->2949119) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f33a expref: 26 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.001821:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.001822:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.001830:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.001839:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.001867:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.001878:0:9869:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143119.001886:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861153280:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143119.001943:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143119.002645:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861153152:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143119.002667:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e57e600/0x25aee876ca70bc48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3b8 expref: 23 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143119.002678:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e57e600/0x25aee876ca70bc48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3b8 expref: 23 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143119.002687:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57e600, rc 0) 00000100:00100000:1.0:1746143119.002722:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858406144:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5649us (5768us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143119.002729:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11769 00000100:00100000:1.0:1746143119.006188:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861153280:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143119.006211:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143119.006662:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858406528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4905us (7963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.006672:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6211 00000100:00100000:0.0:1746143119.012357:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.013120:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858406784 00000100:00100000:2.0:1746143119.013130:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858406784 00002000:00100000:2.0:1746143119.013175:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800919dd180 x1830962858406784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.013184:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dd180 with x1830962858406784 ext(2097152->3145727) 00010000:00010000:2.0:1746143119.013193:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143119.013207:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143119.013214:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919dd180 00000100:00100000:2.0:1746143119.013247:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1891 00000100:00100000:2.0:1746143119.013255:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858406784:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143119.014074:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.014145:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858406912 00000100:00100000:3.0:1746143119.014149:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858406912 00002000:00100000:3.0:1746143119.014170:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009c1e9f80 x1830962858406912/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.014178:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9f80 with x1830962858406912 ext(3145728->4194303) 00010000:00010000:3.0:1746143119.014183:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 27 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143119.014193:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 27 pid: 8448 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143119.014199:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1e9f80 00000100:00100000:3.0:1746143119.014215:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1892 00000100:00100000:3.0:1746143119.014221:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858406912:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143119.019596:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.019644:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.019670:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858407296 00000100:00100000:2.0:1746143119.019678:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858407296 00000100:00100000:3.0:1746143119.019714:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858407552 00000100:00100000:3.0:1746143119.019717:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858407552 00002000:00100000:3.0:1746143119.019781:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800919dc000 x1830962858407552/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.019791:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dc000 with x1830962858407552 ext(1048576->2097151) 00002000:00010000:3.0:1746143119.019797:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dc000 00000100:00100000:3.0:1746143119.019818:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5705 00000100:00100000:3.0:1746143119.019825:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858407552:12345-192.168.201.28@tcp:3:cat.0 00000100:00080000:1.0:1746143119.019843:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:2.0:1746143119.020637:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800919dce00 x1830962858407296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.020646:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dce00 with x1830962858407296 ext(1048576->2097151) 00002000:00010000:2.0:1746143119.020649:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dce00 00000100:00100000:2.0:1746143119.020670:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5706 00000100:00100000:2.0:1746143119.020677:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858407296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143119.033214:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858406912:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 18983us (19131us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.033226:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1892 00002000:00100000:3.0:1746143119.033239:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009c1e9f80 x1830962858406912/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.033248:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9f80 with x1830962858406912 ext(3145728->4194303) 00010000:00010000:3.0:1746143119.033258:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 27 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143119.033272:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 27 pid: 8448 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143119.033279:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1e9f80 00000100:00100000:2.0:1746143119.041199:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858406784:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 27935us (29167us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143119.041210:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1891 00002000:00100000:2.0:1746143119.041220:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800919dd180 x1830962858406784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.041229:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dd180 with x1830962858406784 ext(2097152->3145727) 00010000:00010000:2.0:1746143119.041238:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143119.041252:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 25 pid: 8448 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143119.041258:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919dd180 00000100:00100000:3.0:1746143119.053654:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858407552:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33822us (34002us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.053666:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5705 00002000:00100000:3.0:1746143119.053677:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800919dc000 x1830962858407552/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.053685:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dc000 with x1830962858407552 ext(1048576->2097151) 00002000:00010000:3.0:1746143119.053690:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dc000 00000100:00100000:0.0:1746143119.063405:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.063497:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858407680 00000100:00100000:1.0:1746143119.063506:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858407680 00000100:00100000:1.0:1746143119.063560:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11770 00000100:00100000:1.0:1746143119.063567:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30649:x1830962858407680:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143119.063582:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143119.063596:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3bf expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.063615:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.063617:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.063623:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.063635:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.063645:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490a400, rc 0) 00000100:00100000:1.0:1746143119.063681:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30649:x1830962858407680:12345-192.168.201.28@tcp:101:cat.0 Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.063686:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11770 00000100:00100000:2.0:1746143119.064333:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858407296:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43656us (44743us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143119.064342:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5706 00002000:00100000:2.0:1746143119.064349:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800919dce00 x1830962858407296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.064357:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dce00 with x1830962858407296 ext(1048576->2097151) 00002000:00010000:2.0:1746143119.064362:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dce00 00000100:00100000:0.0:1746143119.069770:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.070082:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.070179:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858408064 00000100:00100000:2.0:1746143119.070190:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858408064 00002000:00100000:2.0:1746143119.070237:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800919dfb80 x1830962858408064/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.070247:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dfb80 with x1830962858408064 ext(3145728->4194303) 00002000:00010000:2.0:1746143119.070252:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dfb80 00000100:00100000:2.0:1746143119.070296:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5707 00000100:00100000:2.0:1746143119.070304:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858408064:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143119.071747:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858407808 00000100:00100000:1.0:1746143119.071753:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858407808 00010000:00010000:1.0:1746143119.071777:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 28 pid: 8448 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143119.071810:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6212 00000100:00100000:1.0:1746143119.071817:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858407808:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143119.071827:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143119.071842:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 28 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.071855:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 28 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.071877:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70bc17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f387 expref: 28 pid: 8448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.071895:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.071897:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.071903:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.071909:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.071938:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143119.071948:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861153408:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143119.072055:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.077213:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.077298:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858408320 00000100:00100000:3.0:1746143119.077310:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858408320 00002000:00100000:3.0:1746143119.077372:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2375680->2379775) req@ffff8800919df800 x1830962858408320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.077382:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919df800 with x1830962858408320 ext(2375680->2379775) 00002000:00010000:3.0:1746143119.077387:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919df800 00000100:00100000:3.0:1746143119.077422:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5708 00000100:00100000:3.0:1746143119.077432:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858408320:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143119.077615:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858408320:12345-192.168.201.28@tcp:3:cat.0 Request processed in 185us (413us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143119.077622:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5708 00002000:00100000:3.0:1746143119.077628:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2375680->2379775) req@ffff8800919df800 x1830962858408320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.077635:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919df800 with x1830962858408320 ext(2375680->2379775) 00002000:00010000:3.0:1746143119.077638:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919df800 00000100:00100000:1.0:1746143119.078018:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861153408:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143119.078062:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143119.078095:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858407808:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6278us (8338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.078102:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6212 00000100:00080000:0.0:1746143119.078594:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143119.085217:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858408064:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 14904us (15125us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143119.085230:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5707 00002000:00100000:2.0:1746143119.085240:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800919dfb80 x1830962858408064/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.085249:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dfb80 with x1830962858408064 ext(3145728->4194303) 00002000:00010000:2.0:1746143119.085255:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dfb80 00000100:00100000:0.0:1746143119.095828:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.097205:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.097755:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858408576 00000100:00100000:2.0:1746143119.097771:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858408576 00002000:00100000:2.0:1746143119.097822:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3063808->3067903) req@ffff8800919dca80 x1830962858408576/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.097833:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dca80 with x1830962858408576 ext(3063808->3067903) 00002000:00010000:2.0:1746143119.097839:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dca80 00000100:00100000:2.0:1746143119.097863:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5709 00000100:00100000:2.0:1746143119.097871:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858408576:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143119.098106:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858408576:12345-192.168.201.28@tcp:3:cat.0 Request processed in 235us (2290us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143119.098113:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5709 00002000:00100000:2.0:1746143119.098119:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (3063808->3067903) req@ffff8800919dca80 x1830962858408576/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.098128:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dca80 with x1830962858408576 ext(3063808->3067903) 00002000:00010000:2.0:1746143119.098131:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dca80 00000100:00100000:3.0:1746143119.098270:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858408704 00000100:00100000:3.0:1746143119.098275:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858408704 00000100:00100000:3.0:1746143119.098307:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11771 00000100:00100000:3.0:1746143119.098313:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30658:x1830962858408704:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143119.098322:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.098338:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3c6 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.098362:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.098370:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143119.098371:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143119.098374:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.098400:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.098635:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 24 pid: 4758 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143119.098646:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861153536:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143119.098717:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.107740:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.107784:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.107890:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858408960 00000100:00100000:1.0:1746143119.107904:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858408960 00000100:00100000:2.0:1746143119.107940:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858408832 00000100:00100000:2.0:1746143119.107947:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858408832 00000100:00100000:1.0:1746143119.107962:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11772 00000100:00100000:1.0:1746143119.107970:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30649:x1830962858408960:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143119.107986:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746143119.107991:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1409024->1470463) req@ffff8800919df100 x1830962858408832/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143119.108001:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3cd expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143119.108002:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919df100 with x1830962858408832 ext(1409024->1470463) 00010000:00010000:2.0:1746143119.108011:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 25 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143119.108026:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 25 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.108059:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143119.108062:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919df100 00010000:00010000:1.0:1746143119.108071:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143119.108073:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143119.108077:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.108080:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1893 00000100:00100000:2.0:1746143119.108087:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858408832:12345-192.168.201.28@tcp:4:multiop.0 00010000:00010000:1.0:1746143119.108106:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.108116:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 21 pid: 22204 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143119.108127:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861153664:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143119.108206:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143119.108639:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861153536:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143119.108666:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.108680:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1ed000, rc 0) 00000100:00100000:3.0:1746143119.108708:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30658:x1830962858408704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10395us (11506us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.108715:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11771 00000100:00100000:2.0:1746143119.112134:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858408832:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 4036us (4338us total) trans 21474839908 rc 0/0 00000100:00100000:2.0:1746143119.112148:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1893 00002000:00100000:2.0:1746143119.112161:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1409024->1470463) req@ffff8800919df100 x1830962858408832/t21474839908(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/448 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.112172:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919df100 with x1830962858408832 ext(1409024->1470463) 00010000:00010000:2.0:1746143119.112183:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 27 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143119.112196:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 27 pid: 4758 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143119.112204:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919df100 00000100:00100000:0.0:1746143119.112979:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.113079:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861153664:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143119.113107:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.113123:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b484d200, rc 0) 00000100:00100000:1.0:1746143119.113147:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30649:x1830962858408960:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5179us (5418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.113153:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11772 00000100:00100000:2.0:1746143119.114254:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858409088 00000100:00100000:2.0:1746143119.114262:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858409088 00002000:00100000:2.0:1746143119.114298:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3244032->3289087) req@ffff8800919ded80 x1830962858409088/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.114306:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919ded80 with x1830962858409088 ext(3244032->3289087) 00010000:00010000:2.0:1746143119.114313:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 22 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143119.114324:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 22 pid: 22204 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143119.114331:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919ded80 00000100:00100000:0.0:1746143119.114580:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.115565:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1894 00000100:00100000:2.0:1746143119.115577:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962858409088:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143119.116349:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858409216 00000100:00100000:1.0:1746143119.116356:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858409216 00010000:00010000:1.0:1746143119.116386:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 27 pid: 4758 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143119.116412:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6213 00000100:00100000:1.0:1746143119.116417:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858409216:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143119.116426:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143119.116445:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 27 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.116455:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 27 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.116488:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70bc25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1470463) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f395 expref: 27 pid: 4758 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.116516:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.116518:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.116526:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.116535:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.116564:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143119.116575:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861153792:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143119.116631:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143119.122346:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861153792:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143119.122370:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143119.122422:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858409216:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6002us (7841us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.122433:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6213 00000100:00100000:3.0:1746143119.123348:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858409088:12345-192.168.201.28@tcp:4:cat.0 Request processed in 7771us (10367us total) trans 17179872660 rc 0/0 00000100:00100000:3.0:1746143119.123357:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1894 00002000:00100000:3.0:1746143119.123366:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (3244032->3289087) req@ffff8800919ded80 x1830962858409088/t17179872660(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/448 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.123376:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919ded80 with x1830962858409088 ext(3244032->3289087) 00010000:00010000:3.0:1746143119.123386:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143119.123401:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143119.123408:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919ded80 00000100:00100000:0.0:1746143119.134955:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.136741:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.137112:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858409472 00000100:00100000:3.0:1746143119.137122:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858409472 00002000:00100000:3.0:1746143119.137169:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800919de300 x1830962858409472/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.137180:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919de300 with x1830962858409472 ext(1048576->2097151) 00002000:00010000:3.0:1746143119.137186:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919de300 00000100:00100000:1.0:1746143119.137959:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858409600 00000100:00100000:1.0:1746143119.137964:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858409600 00010000:00010000:1.0:1746143119.137993:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143119.138029:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6214 00000100:00100000:1.0:1746143119.138051:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858409600:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143119.138065:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143119.138090:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.138103:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.138128:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70bbbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3244032->18446744073709551615] (req 3244032->3289087) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f32c expref: 24 pid: 22204 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143119.138164:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.138166:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.138174:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.138188:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.138224:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143119.138235:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861153920:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143119.138316:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143119.138701:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5710 00000100:00100000:3.0:1746143119.138711:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858409472:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.155701:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861153920:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143119.155728:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143119.155799:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858409600:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 17748us (19062us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143119.155811:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6214 00000100:00100000:1.0:1746143119.155943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.157239:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858409856 00000100:00100000:0.0:1746143119.157247:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858409856 00002000:00100000:0.0:1746143119.157288:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009c1eb480 x1830962858409856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143119.157298:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1eb480 with x1830962858409856 ext(3145728->4194303) 00002000:00010000:0.0:1746143119.157302:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1eb480 00000100:00100000:0.0:1746143119.157328:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5711 00000100:00100000:0.0:1746143119.157335:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858409856:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143119.177915:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858409472:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39191us (42957us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143119.177931:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5710 00002000:00100000:2.0:1746143119.177955:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800919de300 x1830962858409472/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.177966:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919de300 with x1830962858409472 ext(1048576->2097151) 00002000:00010000:2.0:1746143119.177973:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919de300 00000100:00100000:2.0:1746143119.183732:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858409856:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 26382us (27774us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143119.183748:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5711 00002000:00100000:2.0:1746143119.183763:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009c1eb480 x1830962858409856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.183774:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1eb480 with x1830962858409856 ext(3145728->4194303) 00002000:00010000:2.0:1746143119.183781:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1eb480 00000100:00100000:0.0:1746143119.189275:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.189377:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858409984 00000100:00100000:1.0:1746143119.189391:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858409984 00000100:00100000:1.0:1746143119.189482:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11773 00000100:00100000:1.0:1746143119.189491:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30658:x1830962858409984:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143119.189512:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143119.189532:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3d4 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.189564:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.189572:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143119.189575:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143119.189578:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.189610:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.189624:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 16 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143119.189636:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861154048:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143119.189959:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b9869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.207504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.207530:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.207562:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.207603:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858410368 00000100:00100000:0.0:1746143119.207613:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858410368 00002000:00100000:0.0:1746143119.207662:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2375680->3067903) req@ffff88008eb21880 x1830962858410368/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143119.207672:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21880 with x1830962858410368 ext(2375680->3067903) 00010000:00010000:0.0:1746143119.207684:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.207704:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00010000:0.0:1746143119.207710:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb21880 00000100:00100000:0.0:1746143119.207735:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1895 00000100:00100000:0.0:1746143119.207745:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858410368:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143119.207769:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858410240 00000100:00100000:2.0:1746143119.207781:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858410240 00000100:00100000:2.0:1746143119.207825:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858410112 00000100:00100000:2.0:1746143119.207828:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858410112 00000100:00100000:2.0:1746143119.207849:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11774 00000100:00100000:2.0:1746143119.207855:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858410240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.207871:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.207890:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3fe200/0x25aee876ca70bc6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3e2 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.207922:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3fe200/0x25aee876ca70bc6b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e2 expref: 28 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.207941:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3fe200/0x25aee876ca70bc6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e2 expref: 28 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.207967:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3fe200, rc 0) 00000100:00100000:3.0:1746143119.208093:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11775 00000100:00100000:3.0:1746143119.208111:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858410112:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143119.208129:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.208144:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3db expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.208173:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143119.208176:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143119.208186:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.208203:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.208214:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1ed200, rc 0) 00000100:00100000:1.0:1746143119.208377:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861154048:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143119.208404:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.208416:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490a000, rc 0) 00000100:00100000:2.0:1746143119.209008:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858410240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1150us (1508us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.209016:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11774 00000100:00100000:3.0:1746143119.209174:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858410112:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1064us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.209181:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11775 00000100:00100000:1.0:1746143119.209301:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30658:x1830962858409984:12345-192.168.201.28@tcp:101:cat.0 Request processed in 19808us (20032us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.209307:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11773 00000100:00100000:2.0:1746143119.225152:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.225248:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858410624 00000100:00100000:3.0:1746143119.225262:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858410624 00002000:00100000:3.0:1746143119.225306:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5193727) req@ffff8800a531ad80 x1830962858410624/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.225315:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531ad80 with x1830962858410624 ext(4194304->5193727) 00002000:00010000:3.0:1746143119.225320:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531ad80 00000100:00100000:3.0:1746143119.226406:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5712 00000100:00100000:3.0:1746143119.226418:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858410624:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143119.245363:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858410368:12345-192.168.201.28@tcp:4:cat.0 Request processed in 37612us (37790us total) trans 21474839909 rc 0/0 00000100:00100000:1.0:1746143119.245375:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1895 00002000:00100000:1.0:1746143119.245386:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2375680->3067903) req@ffff88008eb21880 x1830962858410368/t21474839909(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/448 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.245395:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21880 with x1830962858410368 ext(2375680->3067903) 00010000:00010000:1.0:1746143119.245404:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 18 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.245419:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 18 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746143119.245438:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb21880 00000100:00100000:3.0:1746143119.248746:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858410624:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22325us (23599us total) trans 0 rc 999424/999424 00000100:00100000:3.0:1746143119.248777:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5712 00002000:00100000:3.0:1746143119.248786:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5193727) req@ffff8800a531ad80 x1830962858410624/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.248794:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531ad80 with x1830962858410624 ext(4194304->5193727) 00002000:00010000:3.0:1746143119.248800:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531ad80 00000100:00100000:0.0:1746143119.251179:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.251268:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858410752 00000100:00100000:2.0:1746143119.251280:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858410752 00010000:00010000:2.0:1746143119.251316:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 18 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.251360:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6215 00000100:00100000:2.0:1746143119.251367:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858410752:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143119.251379:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143119.251397:0:9869:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143116 -> 1746143117 00010000:00010000:2.0:1746143119.251402:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 18 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.251414:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 18 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.251435:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3200/0x25aee876ca70bc1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2375680->3145727] (req 2375680->3067903) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f38e expref: 18 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.251482:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.251484:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.251490:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.251499:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.251532:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.251545:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861154176:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143119.251634:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea80540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.264798:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861154176:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143119.264818:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143119.265187:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858410752:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13818us (14015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.265196:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6215 00000100:00100000:0.0:1746143119.265285:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.266952:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858411008 00000100:00100000:3.0:1746143119.266960:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858411008 00002000:00100000:3.0:1746143119.266997:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008eb21f80 x1830962858411008/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.267006:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21f80 with x1830962858411008 ext(2097152->3145727) 00002000:00010000:3.0:1746143119.267118:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21f80 00000100:00100000:3.0:1746143119.267213:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5713 00000100:00100000:3.0:1746143119.267222:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858411008:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143119.267256:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.267272:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858411136 00000100:00100000:1.0:1746143119.267275:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858411136 00000100:00100000:1.0:1746143119.267306:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11776 00000100:00100000:1.0:1746143119.267311:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858411136:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143119.267535:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143119.267549:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3e9 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.267566:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.267568:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.267574:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 28 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143119.267587:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 28 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143119.267595:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309f2400, rc 0) 00000100:00100000:1.0:1746143119.267622:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858411136:12345-192.168.201.28@tcp:101:cat.0 Request processed in 311us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.267627:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11776 00000100:00100000:3.0:1746143119.286819:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858411008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19588us (21524us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.286830:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5713 00002000:00100000:3.0:1746143119.286839:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008eb21f80 x1830962858411008/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.286848:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21f80 with x1830962858411008 ext(2097152->3145727) 00002000:00010000:3.0:1746143119.286854:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21f80 00000100:00100000:0.0:1746143119.292600:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.293063:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858411264 00000100:00100000:2.0:1746143119.293072:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858411264 00000100:00100000:2.0:1746143119.293114:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11777 00000100:00100000:2.0:1746143119.293122:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:30658:x1830962858411264:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.293136:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.293148:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3f0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.293174:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.293176:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.293181:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.293193:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.293202:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3fea00, rc 0) 00000100:00100000:2.0:1746143119.293240:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30658:x1830962858411264:12345-192.168.201.28@tcp:101:cat.0 Request processed in 119us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.293246:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11777 00000100:00100000:0.0:1746143119.304809:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.304882:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.304899:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858411520 00000100:00100000:3.0:1746143119.304908:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858411520 00002000:00100000:3.0:1746143119.304946:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008eb22300 x1830962858411520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.304957:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb22300 with x1830962858411520 ext(2097152->3145727) 00000100:00100000:1.0:1746143119.304958:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858411648 00002000:00010000:3.0:1746143119.304961:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb22300 00000100:00100000:1.0:1746143119.304962:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858411648 00002000:00100000:1.0:1746143119.304977:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eb21500 x1830962858411648/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.304989:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21500 with x1830962858411648 ext(3145728->4194303) 00002000:00010000:1.0:1746143119.304992:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb21500 00000100:00100000:3.0:1746143119.305232:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5714 00000100:00100000:3.0:1746143119.305241:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858411520:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143119.305710:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5715 00000100:00100000:3.0:1746143119.307618:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1970:x1830962858411648:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143119.319282:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858411648:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13556us (14391us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.319295:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5715 00002000:00100000:3.0:1746143119.319306:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eb21500 x1830962858411648/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.319321:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21500 with x1830962858411648 ext(3145728->4194303) 00002000:00010000:3.0:1746143119.319326:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb21500 00000100:00100000:3.0:1746143119.327642:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858411520:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22393us (22836us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.327653:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5714 00002000:00100000:3.0:1746143119.327664:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008eb22300 x1830962858411520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.327673:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb22300 with x1830962858411520 ext(2097152->3145727) 00002000:00010000:3.0:1746143119.327678:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb22300 00000100:00100000:0.0:1746143119.343130:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.343203:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858412032 00000100:00100000:3.0:1746143119.343212:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858412032 00002000:00100000:3.0:1746143119.343254:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff88008eb22680 x1830962858412032/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.343263:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb22680 with x1830962858412032 ext(4194304->5206015) 00002000:00010000:3.0:1746143119.343268:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb22680 00000100:00100000:3.0:1746143119.343297:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5716 00000100:00100000:3.0:1746143119.343305:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858412032:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.354431:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.354580:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858412160 00000100:00100000:2.0:1746143119.354589:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858412160 00000100:00100000:2.0:1746143119.354629:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11778 00000100:00100000:2.0:1746143119.354636:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:30662:x1830962858412160:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143119.354653:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.354672:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3f7 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.354696:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.354704:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 29 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.354715:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.354717:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.354720:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2330624->3129343] (req 2330624->3129343) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.354748:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 29 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.354759:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 29 pid: 4758 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143119.354770:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861154304:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.356159:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.356169:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.356178:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861154432:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143119.358010:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858412032:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14702us (14882us total) trans 0 rc 1011712/1011712 00000100:00100000:3.0:1746143119.358020:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5716 00002000:00100000:3.0:1746143119.358050:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff88008eb22680 x1830962858412032/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.358060:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb22680 with x1830962858412032 ext(4194304->5206015) 00010000:00010000:3.0:1746143119.358069:0:11337:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.358078:0:11337:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143119.358084:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb22680 00000100:00100000:2.0:1746143119.358980:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea80540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.361097:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861154304:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.361301:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861154432:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.361324:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2330624->3129343] (req 2330624->3129343) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.361344:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3fee00, rc 0) 00000100:00100000:2.0:1746143119.361383:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30662:x1830962858412160:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6747us (6959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.361392:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11778 00000100:00100000:0.0:1746143119.364993:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.365128:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858412288 00000100:00100000:2.0:1746143119.365137:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858412288 00010000:00010000:2.0:1746143119.365168:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 29 pid: 4758 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143119.365193:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6216 00000100:00100000:2.0:1746143119.365199:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858412288:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143119.365211:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143119.365229:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 29 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143119.365240:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 29 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143119.365260:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309f2400/0x25aee876ca70bc79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3e9 expref: 29 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143119.365290:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143119.365327:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858412288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.365333:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6216 00000100:00100000:1.0:1746143119.365740:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.366351:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858412416 00000100:00100000:2.0:1746143119.366559:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858412416 00000100:00100000:2.0:1746143119.366672:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11779 00000100:00100000:2.0:1746143119.366786:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858412416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.366800:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.366810:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff600/0x25aee876ca70bc8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f3fe expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.366823:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.366829:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff600/0x25aee876ca70bc8e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3fe expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.366838:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff600/0x25aee876ca70bc8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3fe expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.366844:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3ff600, rc 0) 00000100:00100000:2.0:1746143119.367212:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858412416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 532us (1471us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.367218:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11779 00000100:00100000:0.0:1746143119.369207:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.369262:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858412544 00000100:00100000:2.0:1746143119.369269:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858412544 00000100:00100000:2.0:1746143119.369310:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11780 00000100:00100000:2.0:1746143119.369317:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858412544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.369329:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.369341:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff800/0x25aee876ca70bc95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f405 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.369358:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.369596:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff800/0x25aee876ca70bc95 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f405 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.369608:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff800/0x25aee876ca70bc95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f405 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.369617:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3ff800, rc 0) 00000100:00100000:2.0:1746143119.369664:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858412544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 348us (462us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.369670:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11780 00000100:00100000:0.0:1746143119.370754:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.371757:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858412672 00000100:00100000:2.0:1746143119.371763:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858412672 00010000:00010000:2.0:1746143119.371787:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.372140:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6217 00000100:00100000:2.0:1746143119.372147:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858412672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143119.372160:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143119.372180:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.372190:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.372210:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009490a000/0x25aee876ca70bc64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3d4 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.372226:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.372228:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.372233:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.372241:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.372269:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.372281:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861154560:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143119.372379:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea80180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143119.381870:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.381975:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861154560:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143119.381994:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143119.382168:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858412672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10020us (11415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.382178:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6217 00000100:00100000:3.0:1746143119.382823:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858412928 00000100:00100000:3.0:1746143119.382830:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858412928 00002000:00100000:3.0:1746143119.382866:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (2330624->2334719) req@ffff88009c1ea300 x1830962858412928/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.382875:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1ea300 with x1830962858412928 ext(2330624->2334719) 00002000:00010000:3.0:1746143119.382879:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1ea300 00000100:00100000:3.0:1746143119.382894:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5717 00000100:00100000:3.0:1746143119.382901:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858412928:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143119.383068:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858412928:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 167us (1205us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143119.383073:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5717 00002000:00100000:3.0:1746143119.383077:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2ff:0x0] (2330624->2334719) req@ffff88009c1ea300 x1830962858412928/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.383084:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1ea300 with x1830962858412928 ext(2330624->2334719) 00002000:00010000:3.0:1746143119.383087:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1ea300 00000100:00100000:0.0:1746143119.396491:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.397062:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858413184 00000100:00100000:2.0:1746143119.397072:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858413184 00002000:00100000:2.0:1746143119.397111:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3125248->3129343) req@ffff88008eb22d80 x1830962858413184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.397120:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb22d80 with x1830962858413184 ext(3125248->3129343) 00002000:00010000:2.0:1746143119.397124:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb22d80 00000100:00100000:2.0:1746143119.397152:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5718 00000100:00100000:2.0:1746143119.397159:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858413184:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143119.397324:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858413184:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 165us (841us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143119.397331:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5718 00002000:00100000:2.0:1746143119.397337:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3125248->3129343) req@ffff88008eb22d80 x1830962858413184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.397343:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb22d80 with x1830962858413184 ext(3125248->3129343) 00002000:00010000:2.0:1746143119.397346:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb22d80 00000100:00100000:0.0:1746143119.465268:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.465339:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858413312 00000100:00100000:2.0:1746143119.465349:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858413312 00000100:00100000:2.0:1746143119.465585:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11781 00000100:00100000:2.0:1746143119.465593:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30665:x1830962858413312:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143119.465609:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.465621:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f40c expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.465643:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 25 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.465649:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.465653:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.465657:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143119.465658:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143119.465660:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2359296->3145727] (req 2359296->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.465682:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.465690:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 25 pid: 8450 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.465698:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861154688:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.466676:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.466687:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 25 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.466698:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861154816:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.467103:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 25 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.467113:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 25 pid: 754 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.467121:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861154944:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.467572:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea80180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.469093:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861154816:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.470666:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861154688:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143119.472227:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.472259:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.472473:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861154944:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.472501:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2359296->3145727] (req 2359296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.472515:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3ff400, rc 0) 00000100:00100000:2.0:1746143119.472550:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30665:x1830962858413312:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6957us (7291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.472557:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11781 00000100:00100000:3.0:1746143119.474246:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858413440 00000100:00100000:3.0:1746143119.474255:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858413440 00010000:00010000:3.0:1746143119.474284:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 26 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.474316:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858413568 00000100:00100000:3.0:1746143119.474319:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858413568 00010000:00010000:3.0:1746143119.474326:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 27 pid: 754 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.474440:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6218 00000100:00100000:3.0:1746143119.474447:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858413440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143119.474667:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143119.474685:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.474695:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.474713:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b484d200/0x25aee876ca70bc5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3cd expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143119.474764:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6219 00000100:00100000:0.0:1746143119.474771:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858413568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143119.474778:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143119.474786:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 26 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.474793:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 26 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.474802:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29a00/0x25aee876ca70bb30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2a0 expref: 26 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.474821:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143119.474850:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858413568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 80us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143119.474856:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6219 00010000:00010000:3.0:1746143119.475309:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143119.475331:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858413440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 884us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.475337:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6218 00000100:00100000:1.0:1746143119.475590:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.475699:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858413696 00000100:00100000:3.0:1746143119.475704:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858413696 00010000:00010000:3.0:1746143119.475717:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 25 pid: 8450 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.475736:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6220 00000100:00100000:3.0:1746143119.475741:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1970:x1830962858413696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143119.475747:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143119.475755:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 25 pid: 8450 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.475763:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 25 pid: 8450 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.475970:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3fea00/0x25aee876ca70bc80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f0 expref: 25 pid: 8450 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.475977:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143119.475979:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143119.475984:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.475992:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.476020:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143119.476131:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861155072:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143119.477260:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143119.480636:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861155072:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143119.480656:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143119.480706:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858413696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4962us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.480716:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6220 00000100:00100000:0.0:1746143119.481363:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.481435:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858413952 00000100:00100000:2.0:1746143119.481442:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858413952 00002000:00100000:2.0:1746143119.481490:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2359296->2363391) req@ffff88008eb21c00 x1830962858413952/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.481499:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21c00 with x1830962858413952 ext(2359296->2363391) 00002000:00010000:2.0:1746143119.481503:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb21c00 00000100:00100000:2.0:1746143119.481520:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5719 00000100:00100000:2.0:1746143119.481527:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858413952:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143119.481657:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858413952:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 130us (296us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143119.481663:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5719 00002000:00100000:2.0:1746143119.481667:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x305:0x0] (2359296->2363391) req@ffff88008eb21c00 x1830962858413952/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.481673:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21c00 with x1830962858413952 ext(2359296->2363391) 00002000:00010000:2.0:1746143119.481676:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb21c00 00010000:00010000:1.0:1746143119.492285:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143119.503927:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.506863:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858414080 00000100:00100000:2.0:1746143119.506873:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858414080 00000100:00100000:2.0:1746143119.507141:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11782 00000100:00100000:2.0:1746143119.507149:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30665:x1830962858414080:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143119.507166:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.507180:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f413 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.507207:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4fa000/0x25aee876ca70bbae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f31e expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.507215:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.507221:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143119.507222:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143119.507225:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->3153919] (req 3145728->3153919) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.507250:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.507259:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.507270:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861155200:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.507365:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4fa000/0x25aee876ca70bbae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f31e expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.507373:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4fa000/0x25aee876ca70bbae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f31e expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.507380:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861155328:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.507582:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea80180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.515324:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861155200:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.515335:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861155328:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.515363:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->3153919] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.515380:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3ff000, rc 0) 00000100:00100000:2.0:1746143119.515432:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30665:x1830962858414080:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8284us (11512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.515441:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11782 00000100:00100000:0.0:1746143119.520211:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.520483:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858414208 00000100:00100000:3.0:1746143119.520492:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858414208 00010000:00010000:3.0:1746143119.520523:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4fa000/0x25aee876ca70bbae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f31e expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.520563:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6221 00000100:00100000:3.0:1746143119.520571:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858414208:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143119.520583:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143119.520602:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4fa000/0x25aee876ca70bbae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f31e expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.520613:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4fa000/0x25aee876ca70bbae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f31e expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.520633:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4fa000/0x25aee876ca70bbae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f31e expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.520663:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143119.520699:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858414208:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 130us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.520706:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6221 00000100:00100000:0.0:1746143119.529282:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.529325:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.529600:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858414464 00000100:00100000:2.0:1746143119.529609:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858414464 00000100:00100000:2.0:1746143119.529666:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11783 00000100:00100000:2.0:1746143119.529677:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858414464:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.529694:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.529709:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff800/0x25aee876ca70bcaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f41a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.529743:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff800/0x25aee876ca70bcaa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f41a expref: 17 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.529753:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff800/0x25aee876ca70bcaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f41a expref: 17 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143119.529902:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.529913:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858414592 00000100:00100000:0.0:1746143119.529916:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858414592 00000100:00100000:1.0:1746143119.530162:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858414336 00000100:00100000:1.0:1746143119.530166:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858414336 00010000:00010000:1.0:1746143119.530184:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 29 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.530230:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3ff800, rc 0) 00000100:00100000:2.0:1746143119.530272:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858414464:12345-192.168.201.28@tcp:101:cat.0 Request processed in 595us (999us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.530278:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11783 00000100:00100000:2.0:1746143119.530293:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11784 00000100:00100000:2.0:1746143119.530298:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858414592:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.530304:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.530310:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3fea00/0x25aee876ca70bcb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f421 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.530324:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3fea00/0x25aee876ca70bcb1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f421 expref: 30 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.530332:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3fea00/0x25aee876ca70bcb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f421 expref: 30 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.530338:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3fea00, rc 0) 00000100:00100000:2.0:1746143119.530351:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858414592:12345-192.168.201.28@tcp:101:cat.0 Request processed in 54us (451us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.530359:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11784 00000100:00100000:1.0:1746143119.530686:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6222 00000100:00100000:1.0:1746143119.530692:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858414336:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143119.530701:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143119.530718:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 28 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.530727:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 28 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.530742:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009490a400/0x25aee876ca70bc4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3bf expref: 28 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.530761:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.530763:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.530769:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.530778:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.530812:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143119.530824:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861155456:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143119.530991:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b9869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143119.531118:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.531137:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858414720 00000100:00100000:1.0:1746143119.531140:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858414720 00000100:00100000:1.0:1746143119.531160:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11785 00000100:00100000:1.0:1746143119.531165:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858414720:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143119.531328:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143119.531339:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5463c00/0x25aee876ca70bcb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f428 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143119.531487:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861155584:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143119.531515:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.537895:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:2.0:1746143119.538010:0:10061:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143117 -> 1746143118 00002000:00010000:2.0:1746143119.538014:0:10061:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143117 -> 1746143118 00002000:00010000:2.0:1746143119.538016:0:10061:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143117 -> 1746143118 00000100:00100000:2.0:1746143119.538057:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861155584:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143119.538088:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5463c00/0x25aee876ca70bcb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f428 expref: 25 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.538102:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5463c00/0x25aee876ca70bcb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f428 expref: 25 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.538116:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5463c00, rc 0) 00000100:00100000:2.0:1746143119.538155:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858414720:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6989us (7037us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.538163:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11785 00000100:00100000:1.0:1746143119.538294:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861155456:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143119.538309:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143119.538331:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858414336:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7639us (9005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.538338:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6222 00000100:00100000:3.0:1746143119.538649:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858414976 00000100:00100000:3.0:1746143119.538656:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858414976 00002000:00100000:3.0:1746143119.538687:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3149824->3153919) req@ffff88009535ea00 x1830962858414976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.538697:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ea00 with x1830962858414976 ext(3149824->3153919) 00002000:00010000:3.0:1746143119.538701:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535ea00 00000100:00100000:3.0:1746143119.538716:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5720 00000100:00100000:3.0:1746143119.538723:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858414976:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143119.538849:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858414976:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 126us (962us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143119.538855:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5720 00002000:00100000:3.0:1746143119.538859:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3149824->3153919) req@ffff88009535ea00 x1830962858414976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.538865:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ea00 with x1830962858414976 ext(3149824->3153919) 00002000:00010000:3.0:1746143119.538868:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535ea00 00000100:00100000:0.0:1746143119.552250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.552320:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858415232 00000100:00100000:2.0:1746143119.552329:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858415232 00002000:00100000:2.0:1746143119.552370:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009535e300 x1830962858415232/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.552380:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535e300 with x1830962858415232 ext(1048576->2097151) 00002000:00010000:2.0:1746143119.552385:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535e300 00000100:00100000:2.0:1746143119.552844:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5721 00000100:00100000:2.0:1746143119.552853:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858415232:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.554135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.554169:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858415360 00000100:00100000:0.0:1746143119.554174:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858415360 00000100:00100000:0.0:1746143119.556441:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11786 00000100:00100000:0.0:1746143119.556467:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30672:x1830962858415360:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143119.556481:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143119.556498:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f42f expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.556521:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 28 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.556527:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143119.556529:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143119.556531:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 17 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.556558:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 28 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.556568:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 28 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143119.556579:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861155712:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143119.557643:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.566273:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861155712:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.566300:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 17 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.566317:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a43c00, rc 0) 00000100:00100000:2.0:1746143119.567221:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30672:x1830962858415360:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10768us (13084us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.567230:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11786 00000100:00100000:0.0:1746143119.568298:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.568407:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858415488 00000100:00100000:3.0:1746143119.568414:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858415488 00002000:00100000:3.0:1746143119.568447:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2330624->3129343) req@ffff88009535f480 x1830962858415488/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.568467:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535f480 with x1830962858415488 ext(2330624->3129343) 00010000:00010000:3.0:1746143119.568474:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 29 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.568486:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 29 pid: 4758 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143119.568497:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009535f480 00000100:00100000:3.0:1746143119.568515:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1896 00000100:00100000:3.0:1746143119.568522:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858415488:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143119.573403:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858415232:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20542us (21150us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143119.573416:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5721 00002000:00100000:2.0:1746143119.573428:0:11337:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009535e300 x1830962858415232/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.573437:0:11337:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535e300 with x1830962858415232 ext(1048576->2097151) 00002000:00010000:2.0:1746143119.573443:0:11337:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535e300 00000100:00100000:3.0:1746143119.590323:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858415488:12345-192.168.201.28@tcp:4:cat.0 Request processed in 21793us (22017us total) trans 21474839910 rc 0/0 00000100:00100000:3.0:1746143119.590334:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1896 00002000:00100000:3.0:1746143119.591244:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2330624->3129343) req@ffff88009535f480 x1830962858415488/t21474839910(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/448 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.591253:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535f480 with x1830962858415488 ext(2330624->3129343) 00010000:00010000:3.0:1746143119.591263:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 29 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.591276:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 29 pid: 4758 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143119.591283:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009535f480 00000100:00100000:0.0:1746143119.591493:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.591745:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858415616 00000100:00100000:2.0:1746143119.591754:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858415616 00000100:00100000:2.0:1746143119.591907:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11787 00000100:00100000:2.0:1746143119.591918:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30674:x1830962858415616:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.591933:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.591949:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f436 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.591974:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143119.591980:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 30 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.591997:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 30 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.592007:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a42400, rc 0) 00000100:00100000:2.0:1746143119.593140:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30674:x1830962858415616:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1223us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.593145:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11787 00000100:00100000:0.0:1746143119.595541:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.595869:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858415744 00000100:00100000:1.0:1746143119.595877:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858415744 00010000:00010000:1.0:1746143119.595905:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143119.595938:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6223 00000100:00100000:1.0:1746143119.595944:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858415744:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143119.595954:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143119.595969:0:4759:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143117 -> 1746143118 00010000:00010000:1.0:1746143119.595973:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.595983:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.596002:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3fee00/0x25aee876ca70bc87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2330624->3145727] (req 2330624->3129343) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3f7 expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.596052:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.596054:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.596060:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.596067:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.596074:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.596075:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143119.596079:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 29 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.596085:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 29 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143119.596111:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 29 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143119.596121:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861155840:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143119.596185:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143119.596192:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861155968:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143119.596205:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b9869c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.604182:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861155840:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143119.604192:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861155968:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143119.604214:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143119.604251:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858415744:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8307us (8717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.604261:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6223 00000100:00100000:0.0:1746143119.611320:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.611414:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858416000 00000100:00100000:3.0:1746143119.611423:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858416000 00002000:00100000:3.0:1746143119.611473:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009535d880 x1830962858416000/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.611483:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535d880 with x1830962858416000 ext(2097152->3145727) 00002000:00010000:3.0:1746143119.611487:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535d880 00000100:00100000:3.0:1746143119.611557:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5722 00000100:00100000:3.0:1746143119.611564:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858416000:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143119.620698:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.620740:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.620765:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.620795:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.621019:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858416512 00000100:00100000:2.0:1746143119.621026:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858416512 00002000:00100000:2.0:1746143119.621082:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3932160->4194303) req@ffff880094425500 x1830962858416512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.621090:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425500 with x1830962858416512 ext(3932160->4194303) 00002000:00010000:2.0:1746143119.621095:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094425500 00000100:00100000:2.0:1746143119.621110:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858416384 00000100:00100000:2.0:1746143119.621113:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858416384 00002000:00100000:2.0:1746143119.621124:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3932159) req@ffff880094426d80 x1830962858416384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 504/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.621130:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094426d80 with x1830962858416384 ext(2097152->3932159) 00002000:00010000:2.0:1746143119.621132:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094426d80 00000100:00100000:2.0:1746143119.621138:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858416768 00000100:00100000:2.0:1746143119.621140:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858416768 00002000:00100000:2.0:1746143119.621150:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094424000 x1830962858416768/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.621156:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094424000 with x1830962858416768 ext(2097152->3145727) 00002000:00010000:2.0:1746143119.621158:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094424000 00000100:00100000:0.0:1746143119.622857:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858416896 00000100:00100000:0.0:1746143119.622865:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858416896 00002000:00100000:0.0:1746143119.622902:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3153920->4194303) req@ffff880094424700 x1830962858416896/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143119.622911:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094424700 with x1830962858416896 ext(3153920->4194303) 00002000:00010000:0.0:1746143119.622917:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094424700 00000100:00100000:0.0:1746143119.622944:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5723 00000100:00100000:0.0:1746143119.622955:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858416512:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.623532:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5724 00000100:00100000:0.0:1746143119.623541:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858416384:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143119.625736:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5725 00000100:00100000:3.0:1746143119.625748:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858416768:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143119.627438:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5726 00000100:00100000:3.0:1746143119.627449:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858416896:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.640417:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858416512:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17456us (19719us total) trans 0 rc 262144/262144 00000100:00100000:0.0:1746143119.640428:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5723 00002000:00100000:0.0:1746143119.640438:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3932160->4194303) req@ffff880094425500 x1830962858416512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 262144/262144 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143119.640447:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425500 with x1830962858416512 ext(3932160->4194303) 00002000:00010000:0.0:1746143119.640463:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094425500 00000100:00100000:3.0:1746143119.643403:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858416000:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31829us (32079us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.643414:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5722 00002000:00100000:3.0:1746143119.643427:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009535d880 x1830962858416000/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.643436:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535d880 with x1830962858416000 ext(2097152->3145727) 00002000:00010000:3.0:1746143119.643441:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535d880 00000100:00100000:1.0:1746143119.648247:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858416384:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24695us (27493us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143119.648261:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5724 00002000:00100000:1.0:1746143119.648275:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3932159) req@ffff880094426d80 x1830962858416384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 504/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.648284:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094426d80 with x1830962858416384 ext(2097152->3932159) 00002000:00010000:1.0:1746143119.648289:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094426d80 00000100:00100000:3.0:1746143119.658692:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858416768:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32937us (37916us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.658704:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5725 00002000:00100000:3.0:1746143119.658716:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094424000 x1830962858416768/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.658726:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094424000 with x1830962858416768 ext(2097152->3145727) 00002000:00010000:3.0:1746143119.658731:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094424000 00000100:00100000:0.0:1746143119.659727:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.660221:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858416896:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32771us (39421us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746143119.660230:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5726 00002000:00100000:3.0:1746143119.660238:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3153920->4194303) req@ffff880094424700 x1830962858416896/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.660247:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094424700 with x1830962858416896 ext(3153920->4194303) 00002000:00010000:3.0:1746143119.660251:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094424700 00000100:00100000:2.0:1746143119.660366:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858417152 00000100:00100000:2.0:1746143119.660376:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858417152 00000100:00100000:2.0:1746143119.660626:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11788 00000100:00100000:2.0:1746143119.660637:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30674:x1830962858417152:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.660653:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.660673:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f43d expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.660703:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.660711:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143119.660713:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143119.660717:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 25 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.660754:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.660981:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 23 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.660994:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861156096:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.661115:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.673422:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.673619:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.673659:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858417408 00000100:00100000:0.0:1746143119.673667:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858417408 00002000:00100000:0.0:1746143119.673708:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5193727) req@ffff88009535c700 x1830962858417408/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143119.673718:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535c700 with x1830962858417408 ext(4194304->5193727) 00002000:00010000:0.0:1746143119.673723:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535c700 00000100:00100000:0.0:1746143119.673751:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858417536 00000100:00100000:0.0:1746143119.673755:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858417536 00002000:00100000:0.0:1746143119.673768:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2359296->3145727) req@ffff8800942c4e00 x1830962858417536/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143119.673781:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4e00 with x1830962858417536 ext(2359296->3145727) 00010000:00010000:0.0:1746143119.673789:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 24 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.673802:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 24 pid: 4758 timeout: 1001 lvb_type: 0 00002000:00010000:0.0:1746143119.673809:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c4e00 00000100:00100000:0.0:1746143119.674060:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1897 00000100:00100000:0.0:1746143119.674071:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858417536:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143119.674991:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5727 00000100:00100000:0.0:1746143119.674998:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858417408:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143119.675747:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861156096:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.675779:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 25 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.675794:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a6da00, rc 0) 00000100:00100000:2.0:1746143119.675840:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30674:x1830962858417152:12345-192.168.201.28@tcp:101:cat.0 Request processed in 15204us (16112us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.675848:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11788 00000100:00100000:2.0:1746143119.689734:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.690054:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858417664 00000100:00100000:3.0:1746143119.690063:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858417664 00000100:00100000:3.0:1746143119.690112:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11789 00000100:00100000:3.0:1746143119.690119:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30672:x1830962858417664:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143119.690136:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.690150:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f444 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.690174:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143119.690179:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 27 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.690189:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 27 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.690200:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7b000, rc 0) 00000100:00100000:3.0:1746143119.690238:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:30672:x1830962858417664:12345-192.168.201.28@tcp:101:cat.0 Request processed in 120us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.690244:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11789 00000100:00100000:2.0:1746143119.698024:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858417408:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23015us (24602us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746143119.698063:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5727 00002000:00100000:2.0:1746143119.698076:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5193727) req@ffff88009535c700 x1830962858417408/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.698085:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535c700 with x1830962858417408 ext(4194304->5193727) 00002000:00010000:2.0:1746143119.698091:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535c700 00000100:00100000:0.0:1746143119.704940:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858417536:12345-192.168.201.28@tcp:4:cat.0 Request processed in 30859us (31309us total) trans 17179872661 rc 0/0 00000100:00100000:0.0:1746143119.704954:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1897 00002000:00100000:0.0:1746143119.704967:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2359296->3145727) req@ffff8800942c4e00 x1830962858417536/t17179872661(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/448 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143119.704976:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4e00 with x1830962858417536 ext(2359296->3145727) 00010000:00010000:0.0:1746143119.704987:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.705002:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00002000:00010000:0.0:1746143119.705015:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c4e00 00000100:00100000:0.0:1746143119.711193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.711345:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858417792 00000100:00100000:2.0:1746143119.711357:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858417792 00010000:00010000:2.0:1746143119.711400:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.711437:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6224 00000100:00100000:2.0:1746143119.711447:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858417792:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143119.711476:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143119.711501:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.711515:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.711538:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3ff400/0x25aee876ca70bc9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2359296->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f40c expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.713188:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.713192:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.713201:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 24 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.713211:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 24 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.713221:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.713223:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.713227:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 26 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.713237:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 26 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.713279:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 26 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.713294:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861156224:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143119.714405:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 24 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.714607:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861156352:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143119.714644:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.718090:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861156352:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143119.721960:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.722539:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861156224:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143119.722560:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143119.722600:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858417792:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11156us (11418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.722610:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6224 00000100:00100000:1.0:1746143119.726357:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858418048 00000100:00100000:1.0:1746143119.726369:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858418048 00002000:00100000:1.0:1746143119.726415:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800942c6a00 x1830962858418048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.726431:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6a00 with x1830962858418048 ext(2097152->3145727) 00002000:00010000:1.0:1746143119.726436:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c6a00 00000100:00100000:1.0:1746143119.726477:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5728 00000100:00100000:1.0:1746143119.726485:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858418048:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.729866:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.729944:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858418304 00000100:00100000:2.0:1746143119.729951:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858418304 00002000:00100000:2.0:1746143119.729985:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800942c4380 x1830962858418304/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.729996:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4380 with x1830962858418304 ext(2097152->3145727) 00002000:00010000:2.0:1746143119.730001:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c4380 00000100:00100000:2.0:1746143119.730058:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5729 00000100:00100000:2.0:1746143119.730067:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858418304:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.734150:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.735247:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858418432 00000100:00100000:3.0:1746143119.735259:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858418432 00002000:00100000:3.0:1746143119.735306:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800942c6680 x1830962858418432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.735316:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6680 with x1830962858418432 ext(3145728->4194303) 00002000:00010000:3.0:1746143119.735323:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c6680 00000100:00100000:3.0:1746143119.736743:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5730 00000100:00100000:3.0:1746143119.736757:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858418432:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143119.746190:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858418048:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19697us (24229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143119.746203:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5728 00002000:00100000:1.0:1746143119.746214:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800942c6a00 x1830962858418048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.746223:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6a00 with x1830962858418048 ext(2097152->3145727) 00002000:00010000:1.0:1746143119.746227:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c6a00 00000100:00100000:0.0:1746143119.759023:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.759155:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858418688 00000100:00100000:2.0:1746143119.759164:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858418688 00000100:00100000:2.0:1746143119.759214:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11790 00000100:00100000:2.0:1746143119.759226:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30674:x1830962858418688:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.759243:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.759259:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f44b expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.759290:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.759297:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143119.759299:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143119.759303:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.759332:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.759343:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 16 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.759354:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861156480:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.759610:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.764218:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858418304:12345-192.168.201.28@tcp:3:cat.0 Request processed in 34140us (34352us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143119.764231:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5729 00002000:00100000:2.0:1746143119.764245:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800942c4380 x1830962858418304/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.764254:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4380 with x1830962858418304 ext(2097152->3145727) 00002000:00010000:2.0:1746143119.764260:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c4380 00000100:00100000:3.0:1746143119.764802:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858418432:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28044us (30656us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.764809:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5730 00002000:00100000:3.0:1746143119.764817:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800942c6680 x1830962858418432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.764824:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6680 with x1830962858418432 ext(3145728->4194303) 00002000:00010000:3.0:1746143119.764828:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c6680 00000100:00100000:0.0:1746143119.771507:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.771720:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861156480:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.771747:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.771764:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009494a800, rc 0) 00000100:00100000:2.0:1746143119.771812:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30674:x1830962858418688:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12590us (12796us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.771821:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11790 00000100:00100000:3.0:1746143119.772154:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858418816 00000100:00100000:3.0:1746143119.772161:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858418816 00002000:00100000:3.0:1746143119.772197:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3153919) req@ffff8800942c4000 x1830962858418816/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 8680/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.772206:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4000 with x1830962858418816 ext(3145728->3153919) 00010000:00010000:3.0:1746143119.772215:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.772230:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 17 pid: 4758 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143119.772238:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c4000 00000100:00100000:3.0:1746143119.772278:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1898 00000100:00100000:3.0:1746143119.772288:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858418816:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143119.772967:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858418816:12345-192.168.201.28@tcp:4:cat.0 Request processed in 679us (1464us total) trans 21474839911 rc 0/0 00000100:00100000:3.0:1746143119.772975:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1898 00002000:00100000:3.0:1746143119.772983:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3153919) req@ffff8800942c4000 x1830962858418816/t21474839911(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 8680/448 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.772990:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4000 with x1830962858418816 ext(3145728->3153919) 00010000:00010000:3.0:1746143119.772996:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 19 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.773007:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 19 pid: 4758 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143119.773013:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c4000 00000100:00100000:0.0:1746143119.777118:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.777235:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858418944 00000100:00100000:2.0:1746143119.777243:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858418944 00000100:00100000:2.0:1746143119.777285:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11791 00000100:00100000:2.0:1746143119.777292:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30672:x1830962858418944:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.777307:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.777322:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f452 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.777343:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143119.777347:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 20 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.777361:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 20 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.777371:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009494a400, rc 0) 00000100:00100000:2.0:1746143119.777406:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30672:x1830962858418944:12345-192.168.201.28@tcp:101:cat.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.777411:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11791 00000100:00100000:0.0:1746143119.785023:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.785429:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858419072 00000100:00100000:2.0:1746143119.785441:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858419072 00010000:00010000:2.0:1746143119.785480:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 20 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.785503:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6225 00000100:00100000:2.0:1746143119.785510:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858419072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143119.785523:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143119.785545:0:4759:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143117 -> 1746143118 00010000:00010000:2.0:1746143119.785551:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 20 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.785563:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 20 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.785584:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3ff000/0x25aee876ca70bca3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [3145728->5193727] (req 3145728->3153919) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f413 expref: 20 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143119.787049:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.787052:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.787060:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.787070:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.787078:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.787083:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.787085:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.787092:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.787124:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.787136:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861156608:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143119.788404:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.788419:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861156736:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143119.789632:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.799657:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.799710:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.799753:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.800074:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858419584 00000100:00100000:2.0:1746143119.800083:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858419584 00002000:00100000:2.0:1746143119.800133:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094427b80 x1830962858419584/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.800144:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427b80 with x1830962858419584 ext(3145728->4194303) 00002000:00010000:2.0:1746143119.800149:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094427b80 00000100:00100000:2.0:1746143119.800169:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858419840 00000100:00100000:2.0:1746143119.800173:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858419840 00002000:00100000:2.0:1746143119.800190:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094427480 x1830962858419840/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.800197:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427480 with x1830962858419840 ext(3145728->4194303) 00002000:00010000:2.0:1746143119.800201:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094427480 00000100:00100000:2.0:1746143119.800214:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858419712 00000100:00100000:2.0:1746143119.800217:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858419712 00002000:00100000:2.0:1746143119.800233:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094427100 x1830962858419712/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.800239:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427100 with x1830962858419712 ext(3145728->4194303) 00002000:00010000:2.0:1746143119.800242:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094427100 00000100:00100000:2.0:1746143119.800257:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5731 00000100:00100000:2.0:1746143119.800276:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5732 00000100:00100000:2.0:1746143119.800283:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858419840:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143119.802168:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861156608:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143119.802184:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861156736:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143119.802206:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143119.802260:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858419072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 16748us (17243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.802270:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6225 00000100:00100000:1.0:1746143119.802401:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5733 00000100:00100000:1.0:1746143119.802414:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858419712:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143119.804695:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858419584:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.835246:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.836173:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858419968 00000100:00100000:3.0:1746143119.836181:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858419968 00000100:00100000:3.0:1746143119.836322:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11792 00000100:00100000:3.0:1746143119.836329:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:30679:x1830962858419968:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143119.836348:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.836364:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f459 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.836390:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.836397:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 5 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.836404:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.836409:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143119.836410:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143119.836414:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [249856->491519] (req 249856->491519) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 22 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.836630:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.836640:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 22 pid: 8450 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143119.836653:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861156864:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143119.837079:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 5 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.837091:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 5 pid: 8449 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143119.837098:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861156992:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143119.837143:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.837151:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 31 pid: 20836 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.837157:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861157120:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143119.837802:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.838763:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.838804:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858420096 00000100:00100000:2.0:1746143119.838810:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858420096 00000100:00100000:2.0:1746143119.838841:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11793 00000100:00100000:2.0:1746143119.838850:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:30675:x1830962858420096:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143119.838861:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.838872:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f460 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.838892:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.838899:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 33 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.838904:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.838905:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.838908:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 33 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.838929:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 33 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.838937:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 33 pid: 8450 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143119.838946:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094427800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861157248:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.839017:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.839025:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 22 pid: 8450 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.839056:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861157376:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.839085:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143119.839359:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1971:x1830962858419584:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39093us (39711us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143119.839368:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5731 00002000:00100000:3.0:1746143119.839376:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094427b80 x1830962858419584/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.839383:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427b80 with x1830962858419584 ext(3145728->4194303) 00002000:00010000:3.0:1746143119.839387:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094427b80 00000100:00100000:0.0:1746143119.844839:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.844865:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.844885:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858420224 00000100:00100000:0.0:1746143119.844896:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858420224 00010000:00010000:0.0:1746143119.844922:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 6 pid: 8449 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746143119.844940:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858420480 00000100:00100000:0.0:1746143119.844942:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858420480 00010000:00010000:0.0:1746143119.844948:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 32 pid: 20836 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143119.844959:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6226 00000100:00100000:0.0:1746143119.844965:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858420224:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143119.844975:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143119.844990:0:9869:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1939 -> 2001 00010000:00010000:0.0:1746143119.844995:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 6 pid: 8449 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746143119.845004:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 6 pid: 8449 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746143119.845023:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143119.845086:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858420224:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143119.845093:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6226 00000100:00100000:0.0:1746143119.845106:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6227 00000100:00100000:0.0:1746143119.845111:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858420480:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143119.845117:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143119.845125:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 32 pid: 20836 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.845133:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 32 pid: 20836 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.845144:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143119.845158:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858420480:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 47us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143119.845162:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6227 00000100:00100000:0.0:1746143119.845213:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.845228:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858420352 00000100:00100000:0.0:1746143119.845232:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858420352 00010000:00010000:0.0:1746143119.845244:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 23 pid: 8450 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746143119.845259:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6228 00000100:00100000:0.0:1746143119.845263:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858420352:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143119.845269:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143119.845276:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 23 pid: 8450 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746143119.845284:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 23 pid: 8450 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746143119.845294:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143119.845296:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143119.845302:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 23 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.845309:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 23 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.845336:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 23 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143119.845346:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861157504:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143119.845399:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909780 going to sleep for 11 seconds 00010000:00010000:3.0:1746143119.845729:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c475200/0x25aee876ca70b7fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f031 expref: 23 pid: 8450 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143119.845745:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861156864:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143119.845754:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c474a00/0x25aee876ca70b80b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f04d expref: 5 pid: 8449 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143119.845762:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861156992:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143119.845771:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c474600/0x25aee876ca70b7be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f015 expref: 31 pid: 20836 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.845778:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861157120:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143119.845801:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 22 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.845810:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8a00, rc 0) 00000100:00100000:3.0:1746143119.845831:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:30679:x1830962858419968:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9504us (10595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.845838:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11792 00000100:00100000:1.0:1746143119.846173:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858419712:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43764us (46421us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143119.846181:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5733 00002000:00100000:1.0:1746143119.846189:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094427100 x1830962858419712/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.846196:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427100 with x1830962858419712 ext(3145728->4194303) 00002000:00010000:1.0:1746143119.846207:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094427100 00000100:00100000:1.0:1746143119.851190:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.851358:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858420608 00000100:00100000:3.0:1746143119.851366:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858420608 00010000:00010000:3.0:1746143119.851397:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 20 pid: 8450 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.851425:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6229 00000100:00100000:3.0:1746143119.851431:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858420608:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143119.851467:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143119.851486:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 20 pid: 8450 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.851501:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 20 pid: 8450 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.851523:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143119.851710:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094427800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861157248:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.851727:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed000/0x25aee876ca70bc56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3c6 expref: 20 pid: 8450 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.851747:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861157376:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.851780:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143119.851790:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858420608:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 357us (607us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143119.851795:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff27c00, rc 0) 00000100:00100000:3.0:1746143119.851796:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6229 00000100:00100000:2.0:1746143119.852131:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30675:x1830962858420096:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 13280us (13367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.852138:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11793 00000100:00100000:2.0:1746143119.852428:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858419840:12345-192.168.201.28@tcp:3:cat.0 Request processed in 52147us (52719us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143119.852436:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5732 00002000:00100000:2.0:1746143119.852445:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094427480 x1830962858419840/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143119.852468:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427480 with x1830962858419840 ext(3145728->4194303) 00002000:00010000:2.0:1746143119.852473:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094427480 00000100:00100000:1.0:1746143119.856224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.856581:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.856731:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861157504:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143119.856753:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143119.856799:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858420352:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11534us (11585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.856810:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6228 00000100:00100000:2.0:1746143119.856837:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858420736 00000100:00100000:2.0:1746143119.856843:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858420736 00010000:00010000:2.0:1746143119.856871:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 30 pid: 8450 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143119.856894:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6230 00000100:00100000:2.0:1746143119.856900:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858420736:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143119.856913:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143119.856937:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 30 pid: 8450 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143119.856949:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 30 pid: 8450 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143119.856973:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c1ed200/0x25aee876ca70bc72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3db expref: 30 pid: 8450 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143119.856986:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.856988:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143119.856995:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.857003:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.857058:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 29 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.857071:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861157632:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143119.857414:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858420992 00000100:00100000:3.0:1746143119.857419:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858420992 00002000:00100000:3.0:1746143119.857459:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (249856->253951) req@ffff88009ae2fb80 x1830962858420992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.857468:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2fb80 with x1830962858420992 ext(249856->253951) 00002000:00010000:3.0:1746143119.857472:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2fb80 00000100:00100000:3.0:1746143119.857487:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5734 00000100:00100000:3.0:1746143119.857493:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858420992:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143119.857652:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858420992:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 158us (1070us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143119.857657:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5734 00002000:00100000:3.0:1746143119.857662:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (249856->253951) req@ffff88009ae2fb80 x1830962858420992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.857672:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2fb80 with x1830962858420992 ext(249856->253951) 00002000:00010000:3.0:1746143119.857675:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2fb80 00000100:00100000:2.0:1746143119.857972:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.860589:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.860810:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858421120 00000100:00100000:2.0:1746143119.860818:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858421120 00000100:00100000:2.0:1746143119.861107:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11794 00000100:00100000:2.0:1746143119.861116:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858421120:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143119.861136:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.861156:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff26400/0x25aee876ca70bcf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f467 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143119.861212:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094427800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861157760:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143119.862574:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.862764:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.863416:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858421248 00000100:00100000:3.0:1746143119.863422:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858421248 00000100:00100000:3.0:1746143119.863458:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858421376 00000100:00100000:3.0:1746143119.863460:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858421376 00000100:00100000:3.0:1746143119.863481:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11795 00000100:00100000:3.0:1746143119.863487:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858421248:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143119.863502:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.863515:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b2734600/0x25aee876ca70bcfe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f46e expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143119.863553:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861157888:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143119.863668:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861157632:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143119.863682:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143119.864705:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11796 00000100:00100000:1.0:1746143119.864717:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858421376:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143119.864727:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143119.864736:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dbea00/0x25aee876ca70bd05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f475 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143119.864762:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861158016:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143119.865092:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.865141:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858420736:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8240us (8927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.865151:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6230 00000100:00100000:2.0:1746143119.865204:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143119.865800:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.866012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.866253:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143119.867808:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858421632 00000100:00100000:3.0:1746143119.867818:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858421632 00002000:00100000:3.0:1746143119.867860:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1904640->1908735) req@ffff880094425f80 x1830962858421632/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.867871:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425f80 with x1830962858421632 ext(1904640->1908735) 00002000:00010000:3.0:1746143119.867876:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094425f80 00000100:00100000:3.0:1746143119.867892:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858421888 00000100:00100000:3.0:1746143119.867894:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858421888 00002000:00100000:3.0:1746143119.867906:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (487424->491519) req@ffff880094424a80 x1830962858421888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.867913:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094424a80 with x1830962858421888 ext(487424->491519) 00002000:00010000:3.0:1746143119.867916:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094424a80 00000100:00100000:3.0:1746143119.867943:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5735 00000100:00100000:3.0:1746143119.867949:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858421632:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143119.868164:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858421632:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 213us (2363us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143119.868172:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5735 00002000:00100000:3.0:1746143119.868177:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1904640->1908735) req@ffff880094425f80 x1830962858421632/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.868185:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425f80 with x1830962858421632 ext(1904640->1908735) 00002000:00010000:3.0:1746143119.868188:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094425f80 00000100:00100000:3.0:1746143119.868201:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5736 00000100:00100000:3.0:1746143119.868206:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858421888:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143119.868272:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858421888:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 65us (2260us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143119.868278:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5736 00002000:00100000:3.0:1746143119.868282:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (487424->491519) req@ffff880094424a80 x1830962858421888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.868289:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094424a80 with x1830962858421888 ext(487424->491519) 00002000:00010000:3.0:1746143119.868292:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094424a80 00002000:00010000:1.0:1746143119.869464:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143117 -> 1746143118 00002000:00010000:1.0:1746143119.869470:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143117 -> 1746143118 00002000:00010000:1.0:1746143119.869472:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143117 -> 1746143118 00000100:00100000:1.0:1746143119.869485:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861158016:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143119.869517:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dbea00/0x25aee876ca70bd05 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f475 expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143119.869530:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dbea00/0x25aee876ca70bd05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f475 expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143119.869545:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbea00, rc 0) 00000100:00100000:1.0:1746143119.869573:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858421376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4860us (6809us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143119.869579:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11796 00002000:00010000:2.0:1746143119.869940:0:8448:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143115 -> 1746143118 00002000:00010000:2.0:1746143119.869943:0:8448:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143115 -> 1746143118 00002000:00010000:2.0:1746143119.869945:0:8448:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143115 -> 1746143118 00000100:00100000:2.0:1746143119.869954:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094427800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861157760:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143119.869973:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff26400/0x25aee876ca70bcf7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f467 expref: 32 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.869982:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff26400/0x25aee876ca70bcf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f467 expref: 32 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.869993:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff26400, rc 0) 00000100:00100000:2.0:1746143119.870013:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858421120:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8899us (9434us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.870018:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11794 00000100:00100000:2.0:1746143119.870081:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861157888:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143119.870097:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b2734600/0x25aee876ca70bcfe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f46e expref: 30 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.870105:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b2734600/0x25aee876ca70bcfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f46e expref: 30 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.870113:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2734600, rc 0) 00000100:00100000:2.0:1746143119.870136:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858421248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6644us (7563us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.870141:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11795 00000100:00100000:0.0:1746143119.877252:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.877541:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143119.877613:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858422016 00000100:00100000:2.0:1746143119.877622:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858422016 00000100:00100000:2.0:1746143119.877667:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11797 00000100:00100000:2.0:1746143119.877677:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30675:x1830962858422016:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143119.877695:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143119.877713:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f47c expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.877748:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.877757:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.877764:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 17 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.877770:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 30 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.877777:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143119.877779:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143119.877782:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 7/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->2924543] (req 2097152->2924543) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.877813:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 30 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.877825:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 30 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.877843:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094427800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861158144:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.877940:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 17 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.877960:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 17 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.877969:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861158272:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.877996:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.878003:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.878011:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861158400:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.878054:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.878062:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 30 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.878070:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861158528:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.878094:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143119.878695:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858422272 00000100:00100000:3.0:1746143119.878700:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858422272 00002000:00100000:3.0:1746143119.878729:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff8800942c6300 x1830962858422272/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143119.878737:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6300 with x1830962858422272 ext(4194304->5206015) 00010000:00010000:3.0:1746143119.878743:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 18 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.878752:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 18 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143119.878758:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c6300 00000100:00100000:3.0:1746143119.878784:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1899 00000100:00100000:3.0:1746143119.878790:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858422272:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143119.881524:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.883780:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858422528 00000100:00100000:1.0:1746143119.883801:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858422528 00002000:00100000:1.0:1746143119.884102:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5193727) req@ffff8800942c4700 x1830962858422528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.884118:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4700 with x1830962858422528 ext(4194304->5193727) 00010000:00010000:1.0:1746143119.884128:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 31 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.884151:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 31 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746143119.884158:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c4700 00000100:00100000:1.0:1746143119.884195:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1900 00000100:00100000:1.0:1746143119.884210:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1970:x1830962858422528:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143119.896285:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.896387:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.896486:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858422656 00000100:00100000:0.0:1746143119.896496:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858422656 00010000:00010000:0.0:1746143119.896550:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 33 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143119.896579:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858422784 00000100:00100000:0.0:1746143119.896581:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858422784 00010000:00010000:0.0:1746143119.896598:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 20 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143119.896615:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6231 00000100:00100000:0.0:1746143119.896631:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858422656:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143119.896646:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143119.896675:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 33 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.896687:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 33 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.896719:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143119.896817:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6232 00000100:00100000:3.0:1746143119.896832:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858422784:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143119.896839:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143119.896850:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 20 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.896858:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 20 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.896879:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143119.897142:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a42400/0x25aee876ca70bcc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f436 expref: 33 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.897167:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094427800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861158144:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.897180:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a43c00/0x25aee876ca70bcbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f42f expref: 20 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143119.897194:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861158272:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.897204:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861158400:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143119.897220:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861158528:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143119.897263:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->2924543] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143119.897280:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff27600, rc 0) 00000100:00100000:0.0:1746143119.902052:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858422656:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5387us (5735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143119.902069:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6231 00000100:00100000:3.0:1746143119.903503:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858422784:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6666us (7103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.903515:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6232 00000100:00100000:2.0:1746143119.903730:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:30675:x1830962858422016:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 26048us (26483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143119.903739:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11797 00000100:00100000:0.0:1746143119.912287:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858422272:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33477us (34726us total) trans 0 rc 1011712/1011712 00000100:00100000:0.0:1746143119.912303:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1899 00002000:00100000:0.0:1746143119.912323:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff8800942c6300 x1830962858422272/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 1011712/1011712 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143119.912334:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6300 with x1830962858422272 ext(4194304->5206015) 00010000:00010000:0.0:1746143119.912352:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.912368:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00010000:0.0:1746143119.912608:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c6300 00000100:00100000:1.0:1746143119.912729:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858422528:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28524us (31214us total) trans 0 rc 999424/999424 00000100:00100000:1.0:1746143119.912737:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1900 00002000:00100000:1.0:1746143119.912752:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5193727) req@ffff8800942c4700 x1830962858422528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/440 e 0 to 0 dl 1746143130 ref 1 fl Complete:H/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.912760:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4700 with x1830962858422528 ext(4194304->5193727) 00010000:00010000:1.0:1746143119.912766:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143119.912961:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746143119.912975:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c4700 00000100:00100000:0.0:1746143119.922656:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.922711:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.922750:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.923420:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.923874:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858422912 00000100:00100000:3.0:1746143119.923884:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858422912 00000100:00100000:3.0:1746143119.923937:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858423040 00000100:00100000:3.0:1746143119.923940:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858423040 00000100:00100000:3.0:1746143119.923957:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858423296 00000100:00100000:3.0:1746143119.923959:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858423296 00000100:00100000:3.0:1746143119.923975:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858423168 00000100:00100000:3.0:1746143119.923977:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858423168 00000100:00100000:3.0:1746143119.924004:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11798 00000100:00100000:3.0:1746143119.924013:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858422912:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143119.924049:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.924072:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8800/0x25aee876ca70bd13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f483 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143119.924143:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861158656:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143119.924235:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143119.924266:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11799 00000100:00100000:3.0:1746143119.924274:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858423040:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143119.924281:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.924289:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8400/0x25aee876ca70bd1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f48a expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.924310:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143119.924320:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8400/0x25aee876ca70bd1a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f48a expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.924337:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8400/0x25aee876ca70bd1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f48a expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.924351:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8400, rc 0) 00000100:00100000:3.0:1746143119.924380:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858423040:12345-192.168.201.28@tcp:101:cat.0 Request processed in 107us (1669us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143119.924394:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11799 00000100:00100000:3.0:1746143119.924410:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11800 00000100:00100000:3.0:1746143119.924422:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858423296:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143119.924433:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.924439:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9e00/0x25aee876ca70bd21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f498 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.924469:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143119.924475:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9e00/0x25aee876ca70bd21 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f498 expref: 31 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.924483:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9e00/0x25aee876ca70bd21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f498 expref: 31 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143119.924499:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf9e00, rc 0) 00000100:00100000:3.0:1746143119.924527:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858423296:12345-192.168.201.28@tcp:101:cat.0 Request processed in 96us (1767us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143119.924534:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11800 00000100:00100000:3.0:1746143119.924545:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11801 00000100:00100000:3.0:1746143119.924550:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858423168:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143119.924563:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.924570:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bd28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f491 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143119.924599:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861158784:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143119.924633:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.929115:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.929420:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861158784:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143119.929480:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bd28 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f491 expref: 30 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143119.929496:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bd28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f491 expref: 30 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143119.929543:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8600, rc 0) 00000100:00100000:0.0:1746143119.929588:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858423168:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5037us (6167us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143119.929598:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11801 00000100:00100000:2.0:1746143119.929921:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861158656:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143119.929938:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8800/0x25aee876ca70bd13 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f483 expref: 18 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.929948:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8800/0x25aee876ca70bd13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f483 expref: 18 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.929971:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8800, rc 0) 00000100:00100000:2.0:1746143119.929990:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858422912:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5979us (7348us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.929996:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11798 00000100:00100000:3.0:1746143119.930244:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858423424 00000100:00100000:3.0:1746143119.930251:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858423424 00010000:00010000:3.0:1746143119.930284:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.930813:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6233 00000100:00100000:3.0:1746143119.930821:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858423424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143119.930841:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143119.930855:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.930871:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.930895:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009494a800/0x25aee876ca70bcdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f44b expref: 29 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143119.930909:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143119.936190:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.936362:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.936400:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858423680 00000100:00100000:0.0:1746143119.936409:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858423680 00000100:00100000:0.0:1746143119.936465:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858423552 00000100:00100000:0.0:1746143119.936467:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858423552 00000100:00100000:0.0:1746143119.936487:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11802 00000100:00100000:0.0:1746143119.936495:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858423680:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143119.936522:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143119.936548:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70bd2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4a6 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.936581:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143119.936599:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70bd2f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4a6 expref: 31 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143119.936611:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70bd2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4a6 expref: 31 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143119.936629:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf9800, rc 0) 00000100:00100000:0.0:1746143119.936686:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858423680:12345-192.168.201.28@tcp:101:cat.0 Request processed in 185us (501us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143119.936693:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11802 00000100:00100000:0.0:1746143119.936716:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11803 00000100:00100000:0.0:1746143119.936722:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858423552:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143119.936737:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143119.936744:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8c00/0x25aee876ca70bd36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f49f expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143119.936795:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861158912:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143119.937080:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.937131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.937158:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858423808 00000100:00100000:0.0:1746143119.937162:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858423808 00010000:00010000:0.0:1746143119.937184:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143119.937214:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6234 00000100:00100000:0.0:1746143119.937220:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858423808:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143119.937235:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143119.937264:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.937276:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.937300:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009494a400/0x25aee876ca70bce2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f452 expref: 17 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143119.937311:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143119.937313:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143119.937320:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.937334:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.937356:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143119.937371:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861159040:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143119.937402:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.937459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.937481:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858423936 00000100:00100000:0.0:1746143119.937485:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858423936 00000100:00100000:0.0:1746143119.937505:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11804 00000100:00100000:0.0:1746143119.937510:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858423936:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143119.937526:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143119.937534:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094444000/0x25aee876ca70bd3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4ad expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143119.937562:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861159168:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143119.937583:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143119.937662:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143119.937676:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858424064 00000100:00100000:0.0:1746143119.937679:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858424064 00000100:00100000:0.0:1746143119.937704:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11805 00000100:00100000:3.0:1746143119.938025:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858423424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7202us (8922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143119.938053:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6233 00000100:00100000:0.0:1746143119.942098:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858424064:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143119.942123:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143119.942147:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094444a00/0x25aee876ca70bd44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4b4 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143119.942184:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094444a00/0x25aee876ca70bd44 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4b4 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143119.942196:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094444a00/0x25aee876ca70bd44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4b4 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143119.942214:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444a00, rc 0) 00000100:00100000:0.0:1746143119.942263:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858424064:12345-192.168.201.28@tcp:101:cat.0 Request processed in 192us (4608us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143119.942487:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11805 00000100:00100000:0.0:1746143119.947065:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861159168:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143119.947112:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094444000/0x25aee876ca70bd3d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4ad expref: 18 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143119.947128:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094444000/0x25aee876ca70bd3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4ad expref: 18 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143119.947145:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444000, rc 0) 00000100:00100000:0.0:1746143119.947195:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858423936:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9678us (9729us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143119.947203:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11804 00000100:00100000:1.0:1746143119.947318:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861159040:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143119.947335:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143119.947354:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858423808:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10135us (10223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143119.947370:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6234 00000100:00100000:2.0:1746143119.947596:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861158912:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143119.947614:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8c00/0x25aee876ca70bd36 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f49f expref: 29 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.947632:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8c00/0x25aee876ca70bd36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f49f expref: 29 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143119.947642:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8c00, rc 0) 00000100:00100000:2.0:1746143119.947671:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858423552:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10949us (11309us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143119.947677:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11803 00000100:00100000:0.0:1746143119.966217:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143119.966993:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858424320 00000100:00100000:1.0:1746143119.967004:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858424320 00002000:00100000:1.0:1746143119.967089:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2920448->2924543) req@ffff880094513800 x1830962858424320/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/0 e 0 to 0 dl 1746143130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.967100:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513800 with x1830962858424320 ext(2920448->2924543) 00002000:00010000:1.0:1746143119.967106:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094513800 00000100:00100000:1.0:1746143119.967141:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5737 00000100:00100000:1.0:1746143119.967154:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858424320:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143119.969712:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858424320:12345-192.168.201.28@tcp:3:cat.0 Request processed in 2547us (3494us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143119.969725:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5737 00002000:00100000:1.0:1746143119.969743:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2920448->2924543) req@ffff880094513800 x1830962858424320/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:270/0 lens 488/4536 e 0 to 0 dl 1746143130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143119.969753:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513800 with x1830962858424320 ext(2920448->2924543) 00002000:00010000:1.0:1746143119.969759:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094513800 00000100:00100000:0.0:1746143119.991679:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143119.994255:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858424448 00000100:00100000:3.0:1746143119.994265:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858424448 00000100:00100000:3.0:1746143119.994333:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8037 00000100:00100000:3.0:1746143119.994522:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30684:x1830962858424448:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143119.994545:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143119.994560:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734800/0x25aee876ca70bd4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4bb expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.994613:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143119.994625:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143119.994634:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143119.994646:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143119.994651:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143119.994656:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143119.994742:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143119.994751:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcfc00/0x25aee876ca70bac0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f245 expref: 209 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.994758:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 17 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.994764:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143119.994790:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 17 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.994801:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 17 pid: 14795 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.995010:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861159296:192.168.201.28@tcp:104: 00000100:00080000:0.0:1746143119.995189:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746143119.996969:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcfc00/0x25aee876ca70bac0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f245 expref: 209 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143119.996981:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcfc00/0x25aee876ca70bac0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f245 expref: 209 pid: 14795 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143119.996991:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861159424:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143119.997847:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143120.002723:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861159296:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143120.004127:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143120.005072:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858424704 00000100:00100000:3.0:1746143120.005082:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858424704 00000100:00100000:3.0:1746143120.005152:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3373 00000100:00100000:3.0:1746143120.005160:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:26839:x1830962858424704:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00080000:1.0:1746143120.005184:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143120.005745:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861159424:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143120.005972:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:0.0:1746143120.006114:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.006183:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858424960 00000100:00100000:1.0:1746143120.006189:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858424960 00000100:00100000:1.0:1746143120.006246:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3374 00000100:00100000:1.0:1746143120.006253:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:7718:x1830962858424960:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746143120.006257:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1746143120.006611:0:16950:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589942243 00000100:00100000:3.0:1746143120.006990:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:26839:x1830962858424704:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 1828us (2869us total) trans 8589942244 rc 0/0 00000100:00100000:3.0:1746143120.006999:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3373 00000020:00080000:3.0:1746143120.007004:0:16950:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746143120.007697:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:7718:x1830962858424960:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 1438us (1577us total) trans 8589942245 rc 0/0 00000100:00100000:1.0:1746143120.007706:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3374 00000100:00100000:0.0:1746143120.012557:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.012651:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858425088 00000100:00100000:1.0:1746143120.012659:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858425088 00010000:00010000:1.0:1746143120.012692:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 20 pid: 14795 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.012792:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6235 00000100:00100000:1.0:1746143120.012800:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858425088:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143120.012812:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.012819:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 20 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.012829:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 20 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.012848:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ffa600/0x25aee876ca70badc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f253 expref: 20 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.012860:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143120.012865:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:0.0:1746143120.013282:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143120.013555:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143120.013563:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143120.013568:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143120.013609:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858425088:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 809us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.013615:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6235 00000100:00100000:1.0:1746143120.013629:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858425216 00000100:00100000:1.0:1746143120.013631:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858425216 00010000:00010000:1.0:1746143120.013642:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcfc00/0x25aee876ca70bac0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f245 expref: 211 pid: 14795 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.013664:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6236 00000100:00100000:1.0:1746143120.013858:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:1969:x1830962858425216:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143120.013869:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.013873:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcfc00/0x25aee876ca70bac0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f245 expref: 211 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.013882:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcfc00/0x25aee876ca70bac0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f245 expref: 211 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.013893:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcfc00/0x25aee876ca70bac0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f245 expref: 211 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.013903:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143120.013905:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143120.013915:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143120.013920:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143120.014597:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143120.014625:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:1969:x1830962858425216:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 954us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.014630:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6236 00010000:00010000:2.0:1746143120.014967:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.014975:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143120.015010:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143120.015013:0:14795:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143120.015028:0:14795:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015099:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015106:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015111:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015116:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015120:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b2734c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143120.015122:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015127:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015141:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143120.015144:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143120.015146:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015150:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70bd52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015333:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015339:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015344:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015348:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b2734400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143120.015350:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015354:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015361:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800aac68300) 00010000:00010000:2.0:1746143120.015362:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143120.015364:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015368:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.015394:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734800/0x25aee876ca70bd4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 16 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.015404:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 15 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.015409:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143120.015410:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143120.015413:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2734600, rc 0) 00000100:00100000:2.0:1746143120.015649:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:30684:x1830962858424448:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 21308us (23977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.015655:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8037 00000100:00100000:0.0:1746143120.019209:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.019249:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.019520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.019603:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858425344 00000100:00100000:1.0:1746143120.019603:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858425600 00000100:00100000:2.0:1746143120.019610:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858425344 00000100:00100000:1.0:1746143120.019610:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858425600 00000100:00100000:0.0:1746143120.020001:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858425856 00000100:00100000:0.0:1746143120.020005:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858425856 00000100:00100000:0.0:1746143120.020061:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11806 00000100:00100000:0.0:1746143120.020069:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858425856:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143120.020084:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143120.020100:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094445e00/0x25aee876ca70bd67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4de expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.020131:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094445e00/0x25aee876ca70bd67 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4de expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143120.020142:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094445e00/0x25aee876ca70bd67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4de expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00000100:00080000:3.0:1746143120.020489:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746143120.020492:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746143120.020527:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094445e00, rc 0) 00000100:00100000:0.0:1746143120.020562:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858425856:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 495us (1043us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143120.020568:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11806 00000100:00100000:0.0:1746143120.020582:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11807 00000100:00100000:0.0:1746143120.020586:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858425344:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143120.020592:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143120.020598:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094444600/0x25aee876ca70bd6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4c2 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143120.020631:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861159552:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143120.020671:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143120.020870:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11808 00000100:00100000:1.0:1746143120.020878:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858425600:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143120.020885:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143120.020892:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4d0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.020903:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.020904:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.020910:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143120.020922:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143120.020930:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbfc00, rc 0) 00000100:00100000:1.0:1746143120.020947:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858425600:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 71us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.020953:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11808 00000100:00100000:0.0:1746143120.020991:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.021124:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858425472 00000100:00100000:1.0:1746143120.021127:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858425472 00000100:00100000:1.0:1746143120.021151:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11809 00000100:00100000:1.0:1746143120.021156:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858425472:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143120.021162:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143120.021168:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4c9 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.021177:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.021179:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.021182:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 7 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143120.021190:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 7 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143120.021196:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbe400, rc 0) 00000100:00100000:1.0:1746143120.021210:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858425472:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 54us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.021214:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11809 00000100:00100000:0.0:1746143120.021277:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.021290:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858425728 00000100:00100000:2.0:1746143120.021293:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858425728 00000100:00100000:0.0:1746143120.021314:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.021564:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858425984 00000100:00100000:2.0:1746143120.021567:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858425984 00000100:00100000:2.0:1746143120.021586:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11810 00000100:00100000:2.0:1746143120.021591:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858425728:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:0.0:1746143120.021591:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11811 00000100:00100000:0.0:1746143120.021595:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858425984:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143120.021598:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143120.021600:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143120.021604:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bd83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4d7 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.021605:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4e5 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.021615:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.021616:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.021620:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143120.021628:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861159680:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143120.021628:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143120.021635:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094445000, rc 0) 00000100:00100000:0.0:1746143120.021649:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858425984:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143120.021656:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11811 00000100:00100000:2.0:1746143120.021659:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3766c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143120.023825:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861159552:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143120.023870:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094444600/0x25aee876ca70bd6e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c2 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.023881:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094444600/0x25aee876ca70bd6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c2 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.023890:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444600, rc 0) 00000100:00100000:2.0:1746143120.023922:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858425344:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 3334us (4720us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143120.023929:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11807 00000100:00100000:3.0:1746143120.024014:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861159680:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143120.024050:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bd83 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d7 expref: 6 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143120.024068:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497a00/0x25aee876ca70bd83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d7 expref: 6 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143120.024078:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497a00, rc 0) 00000100:00100000:3.0:1746143120.024097:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858425728:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 2505us (2820us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143120.024102:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11810 00000100:00100000:0.0:1746143120.029169:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.029375:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858426240 00000100:00100000:2.0:1746143120.029387:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858426240 00000100:00100000:2.0:1746143120.029442:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8038 00000100:00100000:2.0:1746143120.029458:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:30684:x1830962858426240:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143120.029475:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143120.029493:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734800/0x25aee876ca70bd91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4ec expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.029769:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.029962:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 16 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.029969:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.029998:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 16 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.030008:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 16 pid: 14795 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143120.030020:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861159808:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143120.031456:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143120.033518:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861159808:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143120.033539:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:0.0:1746143120.034459:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.036203:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858426368 00000100:00100000:1.0:1746143120.036214:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858426368 00010000:00010000:1.0:1746143120.036256:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 17 pid: 14795 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.036301:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6237 00000100:00100000:1.0:1746143120.036311:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:1969:x1830962858426368:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143120.036325:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.036330:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 17 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.036342:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 17 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.036364:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734600/0x25aee876ca70bd60 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4bb expref: 17 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.036388:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143120.036392:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143120.036401:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143120.036408:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143120.036442:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143120.036497:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:1969:x1830962858426368:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 185us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.036503:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6237 00010000:00010000:2.0:1746143120.036799:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143120.036808:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143120.036836:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143120.037005:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734800/0x25aee876ca70bd91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4ec expref: 17 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.037023:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4ec expref: 16 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.037054:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143120.037057:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143120.037059:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2734400, rc 0) 00000100:00100000:2.0:1746143120.037086:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:30684:x1830962858426240:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 7629us (7928us total) trans 8589942246 rc 0/0 00000100:00100000:2.0:1746143120.037093:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8038 00000100:00100000:0.0:1746143120.039891:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.039986:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858426624 00000100:00100000:2.0:1746143120.039994:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858426624 00000100:00100000:2.0:1746143120.040218:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8039 00000100:00100000:2.0:1746143120.040225:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:30684:x1830962858426624:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143120.040756:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143120.040760:0:14795:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143120.040782:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70bd98 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4ec expref: 16 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.040801:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143120.040803:0:14795:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143120.040815:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9a00/0x25aee876ca70bda6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4f3 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.040892:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70bdad lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143120.040901:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70bdad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143120.040908:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70bdad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:3.0:1746143120.040915:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143120.041000:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9a00/0x25aee876ca70bda6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4f3 expref: 18 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.041009:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70bdad lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4f3 expref: 17 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.041013:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143120.041015:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143120.041016:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8800, rc 0) 00000100:00100000:3.0:1746143120.041070:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:30684:x1830962858426624:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 845us (1186us total) trans 8589942247 rc 0/0 00000100:00100000:3.0:1746143120.041076:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8039 00000100:00100000:0.0:1746143120.042139:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143120.042201:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858426752 00000100:00100000:3.0:1746143120.042206:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858426752 00000100:00100000:3.0:1746143120.042345:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8040 00000100:00100000:3.0:1746143120.042353:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:30684:x1830962858426752:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143120.042368:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143120.042377:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9e00/0x25aee876ca70bdbb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f4fa expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.042408:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9e00/0x25aee876ca70bdbb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4fa expref: 18 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.042419:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9e00/0x25aee876ca70bdbb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4fa expref: 18 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.042433:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143120.042435:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143120.042437:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf9e00, rc 0) 00000100:00100000:3.0:1746143120.042504:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:30684:x1830962858426752:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 152us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143120.042510:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8040 00000100:00100000:0.0:1746143120.046772:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.047573:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.048169:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858427008 00000100:00100000:2.0:1746143120.048178:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858427008 00000100:00100000:2.0:1746143120.048220:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858427264 00000100:00100000:2.0:1746143120.048222:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858427264 00000100:00100000:2.0:1746143120.048672:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11812 00000100:00100000:2.0:1746143120.048681:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858427008:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143120.048726:0:4756:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.048745:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.048754:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.048763:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 25 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.048769:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.048771:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.048774:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.048804:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 25 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.048817:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 25 pid: 4758 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143120.048829:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861159936:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143120.048911:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.048920:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 8 pid: 754 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143120.048929:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861160064:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143120.048955:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.048964:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 24 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143120.048971:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861160192:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143120.048986:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143120.049130:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.050302:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.050398:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858427520 00000100:00100000:1.0:1746143120.050403:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858427520 00000100:00100000:1.0:1746143120.050431:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11813 00000100:00100000:1.0:1746143120.050437:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858427264:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143120.050476:0:754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050488:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 27 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050493:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143120.050494:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143120.050496:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050516:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 27 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050525:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 27 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.050534:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861160320:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143120.050566:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143120.050584:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11814 00000100:00100000:1.0:1746143120.050591:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858427520:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143120.050607:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050617:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 24 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050629:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 9 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143120.050636:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 25 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050641:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.050643:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.050645:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050660:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 25 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050668:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 25 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.050676:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861160448:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.050705:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 9 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143120.050713:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 9 pid: 20836 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143120.050720:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861160576:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.050742:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 24 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.050749:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 24 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.050755:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861160704:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143120.050765:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143120.051400:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.051427:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143120.051503:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858426880 00000100:00100000:3.0:1746143120.051507:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858426880 00000100:00100000:3.0:1746143120.051527:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858427136 00000100:00100000:3.0:1746143120.051529:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858427136 00000100:00100000:3.0:1746143120.051539:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858427392 00000100:00100000:3.0:1746143120.051541:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858427392 00000100:00100000:3.0:1746143120.051560:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11815 00000100:00100000:3.0:1746143120.051566:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858426880:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143120.051586:0:21048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.051598:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.051604:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143120.051605:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143120.051607:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.051626:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.051635:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 15 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143120.051644:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861160832:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143120.051677:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143120.051693:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11816 00000100:00100000:3.0:1746143120.051699:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858427136:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143120.051715:0:10061:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143120.051753:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11817 00000100:00100000:0.0:1746143120.051764:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858427392:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143120.051782:0:22204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.051792:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.051800:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 27 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.052275:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3600/0x25aee876ca70b56b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee0f expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.052281:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746143120.052282:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746143120.052285:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.052307:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3600/0x25aee876ca70b56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee0f expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.052315:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3600/0x25aee876ca70b56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee0f expref: 15 pid: 754 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.052324:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861160960:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143120.052358:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 27 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.052366:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 27 pid: 754 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.052373:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861161088:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143120.052684:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.052693:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 10 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143120.052699:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 25 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143120.052705:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143120.052706:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143120.052708:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.052727:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 25 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143120.052736:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 25 pid: 4758 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143120.052745:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861161216:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143120.052787:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 10 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143120.052795:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 10 pid: 754 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143120.052802:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861161344:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143120.052829:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.052837:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 24 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143120.052845:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861161472:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143120.052862:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143120.053054:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.053064:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 27 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.053072:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861161600:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143120.053103:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143120.058295:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861160960:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143120.058362:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861161088:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143120.058516:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861159936:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143120.058526:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861160064:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143120.058534:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861160192:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143120.058569:0:4756:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143120.058666:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861160320:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.058684:0:754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143120.058712:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861160448:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143120.058769:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861160832:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143120.058785:0:21048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143120.058808:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861161216:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143120.058815:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861161344:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143120.058822:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861161472:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143120.058837:0:10061:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143120.058886:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861160576:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143120.058890:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861161600:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143120.058893:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861160704:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.058906:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.058916:0:22204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143120.060864:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.060960:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858427776 00000100:00100000:1.0:1746143120.060966:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858427776 00002000:00100000:1.0:1746143120.061026:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1904640->2097151) req@ffff88008eb74e00 x1830962858427776/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:271/0 lens 488/0 e 0 to 0 dl 1746143131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00080000:3.0:1746143120.061120:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1746143120.061173:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74e00 with x1830962858427776 ext(1904640->2097151) 00010000:00010000:1.0:1746143120.061181:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 28 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.061191:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 28 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746143120.061198:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb74e00 00000100:00100000:1.0:1746143120.061302:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1901 00000100:00100000:1.0:1746143120.061310:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858427776:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143120.069175:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.069856:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.069886:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.069899:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.069913:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.069937:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858428160 00000100:00100000:2.0:1746143120.069944:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858428160 00002000:00100000:2.0:1746143120.069981:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (249856->491519) req@ffff88008eb20380 x1830962858428160/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:271/0 lens 488/0 e 0 to 0 dl 1746143131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143120.069994:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20380 with x1830962858428160 ext(249856->491519) 00010000:00010000:2.0:1746143120.070002:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 16 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.070014:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 16 pid: 10061 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143120.070020:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb20380 00000100:00100000:1.0:1746143120.070286:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858427904 00000100:00100000:1.0:1746143120.070290:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858427904 00000100:00100000:3.0:1746143120.070513:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858428416 00000100:00100000:3.0:1746143120.070518:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858428416 00010000:00010000:3.0:1746143120.070537:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3600/0x25aee876ca70b56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee0f expref: 17 pid: 754 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143120.070558:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858427648 00000100:00100000:3.0:1746143120.070560:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858427648 00010000:00010000:3.0:1746143120.070570:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 11 pid: 754 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143120.070581:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858428032 00000100:00100000:3.0:1746143120.070583:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858428032 00010000:00010000:3.0:1746143120.070589:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 12 pid: 20836 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143120.070599:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6238 00000100:00100000:3.0:1746143120.070606:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858428416:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143120.070617:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143120.070635:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3600/0x25aee876ca70b56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee0f expref: 17 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.070651:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3600/0x25aee876ca70b56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee0f expref: 17 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.070670:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3600/0x25aee876ca70b56b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ee0f expref: 17 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.070687:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143120.070724:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858428416:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 119us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143120.070730:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6238 00000100:00100000:3.0:1746143120.070742:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6239 00000100:00100000:3.0:1746143120.070746:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858427648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143120.070751:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143120.070761:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 12 pid: 754 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143120.070767:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 12 pid: 754 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143120.070778:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dbe400/0x25aee876ca70bd7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4c9 expref: 12 pid: 754 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143120.070785:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143120.070797:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858427648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 51us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143120.070801:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6239 00000100:00100000:3.0:1746143120.070808:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6240 00000100:00100000:3.0:1746143120.070812:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858428032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143120.070816:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143120.070822:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 10 pid: 20836 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143120.070829:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 10 pid: 20836 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143120.070837:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094445000/0x25aee876ca70bd8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4e5 expref: 10 pid: 20836 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143120.070844:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143120.070854:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858428032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 41us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143120.070858:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6240 00000100:00100000:2.0:1746143120.071227:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1902 00000100:00100000:2.0:1746143120.071236:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858428160:12345-192.168.201.28@tcp:4:cat.0 00010000:00010000:1.0:1746143120.071295:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 25 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.071309:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6241 00000100:00100000:1.0:1746143120.071313:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858427904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143120.071319:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.071326:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 25 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.071333:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 25 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.071343:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2200/0x25aee876ca70bc09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f379 expref: 25 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.071353:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143120.071369:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858427904:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 55us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.071374:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6241 00000100:00100000:2.0:1746143120.071504:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.071545:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858428672 00000100:00100000:2.0:1746143120.071546:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.071556:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858428672 00000100:00100000:2.0:1746143120.071575:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143120.071589:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 26 pid: 4758 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746143120.071646:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858428288 00000100:00100000:0.0:1746143120.071650:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858428288 00010000:00010000:0.0:1746143120.071662:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 27 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.071671:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858428544 00000100:00100000:0.0:1746143120.071673:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858428544 00010000:00010000:0.0:1746143120.071682:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 9 pid: 754 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746143120.071692:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6242 00000100:00100000:0.0:1746143120.071698:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858428672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143120.071708:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143120.071724:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 27 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746143120.071737:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 27 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746143120.071755:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e57e400/0x25aee876ca70bc2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f39c expref: 27 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746143120.071774:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.071776:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.071781:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.071790:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.071809:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143120.071845:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858428672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 147us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143120.071851:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6242 00000100:00100000:0.0:1746143120.071865:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6243 00000100:00100000:0.0:1746143120.071869:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1970:x1830962858428288:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143120.071875:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143120.071883:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 25 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143120.071890:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 25 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143120.071901:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b000/0x25aee876ca70bcd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f444 expref: 25 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143120.071910:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143120.071923:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858428288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 53us (376us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143120.071926:0:4756:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143120.071928:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6243 00010000:00010000:2.0:1746143120.071937:0:4756:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143120.071938:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6244 00000100:00100000:0.0:1746143120.071942:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858428544:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143120.071948:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143120.071956:0:4756:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.071958:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 9 pid: 754 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143120.071962:0:4756:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.071965:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 9 pid: 754 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143120.071968:0:4756:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.071974:0:4756:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b2734000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143120.071977:0:4756:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.071977:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dbfc00/0x25aee876ca70bd75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4d0 expref: 9 pid: 754 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143120.071983:0:4756:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.071986:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143120.071993:0:4756:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.071998:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b2734000/0x25aee876ca70bdc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143120.071999:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858428544:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143120.072004:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6244 00000100:00100000:2.0:1746143120.072061:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858427008:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 23381us (25298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.072069:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11812 00000100:00080000:3.0:1746143120.072336:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143120.075264:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858427776:12345-192.168.201.28@tcp:4:cat.0 Request processed in 13948us (14397us total) trans 21474839912 rc 0/0 00000100:00100000:1.0:1746143120.075274:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1901 00002000:00100000:1.0:1746143120.075283:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1904640->2097151) req@ffff88008eb74e00 x1830962858427776/t21474839912(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:271/0 lens 488/448 e 0 to 0 dl 1746143131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143120.075292:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74e00 with x1830962858427776 ext(1904640->2097151) 00010000:00010000:1.0:1746143120.075300:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 30 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.075310:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 30 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746143120.075316:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb74e00 00000100:00100000:2.0:1746143120.081972:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.082016:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.082059:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858428800 00000100:00100000:1.0:1746143120.082068:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858428800 00010000:00010000:1.0:1746143120.082104:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 24 pid: 4758 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143120.082114:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858428928 00000100:00100000:3.0:1746143120.082119:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858428928 00000100:00100000:1.0:1746143120.082132:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6245 00010000:00010000:3.0:1746143120.082136:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 30 pid: 754 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.082140:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858428800:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143120.082151:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143120.082152:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6246 00000100:00100000:3.0:1746143120.082157:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858428928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143120.082163:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.082169:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 24 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143120.082176:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 30 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.082184:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 30 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.082185:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 24 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143120.082203:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d70600/0x25aee876ca70bb6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5193728->18446744073709551615] (req 5193728->5210111) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f2df expref: 30 pid: 754 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.082203:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e57fe00/0x25aee876ca70bc33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f3a3 expref: 24 pid: 4758 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143120.082219:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143120.082224:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143120.082254:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858428800:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 115us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.082260:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6245 00000100:00100000:3.0:1746143120.082371:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858428928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 212us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143120.082377:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6246 00000100:00100000:2.0:1746143120.084070:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.084219:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.084253:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143120.084274:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858429056 00000100:00100000:3.0:1746143120.084279:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858429056 00000100:00100000:1.0:1746143120.084279:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858429312 00000100:00100000:2.0:1746143120.084282:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.084283:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858429312 00010000:00010000:3.0:1746143120.084299:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 24 pid: 8448 timeout: 1001 lvb_type: 0 00002000:00100000:1.0:1746143120.084306:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2924543) req@ffff88008eb23100 x1830962858429312/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:271/0 lens 488/0 e 0 to 0 dl 1746143131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143120.084315:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb23100 with x1830962858429312 ext(2097152->2924543) 00000100:00100000:3.0:1746143120.084322:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858429184 00010000:00010000:1.0:1746143120.084322:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 29 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143120.084325:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858429184 00010000:00010000:1.0:1746143120.084331:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 29 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.084333:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 25 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.084334:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858429440 00002000:00010000:1.0:1746143120.084337:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb23100 00000100:00100000:0.0:1746143120.084338:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858429440 00000100:00100000:3.0:1746143120.084352:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6247 00000100:00100000:3.0:1746143120.084357:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858429056:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143120.084357:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6248 00000100:00100000:1.0:1746143120.084364:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858429184:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143120.084366:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.084371:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143120.084373:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 30 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.084377:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 25 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.084382:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 25 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.084385:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 25 pid: 8448 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.084387:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6249 00010000:00010000:1.0:1746143120.084390:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 25 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.084392:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858429440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143120.084399:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143120.084401:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3800/0x25aee876ca70bc10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f380 expref: 25 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.084401:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a6da00/0x25aee876ca70bccd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f43d expref: 25 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.084410:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.084410:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.084410:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 30 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.084412:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.084412:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143120.084415:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084416:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.084419:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 30 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.084422:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084422:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.084430:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27c00/0x25aee876ca70bcf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f460 expref: 30 pid: 8448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.084439:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143120.084456:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143120.084460:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.084462:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.084465:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143120.084478:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858429184:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 115us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.084484:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6248 00010000:00010000:1.0:1746143120.084503:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084504:0:10061:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084510:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084511:0:10061:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084525:0:10061:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084525:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084532:0:10061:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084532:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084538:0:10061:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084538:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084543:0:10061:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a48e1a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143120.084543:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dbe800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143120.084547:0:10061:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084547:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084553:0:10061:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084553:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084561:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084562:0:10061:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.084566:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dbe800/0x25aee876ca70bdd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.084568:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70bdde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.084606:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143120.084621:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143120.084655:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858429056:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 297us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143120.084661:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6247 00000100:00100000:1.0:1746143120.085023:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858427520:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 34431us (35892us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143120.085028:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858429440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 634us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.085044:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11814 00000100:00100000:0.0:1746143120.085049:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6249 00010000:00010000:1.0:1746143120.085062:0:754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.085068:0:754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.085081:0:754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.085087:0:754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.085093:0:754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.085098:0:754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dbe000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143120.085100:0:754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.085106:0:754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.085114:0:754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.085119:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dbe000/0x25aee876ca70bdc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143120.085149:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858427264:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 34712us (37577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.085154:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11813 00000100:00100000:1.0:1746143120.085173:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1903 00000100:00100000:1.0:1746143120.085179:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858429312:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143120.085180:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858427136:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 33480us (33780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.085186:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11816 00000100:00100000:3.0:1746143120.088607:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858428160:12345-192.168.201.28@tcp:4:cat.0 Request processed in 17364us (18684us total) trans 21474839913 rc 0/0 00000100:00100000:3.0:1746143120.088618:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1902 00002000:00100000:3.0:1746143120.088628:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (249856->491519) req@ffff88008eb20380 x1830962858428160/t21474839913(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:271/0 lens 488/448 e 0 to 0 dl 1746143131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143120.088637:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20380 with x1830962858428160 ext(249856->491519) 00010000:00010000:3.0:1746143120.088646:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 17 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.088657:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 17 pid: 10061 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143120.088664:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb20380 00000100:00100000:0.0:1746143120.092828:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.093588:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858429568 00000100:00100000:1.0:1746143120.093597:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858429568 00010000:00010000:1.0:1746143120.093626:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 17 pid: 10061 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.093656:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6250 00000100:00100000:1.0:1746143120.093663:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858429568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143120.093675:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.093692:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 17 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.093703:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 17 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.093722:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8a00/0x25aee876ca70bce9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 249856->491519) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f459 expref: 17 pid: 10061 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.093735:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.093737:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.093741:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.093748:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.093781:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143120.094002:0:21048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143120.094004:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858429568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 340us (1183us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143120.094011:0:21048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143120.094011:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6250 00010000:00010000:3.0:1746143120.094043:0:21048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.094051:0:21048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.094058:0:21048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.094063:0:21048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecf8200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143120.094066:0:21048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.094073:0:21048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.094083:0:21048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.094093:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70bdd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143120.094297:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858426880:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 42567us (43833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143120.094305:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11815 00000100:00100000:1.0:1746143120.110707:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858429312:12345-192.168.201.28@tcp:4:cat.0 Request processed in 25394us (26355us total) trans 21474839914 rc 0/0 00000100:00100000:1.0:1746143120.110719:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1903 00002000:00100000:1.0:1746143120.110730:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2924543) req@ffff88008eb23100 x1830962858429312/t21474839914(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:271/0 lens 488/448 e 0 to 0 dl 1746143131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143120.110738:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb23100 with x1830962858429312 ext(2097152->2924543) 00010000:00010000:1.0:1746143120.110748:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.110761:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746143120.110768:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eb23100 00000100:00100000:0.0:1746143120.115148:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.115243:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858429696 00000100:00100000:2.0:1746143120.115253:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858429696 00010000:00010000:2.0:1746143120.115303:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143120.115343:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6251 00000100:00100000:2.0:1746143120.115350:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858429696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143120.115363:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143120.115384:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143117 -> 1746143118 00010000:00010000:2.0:1746143120.115627:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.115638:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.115662:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff27600/0x25aee876ca70bd0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->5193727] (req 2097152->2924543) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f47c expref: 30 pid: 4758 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.117050:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.117054:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.117059:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.117070:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.117105:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143120.117146:0:22204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143120.117155:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858429696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1803us (2016us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143120.117158:0:22204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143120.117167:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6251 00010000:00010000:1.0:1746143120.117188:0:22204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.117195:0:22204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.117206:0:22204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.117212:0:22204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094445400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143120.117215:0:22204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.117222:0:22204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.117237:0:22204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.117242:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bde5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143120.117334:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858427392:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 65572us (65903us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.117342:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11817 00000100:00100000:0.0:1746143120.119966:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.120708:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858429952 00000100:00100000:1.0:1746143120.120718:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858429952 00000100:00100000:1.0:1746143120.120947:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8041 00000100:00100000:1.0:1746143120.120955:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:30684:x1830962858429952:12345-192.168.201.28@tcp:36:mirror_io.0 00010000:00010000:1.0:1746143120.121006:0:17079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.121058:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9e00/0x25aee876ca70bdbb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4fa expref: 18 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121077:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143120.121081:0:17079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143120.121110:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.121122:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70aa89 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6a6 expref: 209 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121128:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9000/0x25aee876ca70aa97 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6b4 expref: 209 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121139:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70aaa5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6c2 expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121145:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5e00/0x25aee876ca70ab54 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e732 expref: 18 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121152:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70ab7e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e74e expref: 209 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121160:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 209 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121165:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 18 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121171:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 10/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.121207:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 18 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.121218:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 18 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.121231:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861161728:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143120.123464:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.123593:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858430080 00000100:00100000:2.0:1746143120.123601:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858430080 00010000:00010000:2.0:1746143120.123634:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 6/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 19 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143120.123662:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6252 00000100:00100000:2.0:1746143120.123668:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858430080:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143120.123680:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143120.123685:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 6/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 19 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.123696:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 19 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.123714:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143120.123719:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 9/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143120.123726:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143120.123765:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858430080:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 97us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.123772:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6252 00010000:00010000:1.0:1746143120.124554:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 209 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.124565:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 209 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.124576:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861161856:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.124621:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70ab7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e74e expref: 209 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.124628:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70ab7e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e74e expref: 209 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.124635:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861161984:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.124661:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5e00/0x25aee876ca70ab54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e732 expref: 18 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.124668:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5e00/0x25aee876ca70ab54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e732 expref: 18 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.124679:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861162112:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.124700:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70aaa5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6c2 expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.124706:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70aaa5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6c2 expref: 18 pid: 14794 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.124712:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094517480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861162240:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.124731:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9000/0x25aee876ca70aa97 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6b4 expref: 209 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.124737:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9000/0x25aee876ca70aa97 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6b4 expref: 209 pid: 14794 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.124744:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861162368:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.124762:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70aa89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6a6 expref: 209 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.124769:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70aa89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6a6 expref: 209 pid: 14795 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.124775:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094516680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861162496:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143120.124799:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986480 going to sleep for 11 seconds 00010000:00010000:1.0:1746143120.124820:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea7be00/0x25aee876ca70aebf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e946 expref: 18 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.124841:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861161728:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143120.130601:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.130646:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.130663:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858430464 00000100:00100000:0.0:1746143120.130666:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858430720 00000100:00100000:2.0:1746143120.130672:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858430464 00000100:00100000:0.0:1746143120.130672:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858430720 00010000:00010000:0.0:1746143120.130708:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9000/0x25aee876ca70aa97 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6b4 expref: 211 pid: 14794 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.130733:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6253 00000100:00100000:0.0:1746143120.130745:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:1970:x1830962858430720:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143120.130757:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3375 00010000:00010000:0.0:1746143120.130758:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143120.130763:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:26840:x1830962858430464:12345-192.168.201.28@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746143120.130764:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9000/0x25aee876ca70aa97 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6b4 expref: 211 pid: 14794 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143120.130775:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9000/0x25aee876ca70aa97 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6b4 expref: 211 pid: 14794 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143120.130798:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143120.130803:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143120.130811:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143120.130847:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:1970:x1830962858430720:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 104us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143120.130857:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6253 00000100:00100000:0.0:1746143120.130887:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.130898:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858430592 00000100:00100000:0.0:1746143120.130901:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858430592 00010000:00010000:0.0:1746143120.130908:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70aaa5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6c2 expref: 18 pid: 14794 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143120.130930:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6254 00000100:00100000:0.0:1746143120.130934:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858430592:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143120.130940:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143120.130943:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70aaa5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6c2 expref: 18 pid: 14794 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143120.130950:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70aaa5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6c2 expref: 18 pid: 14794 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143120.130958:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143120.130961:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143120.130965:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143120.130978:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858430592:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 43us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143120.130983:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6254 00000100:00100000:1.0:1746143120.131136:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861161856:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143120.131146:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861161984:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.131156:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70aaa5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6c2 expref: 17 pid: 14794 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.131175:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094517480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861162240:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143120.131183:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9000/0x25aee876ca70aa97 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6b4 expref: 210 pid: 14794 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.131191:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861162368:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143120.131199:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094516680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861162496:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143120.131283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.131400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.131884:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861162112:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143120.131916:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:3.0:1746143120.131997:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858431104 00000100:00100000:3.0:1746143120.132002:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858431104 00000100:00100000:3.0:1746143120.132024:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3376 00000100:00100000:3.0:1746143120.132043:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5210c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:26839:x1830962858431104:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143120.132136:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5210c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:26839:x1830962858431104:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 107us (736us total) trans 8589942249 rc 0/0 00000100:00100000:3.0:1746143120.132142:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3376 00000100:00100000:1.0:1746143120.132272:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858430848 00000100:00100000:1.0:1746143120.132275:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858430848 00010000:00010000:1.0:1746143120.132289:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70aa89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6a6 expref: 211 pid: 14795 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.132303:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6255 00000100:00100000:1.0:1746143120.132307:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:1970:x1830962858430848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143120.132314:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143120.132318:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70aa89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6a6 expref: 211 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.132331:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70aa89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6a6 expref: 211 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.132345:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70aa89 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e6a6 expref: 211 pid: 14795 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.132354:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143120.132358:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.132365:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143120.132948:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:1970:x1830962858430848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 638us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.132955:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6255 00000100:00100000:2.0:1746143120.132996:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:26840:x1830962858430464:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 2232us (2405us total) trans 8589942248 rc 0/0 00000100:00100000:2.0:1746143120.133002:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3375 00000100:00100000:0.0:1746143120.135103:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.135188:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.135235:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858430208 00000100:00100000:2.0:1746143120.135242:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858430208 00000100:00100000:3.0:1746143120.135258:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858431232 00000100:00100000:3.0:1746143120.135263:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858431232 00010000:00010000:2.0:1746143120.135269:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 210 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143120.135281:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70ab7e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e74e expref: 210 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143120.135908:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6256 00000100:00100000:2.0:1746143120.135917:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:1968:x1830962858430208:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143120.135930:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143120.135943:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 210 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.135954:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 210 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.135975:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1ec800/0x25aee876ca70ad6f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e87b expref: 210 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.135990:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143120.135994:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143120.136001:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143120.136069:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:1968:x1830962858430208:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 153us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.136076:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6256 00000100:00100000:2.0:1746143120.136091:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6257 00000100:00100000:2.0:1746143120.136096:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:1971:x1830962858431232:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143120.136103:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143120.136106:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70ab7e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e74e expref: 208 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.136114:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70ab7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e74e expref: 208 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.136125:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70ab7e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e74e expref: 208 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143120.136135:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143120.136138:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143120.136143:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143120.136290:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143120.136570:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858431360 00000100:00100000:1.0:1746143120.136576:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858431360 00010000:00010000:1.0:1746143120.136594:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5e00/0x25aee876ca70ab54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e732 expref: 18 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143120.136611:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6258 00000100:00100000:1.0:1746143120.136616:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858431360:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143120.136623:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143120.136627:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1971:x1830962858431232:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 530us (1439us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143120.136627:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5e00/0x25aee876ca70ab54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e732 expref: 18 pid: 1037 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143120.136633:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6257 00010000:00010000:1.0:1746143120.136635:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5e00/0x25aee876ca70ab54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e732 expref: 18 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.136652:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5e00/0x25aee876ca70ab54 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164e732 expref: 18 pid: 1037 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143120.136660:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143120.136663:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.136670:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.136676:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.136695:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143120.136711:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858431360:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 95us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.136717:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6258 00010000:00010000:0.0:1746143120.136985:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143120.136992:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000040:00080000:0.0:1746143120.138063:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2296, 88 off194752 00000004:00080000:0.0:1746143120.138073:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901978040696ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.138123:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2324, 88 off196960 00000004:00080000:0.0:1746143120.138127:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901978095746ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143120.138145:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2325, 88 off197048 00000004:00080000:0.0:1746143120.138148:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901978116758ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143120.138155:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2297, 88 off194840 00000004:00080000:0.0:1746143120.138157:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901978125727ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.138163:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2298, 88 off194928 00000004:00080000:0.0:1746143120.138165:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901978133537ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.138170:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2326, 88 off197136 00000004:00080000:0.0:1746143120.138173:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901978141628ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143120.138178:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2327, 88 off197224 00000004:00080000:0.0:1746143120.138180:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901978148967ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143120.138185:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2328, 88 off197312 00000004:00080000:0.0:1746143120.138188:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901978156629ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143120.138193:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2299, 88 off195016 00000004:00080000:0.0:1746143120.138195:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901978163718ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.138200:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2329, 88 off197400 00000004:00080000:0.0:1746143120.138202:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901978170708ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143120.138207:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2300, 88 off195104 00000004:00080000:0.0:1746143120.138210:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901978178954ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.138216:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2330, 88 off197488 00000004:00080000:0.0:1746143120.138219:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901978187434ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143120.139371:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2301, 88 off195192 00000004:00080000:0.0:1746143120.139377:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901979345237ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.139400:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2302, 88 off195280 00000004:00080000:0.0:1746143120.139403:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901979371114ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.139409:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2303, 88 off195368 00000004:00080000:0.0:1746143120.139413:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901979381699ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.139419:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2304, 88 off195456 00000004:00080000:0.0:1746143120.139422:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901979390373ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143120.139430:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2331, 88 off197576 00000004:00080000:0.0:1746143120.139432:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901979401049ns, next at 860119223596ns, rc = 0 00000004:00010000:2.0:1746143120.188785:0:17079:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008eb77100 reply state ffff8800905b6400 transno 8589942250 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143120.188801:0:17079:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143120.188917:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+19:30684:x1830962858429952:12345-192.168.201.28@tcp:36:mirror_io.0 Request processed in 67957us (68954us total) trans 8589942250 rc 0/0 00000100:00100000:2.0:1746143120.188926:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8041 00000001:00080000:1.0:1746143120.188934:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942250 is committed 00000004:00080000:1.0:1746143120.188941:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1749 committed 00000004:00080000:1.0:1746143120.188949:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1728 committed 00000004:00080000:1.0:1746143120.188954:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1727 committed 00000004:00080000:1.0:1746143120.188955:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1726 committed 00000004:00080000:1.0:1746143120.188958:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1725 committed 00000004:00080000:1.0:1746143120.188959:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1748 committed 00000004:00080000:1.0:1746143120.188961:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1724 committed 00000004:00080000:1.0:1746143120.188963:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1747 committed 00000004:00080000:1.0:1746143120.188964:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1723 committed 00000004:00080000:1.0:1746143120.188966:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1746 committed 00000004:00080000:1.0:1746143120.188967:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1745 committed 00000004:00080000:1.0:1746143120.188969:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1744 committed 00000004:00080000:1.0:1746143120.188972:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1722 committed 00000004:00080000:1.0:1746143120.188974:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1721 committed 00000004:00080000:1.0:1746143120.188980:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1743 committed 00000004:00080000:1.0:1746143120.188982:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1742 committed 00000004:00080000:1.0:1746143120.188985:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1720 committed 00000001:00080000:1.0:1746143120.189012:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942245 is committed 00000001:00080000:1.0:1746143120.189017:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942248 is committed 00000100:00100000:2.0:1746143120.189058:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861162624:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1746143120.189068:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942234 is committed 00000001:00080000:1.0:1746143120.189083:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942249 is committed 00000100:00100000:2.0:1746143120.189112:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746143120.189139:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.189148:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.189155:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.189165:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f13000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143120.189170:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143120.189172:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861162624 00010000:00010000:1.0:1746143120.189177:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143120.189179:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861162624 00010000:00010000:1.0:1746143120.189195:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143120.189198:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143120.189202:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143120.189208:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70bdec lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143120.191183:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861163008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.191222:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143120.191250:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861163520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.191263:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143120.191275:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143120.191279:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861162880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.191291:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143120.191299:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861163392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.191309:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143120.191327:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861163008 00000100:00100000:1.0:1746143120.191331:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861163008 00000100:00100000:2.0:1746143120.191437:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861163520 00000100:00100000:2.0:1746143120.191441:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861163520 00000100:00100000:2.0:1746143120.191465:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861162880 00000100:00100000:2.0:1746143120.191468:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861162880 00000100:00100000:2.0:1746143120.191478:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861163392 00000100:00100000:2.0:1746143120.191480:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861163392 00000100:00100000:2.0:1746143120.191494:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11818 00000100:00100000:2.0:1746143120.191500:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861162624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.191713:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3299:x1830962861162624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (2600us total) trans 21474839915 rc 0/0 00000100:00100000:2.0:1746143120.191720:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11818 00000100:00100000:2.0:1746143120.191732:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11819 00000100:00100000:2.0:1746143120.191737:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3302:x1830962861163520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143120.191859:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3302:x1830962861163520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (594us total) trans 17179872662 rc 0/0 00000100:00100000:2.0:1746143120.191865:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11819 00000100:00100000:2.0:1746143120.191874:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11820 00000100:00100000:2.0:1746143120.191878:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3302:x1830962861162880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143120.191981:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3302:x1830962861162880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (673us total) trans 17179872663 rc 0/0 00000100:00100000:2.0:1746143120.191986:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11820 00000100:00100000:2.0:1746143120.191994:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11821 00000100:00100000:2.0:1746143120.191998:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3302:x1830962861163392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143120.192093:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3302:x1830962861163392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (782us total) trans 17179872664 rc 0/0 00000100:00100000:2.0:1746143120.192099:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11821 00000100:00100000:2.0:1746143120.192190:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861163136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143120.192212:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143120.192229:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861163648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143120.192243:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143120.192251:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861164160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.192265:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143120.192287:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb20000/2, rc 0, transno 21474839915 00000100:00100000:2.0:1746143120.192294:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861162624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.192301:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746143120.192306:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861162752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143120.192321:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143120.192332:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861163264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143120.192343:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143120.192352:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861163776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.192375:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1746143120.192949:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746143120.192954:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143120.195316:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861164288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.195363:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143120.195391:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861163136 00000100:00100000:2.0:1746143120.195397:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861163136 00000100:00100000:2.0:1746143120.195423:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861163648 00000100:00100000:2.0:1746143120.195425:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861163648 00000100:00100000:2.0:1746143120.195432:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861164160 00000100:00100000:2.0:1746143120.195434:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861164160 00000100:00100000:3.0:1746143120.195488:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861162752 00000100:00100000:3.0:1746143120.195699:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861162752 00000100:00100000:3.0:1746143120.195713:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861163264 00000100:00100000:3.0:1746143120.195715:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861163264 00000100:00100000:3.0:1746143120.195721:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861163776 00000100:00100000:3.0:1746143120.195723:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861163776 00000100:00100000:3.0:1746143120.195729:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861164288 00000100:00100000:3.0:1746143120.195731:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861164288 00000100:00100000:3.0:1746143120.195741:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11822 00000100:00100000:3.0:1746143120.195746:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861163136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.195765:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11823 00000100:00100000:1.0:1746143120.195773:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861163648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.195836:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11824 00000100:00100000:1.0:1746143120.195842:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3299:x1830962861164160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.195843:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11825 00000100:00100000:2.0:1746143120.195850:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861162752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.196335:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3299:x1830962861164160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 493us (4068us total) trans 21474839916 rc 0/0 00000100:00100000:1.0:1746143120.196342:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11824 00000100:00100000:0.0:1746143120.196350:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11826 00000100:00100000:1.0:1746143120.196356:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11827 00000100:00100000:0.0:1746143120.196358:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861163264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.196361:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3299:x1830962861163776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.196594:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11828 00000100:00100000:2.0:1746143120.196600:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3299:x1830962861164288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143120.196675:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861163264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 318us (4330us total) trans 17179872665 rc 0/0 00000100:00100000:0.0:1746143120.196681:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11826 00000100:00100000:0.0:1746143120.196692:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11829 00000100:00100000:0.0:1746143120.196696:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861163008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143120.196717:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3299:x1830962861164288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (1353us total) trans 21474839917 rc 0/0 00000100:00100000:2.0:1746143120.196722:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11828 00000100:00100000:1.0:1746143120.196784:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3299:x1830962861163776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 422us (4407us total) trans 21474839918 rc 0/0 00000100:00100000:1.0:1746143120.196791:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11827 00000100:00100000:1.0:1746143120.196822:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143120.196830:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861164672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143120.196851:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143120.196877:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861164672 00000100:00100000:1.0:1746143120.196880:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861164672 00000100:00100000:1.0:1746143120.196896:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11830 00000100:00100000:1.0:1746143120.196901:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3300:x1830962861164672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.196937:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861162752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1087us (4614us total) trans 17179872667 rc 0/0 00000100:00100000:2.0:1746143120.196943:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11825 00000100:00100000:3.0:1746143120.197079:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861163648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1307us (4835us total) trans 17179872668 rc 0/0 00000100:00100000:3.0:1746143120.197085:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11823 00000100:00100000:1.0:1746143120.197268:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3300:x1830962861164672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 366us (415us total) trans 21474839919 rc 0/0 00000100:00100000:1.0:1746143120.197274:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11830 00000100:00100000:2.0:1746143120.197405:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861163136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1658us (5191us total) trans 17179872669 rc 0/0 00000100:00100000:2.0:1746143120.197410:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11822 00000004:00080000:1.0:1746143120.197664:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009535fb80/2, rc 0, transno 21474839919 00000100:00100000:1.0:1746143120.197671:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861164672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143120.197688:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861164032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143120.197710:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143120.197746:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861164544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143120.197761:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143120.197781:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb55500/2, rc 0, transno 17179872663 00000100:00100000:1.0:1746143120.197785:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861162880:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143120.197794:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb55f80/2, rc 0, transno 17179872664 00000100:00100000:1.0:1746143120.197797:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861163392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143120.197804:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb57480/2, rc 0, transno 17179872662 00000100:00100000:1.0:1746143120.197807:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861163520:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143120.197814:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb56d80/2, rc 0, transno 17179872666 00000100:00100000:1.0:1746143120.197817:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861163008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143120.197824:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143120.197828:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861163904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.197843:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861164032 00000100:00100000:1.0:1746143120.197843:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143120.197846:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861164032 00000100:00100000:2.0:1746143120.197865:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861164544 00000100:00100000:2.0:1746143120.197867:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861164544 00000100:00100000:1.0:1746143120.197889:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861164416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143120.197906:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143120.198022:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861163904 00000100:00100000:2.0:1746143120.198026:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861163904 00000100:00100000:2.0:1746143120.198056:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861164416 00000100:00100000:2.0:1746143120.198058:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861164416 00000100:00100000:1.0:1746143120.198069:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11831 00000100:00100000:1.0:1746143120.198075:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861164032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.198136:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11832 00000100:00100000:2.0:1746143120.198141:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861164544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.198152:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11833 00000100:00100000:2.0:1746143120.198155:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3302:x1830962861163904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143120.198181:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3302:x1830962861164032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (470us total) trans 21474839920 rc 0/0 00000100:00100000:1.0:1746143120.198187:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11831 00000100:00100000:1.0:1746143120.198199:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11834 00000100:00100000:1.0:1746143120.198203:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861164416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143120.198241:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3302:x1830962861163904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (396us total) trans 21474839921 rc 0/0 00000100:00100000:2.0:1746143120.198247:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11833 00000100:00100000:2.0:1746143120.198326:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3302:x1830962861164544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (563us total) trans 21474839922 rc 0/0 00000100:00100000:2.0:1746143120.198331:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11832 00002000:00010000:1.0:1746143120.198419:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143120.198422:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143120.198424:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143120.198425:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143120.198427:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143120.198460:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3302:x1830962861164416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 256us (552us total) trans 21474839923 rc 0/0 00000100:00100000:1.0:1746143120.198466:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11834 00000004:00080000:1.0:1746143120.198492:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb23480/2, rc 0, transno 21474839921 00000100:00100000:1.0:1746143120.198495:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861163904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143120.198501:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094513100/2, rc 0, transno 21474839923 00000100:00100000:1.0:1746143120.198504:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861164416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143120.198510:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb20e00/2, rc 0, transno 21474839920 00000100:00100000:1.0:1746143120.198512:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861164032:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143120.198518:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094512a00/2, rc 0, transno 21474839922 00000100:00100000:1.0:1746143120.198521:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861164544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143120.198534:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861163008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (5563us total) trans 17179872666 rc 0/0 00000004:00080000:1.0:1746143120.198539:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb55180/2, rc 0, transno 17179872667 00000100:00100000:0.0:1746143120.198541:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11829 00000100:00100000:1.0:1746143120.198542:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861162752:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143120.198549:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb56a00/2, rc 0, transno 17179872665 00000100:00100000:1.0:1746143120.198552:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861163264:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143120.198559:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb23800/2, rc 0, transno 21474839918 00000100:00100000:1.0:1746143120.198562:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861163776:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143120.198568:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094511500/2, rc 0, transno 21474839917 00000100:00100000:1.0:1746143120.198571:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861164288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143120.198578:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb57b80/2, rc 0, transno 17179872669 00000100:00100000:1.0:1746143120.198581:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861163136:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143120.198588:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb54e00/2, rc 0, transno 17179872668 00000100:00100000:1.0:1746143120.198590:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861163648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143120.198596:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094512300/2, rc 0, transno 21474839916 00000100:00100000:1.0:1746143120.198599:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861164160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143120.198672:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.198759:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858431488 00000100:00100000:2.0:1746143120.198762:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858431488 00000100:00100000:2.0:1746143120.198847:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8042 00000100:00100000:2.0:1746143120.198853:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30684:x1830962858431488:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143120.198869:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143120.198884:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f501 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.198933:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.198947:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.198963:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143120.198966:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143120.198969:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66de00, rc 0) 00000100:00100000:2.0:1746143120.199000:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30684:x1830962858431488:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 147us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.199005:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8042 00000100:00100000:0.0:1746143120.206215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143120.206828:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858431616 00000100:00100000:3.0:1746143120.206838:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858431616 00000100:00100000:3.0:1746143120.206896:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8043 00000100:00100000:3.0:1746143120.206906:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30684:x1830962858431616:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143120.206934:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143120.206955:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551200/0x25aee876ca70bdfa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f508 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.207062:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143120.207076:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143120.207087:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:3.0:1746143120.207113:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143120.207117:0:14795:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143120.207132:0:14795:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143120.207153:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551200/0x25aee876ca70bdfa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.207179:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143120.207187:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143120.207191:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143120.207194:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cd5000, rc 0) 00000100:00100000:3.0:1746143120.207250:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30684:x1830962858431616:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 334us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143120.207256:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8043 00000100:00100000:0.0:1746143120.209983:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.210024:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.210130:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858431744 00000100:00100000:2.0:1746143120.210136:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858431744 00000100:00100000:1.0:1746143120.210281:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858431872 00000100:00100000:1.0:1746143120.210285:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858431872 00000100:00100000:2.0:1746143120.210349:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11835 00000100:00100000:2.0:1746143120.210356:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858431744:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143120.210372:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143120.210388:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f50f expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143120.210413:0:20836:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x6814078e, atime: 0x6814078b, ctime: 0x6814078e, blocks: 0x7d1 00010000:00010000:2.0:1746143120.210432:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.210434:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.210453:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 6 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.210471:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 6 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.210481:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66dc00, rc 0) 00000100:00100000:0.0:1746143120.210510:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.210515:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858431744:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 160us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.210521:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11835 00000100:00100000:2.0:1746143120.210925:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858432000 00000100:00100000:2.0:1746143120.210929:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858432000 00000100:00100000:1.0:1746143120.210933:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11836 00000100:00100000:1.0:1746143120.210938:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858431872:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143120.210947:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143120.210961:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f516 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143120.210967:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11837 00000100:00100000:2.0:1746143120.210972:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858432000:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143120.210978:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746143120.210978:0:26949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x6814078d, atime: 0x6814078d, ctime: 0x6814078d, blocks: 0x821 00010000:00010000:2.0:1746143120.210986:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f51d expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143120.210989:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.210991:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143120.211005:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 7 pid: 26949 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746143120.211007:0:20836:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x6814078d, atime: 0x6814078d, ctime: 0x6814078d, blocks: 0x81f 00010000:00010000:2.0:1746143120.211013:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.211014:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.211017:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143120.211017:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 8 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143120.211024:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd2000, rc 0) 00010000:00010000:2.0:1746143120.211026:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.211051:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66ce00, rc 0) 00000100:00100000:1.0:1746143120.211060:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858431872:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 122us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.211063:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858432000:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 92us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143120.211066:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11836 00000100:00100000:2.0:1746143120.211068:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11837 00000100:00100000:0.0:1746143120.211144:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143120.211172:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.211191:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858432128 00000100:00100000:2.0:1746143120.211195:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858432128 00000100:00100000:2.0:1746143120.211209:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858432384 00000100:00100000:2.0:1746143120.211211:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858432384 00000100:00100000:2.0:1746143120.211224:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11838 00000100:00100000:0.0:1746143120.211225:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143120.211228:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858432128:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143120.211235:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143120.211241:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858432256 00000100:00100000:0.0:1746143120.211243:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858432256 00000100:00100000:0.0:1746143120.211261:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11839 00000100:00100000:0.0:1746143120.211266:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858432384:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143120.211273:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143120.211281:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f532 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143120.211294:0:4758:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x6814078e, atime: 0x6814078d, ctime: 0x6814078e, blocks: 0x1029 00010000:00010000:0.0:1746143120.211301:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.211303:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.211307:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143120.211317:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143120.211324:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444a00, rc 0) 00000100:00100000:0.0:1746143120.211344:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858432384:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143120.211349:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11839 00000100:00100000:0.0:1746143120.211360:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11840 00010000:00010000:2.0:1746143120.211364:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f524 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143120.211365:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858432256:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143120.211371:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746143120.211376:0:20836:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x6814078e, atime: 0x6814078e, ctime: 0x6814078e, blocks: 0x821 00010000:00010000:0.0:1746143120.211377:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f52b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143120.211384:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746143120.211386:0:4758:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x6814078e, atime: 0x6814078e, ctime: 0x6814078e, blocks: 0x180b 00010000:00010000:0.0:1746143120.211392:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.211394:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143120.211397:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143120.211406:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143120.211414:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094445a00, rc 0) 00000100:00100000:0.0:1746143120.211429:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858432256:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 64us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143120.211434:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11840 00010000:00010000:2.0:1746143120.211463:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143120.211468:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.211479:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143120.211491:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d9e00, rc 0) 00000100:00100000:2.0:1746143120.211510:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858432128:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 281us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143120.211515:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11838 00010000:00010000:1.0:1746143120.493261:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143121.143271:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.143383:0:14792:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858432512 00000100:00100000:1.0:1746143121.143393:0:14792:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858432512 00000100:00100000:1.0:1746143121.143483:0:14792:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 226 00000100:00100000:1.0:1746143121.143493:0:14792:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1969:x1830962858432512:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:1.0:1746143121.143566:0:14792:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1969:x1830962858432512:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.143573:0:14792:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 226 00000100:00100000:0.0:1746143121.146481:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.146523:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.146540:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.146554:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.146568:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.146679:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858432640 00000100:00100000:3.0:1746143121.146686:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858432640 00000100:00100000:3.0:1746143121.147589:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858433408 00000100:00100000:3.0:1746143121.147593:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858433408 00000100:00100000:0.0:1746143121.147603:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.147624:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 222 00000100:00100000:3.0:1746143121.147631:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:1968:x1830962858432640:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:1.0:1746143121.147651:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 223 00000100:00100000:1.0:1746143121.147657:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858433408:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:3.0:1746143121.147701:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:1968:x1830962858432640:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 70us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.147701:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858433408:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 45us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.147707:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 223 00000100:00100000:3.0:1746143121.147709:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 222 00000100:00100000:0.0:1746143121.149968:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.149991:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858433024 00000100:00100000:0.0:1746143121.149997:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858433024 00000100:00100000:0.0:1746143121.150028:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 224 00000100:00100000:0.0:1746143121.150049:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:1968:x1830962858433024:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:0.0:1746143121.150097:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:1968:x1830962858433024:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 49us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.150103:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 224 00000100:00100000:0.0:1746143121.150175:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.150235:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858432896 00000100:00100000:2.0:1746143121.150240:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858432896 00000100:00100000:2.0:1746143121.150267:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858433152 00000100:00100000:2.0:1746143121.150269:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858433152 00000100:00100000:2.0:1746143121.150285:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858433664 00000100:00100000:2.0:1746143121.150288:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858433664 00000100:00100000:2.0:1746143121.150299:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858432768 00000100:00100000:2.0:1746143121.150301:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858432768 00000100:00100000:2.0:1746143121.150321:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 438 00000100:00100000:2.0:1746143121.150327:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858432896:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:2.0:1746143121.150353:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858432896:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 26us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.150358:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 438 00000100:00100000:2.0:1746143121.150368:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 439 00000100:00100000:2.0:1746143121.150372:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858433152:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:2.0:1746143121.150390:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858433152:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 18us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.150395:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 439 00000100:00100000:2.0:1746143121.150403:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 440 00000100:00100000:2.0:1746143121.150407:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858433664:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:2.0:1746143121.150442:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858433664:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 33us (3872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.150447:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 440 00000100:00100000:2.0:1746143121.150573:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 441 00000100:00100000:2.0:1746143121.150578:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858432768:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:2.0:1746143121.150599:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858432768:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 21us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.150604:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 441 00000100:00080000:2.0:1746143121.150620:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746143121.150625:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143121.152280:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.152575:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858433280 00000100:00100000:1.0:1746143121.152582:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858433280 00000100:00100000:3.0:1746143121.152694:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858433536 00000100:00100000:3.0:1746143121.152697:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858433536 00000100:00100000:3.0:1746143121.152723:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 442 00000100:00100000:3.0:1746143121.152728:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858433536:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:1.0:1746143121.152881:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 443 00000100:00100000:1.0:1746143121.152887:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858433280:12345-192.168.201.28@tcp:400:kworker.0 00000100:00080000:2.0:1746143121.152973:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143121.153047:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858433536:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 302us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.153053:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 442 00000100:00100000:1.0:1746143121.153159:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858433280:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 271us (2983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.153166:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 443 00000100:00100000:0.0:1746143121.239612:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.239890:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858433920 00000100:00100000:1.0:1746143121.239901:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858433920 00000100:00100000:1.0:1746143121.240615:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5738 00000100:00100000:1.0:1746143121.240625:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858433920:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143121.240666:0:31432:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.240682:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.240684:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.240691:0:31432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.240707:0:31432:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.242925:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.242964:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.243081:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858434176 00000100:00100000:2.0:1746143121.243091:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858434176 00000100:00100000:0.0:1746143121.243122:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.243139:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858434432 00000100:00100000:0.0:1746143121.243140:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858434688 00000100:00100000:2.0:1746143121.243142:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858434432 00000100:00100000:0.0:1746143121.243142:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858434688 00000100:00100000:2.0:1746143121.243158:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5739 00000100:00100000:2.0:1746143121.243164:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858434176:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143121.243198:0:21521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.243211:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.243213:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.243219:0:21521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.243234:0:21521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.244084:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5740 00000100:00100000:0.0:1746143121.244092:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858434432:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143121.244111:0:31806:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.244120:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.244121:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.244124:0:31806:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.244133:0:31806:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143121.244392:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5741 00000100:00100000:3.0:1746143121.244401:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858434688:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143121.244419:0:8455:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.244451:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.244452:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.244455:0:8455:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.244464:0:8455:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.257753:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.258725:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.259645:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.259685:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858435200 00000100:00100000:3.0:1746143121.259696:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858435200 00000100:00100000:3.0:1746143121.259754:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858435072 00000100:00100000:3.0:1746143121.259756:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858435072 00000100:00100000:3.0:1746143121.259779:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5742 00000100:00100000:3.0:1746143121.259787:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858435200:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143121.259829:0:8454:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.259845:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.259847:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.259852:0:8454:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.259866:0:8454:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.260405:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858435584 00000100:00100000:2.0:1746143121.260410:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858435584 00000100:00100000:2.0:1746143121.260642:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5743 00000100:00100000:2.0:1746143121.260648:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858435072:12345-192.168.201.28@tcp:3:mirror_io.0 00000100:00100000:1.0:1746143121.260648:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5744 00000100:00100000:1.0:1746143121.260655:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858435584:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143121.260665:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.260672:0:31431:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.260673:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.260674:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.260678:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.260680:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.260682:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.260684:0:31431:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.260687:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.260693:0:31431:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.266545:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.266578:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858435456 00000100:00100000:2.0:1746143121.266586:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858435456 00000100:00100000:2.0:1746143121.266642:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5745 00000100:00100000:2.0:1746143121.266650:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858435456:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143121.266690:0:21522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.266707:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.266710:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.266717:0:21522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.266732:0:21522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.286024:0:31806:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.286076:0:31806:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.286086:0:31806:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.286092:0:31806:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094444400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143121.288508:0:31806:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.288529:0:31806:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.288553:0:31806:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.288560:0:31806:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094444400/0x25aee876ca70be40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.288703:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858434432:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 44604us (45729us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143121.288716:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5740 00010000:00010000:3.0:1746143121.304318:0:8455:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.304338:0:8455:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.304347:0:8455:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.304354:0:8455:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e551a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143121.304358:0:8455:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.304366:0:8455:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.304385:0:8455:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.304391:0:8455:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e551a00/0x25aee876ca70be47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143121.315378:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858434688:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 70965us (72241us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143121.315392:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5741 00010000:00010000:3.0:1746143121.324753:0:21521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.324772:0:21521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.324781:0:21521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.324789:0:21521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecf8a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143121.324793:0:21521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.324801:0:21521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.324833:0:21521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.324840:0:21521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70be39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143121.324947:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858434176:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 81771us (82022us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143121.324958:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5739 00010000:00010000:1.0:1746143121.330612:0:31432:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.330631:0:31432:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.330638:0:31432:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.330645:0:31432:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5cd3c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143121.330650:0:31432:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.330657:0:31432:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.330676:0:31432:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.330682:0:31432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70be32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.330995:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858433920:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 90367us (91390us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143121.331011:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5738 00010000:00010000:3.0:1746143121.340957:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.340979:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.340989:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.341000:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecf8600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143121.341005:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.341025:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.341063:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.341069:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8600/0x25aee876ca70be55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143121.341177:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858435072:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 80523us (82448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143121.341188:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5743 00010000:00010000:1.0:1746143121.348127:0:31431:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.348149:0:31431:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.348158:0:31431:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.348165:0:31431:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5cd3800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143121.348170:0:31431:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.348181:0:31431:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.348212:0:31431:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.348218:0:31431:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3800/0x25aee876ca70be5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.348319:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858435584:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 87659us (88670us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143121.348329:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5744 00010000:00010000:3.0:1746143121.358056:0:8454:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.358075:0:8454:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.358083:0:8454:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.358098:0:8454:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cf9a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143121.358102:0:8454:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.358112:0:8454:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.358135:0:8454:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.358155:0:8454:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cf9a00/0x25aee876ca70be4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143121.358255:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858435200:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 98455us (100501us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143121.358265:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5742 00010000:00010000:2.0:1746143121.360415:0:21522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.360437:0:21522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.360445:0:21522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.360451:0:21522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecf9c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143121.360454:0:21522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.360460:0:21522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.360474:0:21522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.360480:0:21522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.360561:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858435456:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 93906us (94020us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143121.360570:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5745 00000100:00100000:0.0:1746143121.378775:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.378888:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858435840 00000100:00100000:1.0:1746143121.378902:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858435840 00000100:00100000:1.0:1746143121.379060:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 606 00000100:00100000:1.0:1746143121.379076:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30684:x1830962858435840:12345-192.168.201.28@tcp:103:mirror_io.0 00010000:00010000:1.0:1746143121.379105:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.379134:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70bdad lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f4f3 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.379169:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143121.379174:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143121.379219:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30684:x1830962858435840:12345-192.168.201.28@tcp:103:mirror_io.0 Request processed in 144us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.379225:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 606 00000100:00100000:0.0:1746143121.383986:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.384076:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858436096 00000100:00100000:2.0:1746143121.384086:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858436096 00000100:00100000:2.0:1746143121.384158:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3377 00000100:00100000:2.0:1746143121.384173:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30684:x1830962858436096:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143121.387023:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30684:x1830962858436096:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 2841us (3231us total) trans 8589942251 rc 0/0 00000100:00100000:2.0:1746143121.387645:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3377 00000100:00100000:0.0:1746143121.389085:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.389217:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858436352 00000100:00100000:2.0:1746143121.389225:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858436352 00000100:00100000:2.0:1746143121.389435:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3378 00000100:00100000:2.0:1746143121.389444:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30684:x1830962858436352:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143121.389719:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30684:x1830962858436352:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 275us (635us total) trans 8589942252 rc 0/0 00000100:00100000:2.0:1746143121.389732:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3378 00000100:00100000:0.0:1746143121.431576:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.437294:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.437403:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858436608 00000100:00100000:3.0:1746143121.437416:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858436608 00000100:00100000:3.0:1746143121.437469:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858436864 00000100:00100000:3.0:1746143121.437471:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858436864 00000100:00100000:3.0:1746143121.437513:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8044 00000100:00100000:3.0:1746143121.437521:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:30694:x1830962858436608:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143121.437549:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143121.437575:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9a00/0x25aee876ca70be6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f539 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.437724:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.437743:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.437754:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.437773:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.437779:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.437789:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.437923:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.437931:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.437942:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143121.437950:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143121.438088:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438095:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438101:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438111:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cf8a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143121.438115:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438122:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438134:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143121.438137:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143121.438140:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438145:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8a00/0x25aee876ca70be71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438160:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438164:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438169:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438173:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cd4e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143121.438174:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438178:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438183:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094939900) 00010000:00010000:3.0:1746143121.438185:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143121.438187:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438191:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd4e00/0x25aee876ca70be78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438246:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9a00/0x25aee876ca70be6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.438262:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.438268:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143121.438270:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143121.438272:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8800, rc 0) 00000100:00100000:3.0:1746143121.438324:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30694:x1830962858436608:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 803us (6763us total) trans 8589942253 rc 0/0 00000100:00100000:3.0:1746143121.438330:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8044 00000100:00100000:3.0:1746143121.438349:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8045 00000100:00100000:3.0:1746143121.438354:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:30697:x1830962858436864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143121.438360:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143121.438371:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f540 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.438410:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438432:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438438:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438447:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438456:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438461:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438524:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438532:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438538:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143121.438543:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143121.438592:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438603:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438607:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438612:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecf8400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143121.438614:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438624:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438631:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143121.438633:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143121.438635:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438640:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8400/0x25aee876ca70be94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438653:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438657:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438661:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438670:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecf8200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143121.438672:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438677:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438683:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800aac68300) 00010000:00010000:3.0:1746143121.438684:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143121.438686:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438691:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8200/0x25aee876ca70be9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143121.438719:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70be8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.438733:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.438738:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143121.438740:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143121.438742:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8600, rc 0) 00000100:00100000:3.0:1746143121.438764:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30697:x1830962858436864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 411us (1484us total) trans 8589942254 rc 0/0 00000100:00100000:3.0:1746143121.438769:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8045 00000100:00100000:0.0:1746143121.446635:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.446729:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858437248 00000100:00100000:1.0:1746143121.446960:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858437248 00000100:00100000:1.0:1746143121.447010:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11841 00000100:00100000:1.0:1746143121.447018:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858437248:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143121.447056:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143121.447073:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f54e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.447102:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.447104:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.447114:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 30 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.447130:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 30 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.447148:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3c00, rc 0) 00000100:00100000:1.0:1746143121.447196:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858437248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 178us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.447202:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11841 00000100:00100000:3.0:1746143121.447393:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.447433:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858437120 00000100:00100000:0.0:1746143121.447437:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858437120 00000100:00100000:0.0:1746143121.447478:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8046 00000100:00100000:0.0:1746143121.447485:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30691:x1830962858437120:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143121.447499:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.447511:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200200/0x25aee876ca70beb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f547 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143121.447542:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143121.447610:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143121.447621:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.447627:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.447638:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.447643:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143121.447671:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.447687:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 200 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.447701:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861164800:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.447767:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.447774:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 7 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.447781:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861164928:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.447801:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.447807:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 9 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.447814:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861165056:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143121.447828:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.447849:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.447876:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.447898:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.447910:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858437632 00000100:00100000:0.0:1746143121.447912:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858437632 00000100:00100000:0.0:1746143121.447926:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858437760 00000100:00100000:0.0:1746143121.447928:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858437760 00000100:00100000:1.0:1746143121.448267:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858437888 00000100:00100000:1.0:1746143121.448270:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858437888 00000100:00100000:1.0:1746143121.448288:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11842 00000100:00100000:1.0:1746143121.448293:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858437632:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143121.448301:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143121.448310:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f55c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.448322:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.448324:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.448328:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143121.448361:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11843 00000100:00100000:0.0:1746143121.448367:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858437760:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.448373:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.448380:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f563 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.448389:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.448391:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.448395:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 25 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.448405:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 25 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.448413:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cd4e00, rc 0) 00000100:00100000:0.0:1746143121.448443:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858437760:12345-192.168.201.28@tcp:101:cat.0 Request processed in 76us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.448449:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11843 00000100:00100000:0.0:1746143121.448460:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11844 00000100:00100000:0.0:1746143121.448465:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858437888:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.448470:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.448477:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f56a expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.448487:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.448488:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.448492:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 31 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.448506:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 31 pid: 26949 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143121.449097:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143121.449102:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143121.449108:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858438016 00010000:00010000:1.0:1746143121.449110:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3600, rc 0) 00000100:00100000:3.0:1746143121.449111:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858438016 00000100:00100000:1.0:1746143121.449126:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858437632:12345-192.168.201.28@tcp:101:cat.0 Request processed in 833us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.449132:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11845 00000100:00100000:1.0:1746143121.449268:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11842 00000100:00100000:3.0:1746143121.449625:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858438016:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143121.449632:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143121.449640:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f571 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.449658:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.449659:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.449664:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 33 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.449669:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b200000, rc 0) 00010000:00010000:3.0:1746143121.449678:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 33 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143121.449686:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf9800, rc 0) 00000100:00100000:0.0:1746143121.449688:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858437888:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1222us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.449693:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11844 00000100:00100000:3.0:1746143121.449706:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858438016:12345-192.168.201.28@tcp:101:cat.0 Request processed in 569us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.449711:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11845 00000100:00100000:2.0:1746143121.449994:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858437504 00000100:00100000:2.0:1746143121.449998:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858437504 00000100:00100000:2.0:1746143121.450021:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8047 00000100:00100000:2.0:1746143121.450025:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30696:x1830962858437504:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143121.450046:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.450055:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22c00/0x25aee876ca70bee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f555 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.450128:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143121.450143:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143121.450152:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143121.450167:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143121.450339:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22c00/0x25aee876ca70bee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 11 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.450372:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.450380:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143121.450383:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143121.450386:0:14795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143121.450392:0:14795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143121.450397:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f22000, rc 0) 00000100:00100000:2.0:1746143121.452697:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30696:x1830962858437504:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2664us (5148us total) trans 8589942255 rc 0/0 00000100:00100000:2.0:1746143121.452707:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8047 00000100:00100000:2.0:1746143121.453109:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.457727:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858438144 00000100:00100000:0.0:1746143121.457739:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858438144 00000100:00100000:0.0:1746143121.457963:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11846 00000100:00100000:0.0:1746143121.457970:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858438144:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.457986:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.458003:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f578 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.458027:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.458054:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.458062:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 25 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.458077:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 25 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.458087:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b200600, rc 0) 00000100:00100000:0.0:1746143121.458138:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858438144:12345-192.168.201.28@tcp:101:cat.0 Request processed in 169us (5031us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.458145:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11846 00000100:00100000:2.0:1746143121.458780:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.458817:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.458851:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858438272 00000100:00100000:3.0:1746143121.458856:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858438272 00000100:00100000:2.0:1746143121.458857:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.458886:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858438400 00000100:00100000:2.0:1746143121.458889:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858438400 00010000:00010000:3.0:1746143121.458892:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 201 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143121.458905:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 10 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143121.458912:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858438528 00000100:00100000:3.0:1746143121.458914:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858438528 00010000:00010000:3.0:1746143121.458922:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 10 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143121.458922:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6259 00000100:00100000:2.0:1746143121.458929:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1971:x1830962858438272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143121.458939:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143121.458942:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6260 00010000:00010000:2.0:1746143121.458944:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 201 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143121.458947:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858438400:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143121.458954:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 201 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.458958:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143121.458963:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 10 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143121.458970:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143121.458975:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143121.458982:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143121.458987:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143121.459006:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1971:x1830962858438272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.459012:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6261 00000100:00100000:1.0:1746143121.459048:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858438528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143121.459056:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.459060:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 10 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143121.459114:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6259 00010000:00010000:3.0:1746143121.459141:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 10 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.459154:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143121.459158:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143121.459167:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143121.459179:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143121.459214:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858438400:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 267us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.459220:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6260 00010000:00010000:1.0:1746143121.459261:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 10 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.459273:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143121.459276:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143121.459282:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143121.459288:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143121.459304:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143121.459350:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858438528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 331us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.459359:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6261 00000100:00100000:3.0:1746143121.459469:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143121.459474:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8600/0x25aee876ca70bea2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f540 expref: 200 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.459491:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861164800:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.459502:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf8800/0x25aee876ca70be7f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f539 expref: 9 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.459510:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861164928:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.459528:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70be01 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f508 expref: 9 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.459540:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861165056:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.459558:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143121.459566:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143121.459571:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:0.0:1746143121.459590:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:1.0:1746143121.459657:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858438656 00000100:00100000:1.0:1746143121.459661:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858438656 00000100:00100000:1.0:1746143121.459684:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8048 00000100:00100000:1.0:1746143121.459689:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30696:x1830962858438656:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143121.459704:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.460022:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200200/0x25aee876ca70beb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.460051:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.460062:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143121.460065:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143121.460067:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b201200, rc 0) 00000100:00100000:0.0:1746143121.460090:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30691:x1830962858437120:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 12605us (12702us total) trans 8589942256 rc 0/0 00000100:00100000:0.0:1746143121.460095:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8046 00010000:00010000:1.0:1746143121.460278:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bf04 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f57f expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.460345:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.460356:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.460362:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.460385:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.460742:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.461017:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858438784 00000100:00100000:3.0:1746143121.461021:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858438784 00000100:00100000:3.0:1746143121.461074:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8049 00000100:00100000:3.0:1746143121.461081:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30697:x1830962858438784:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143121.461089:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143121.461097:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70bf12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f586 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.463692:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 201 pid: 14796 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143121.463710:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861165184:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143121.463809:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143121.464192:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70bf12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f586 expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.464212:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70bf12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f586 expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.464244:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143121.464247:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143121.464250:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf9c00, rc 0) 00000100:00100000:3.0:1746143121.464297:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30697:x1830962858438784:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3214us (3553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.464309:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8049 00000100:00100000:1.0:1746143121.492678:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861165184:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143121.492704:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143121.493085:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.493372:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858438912 00000100:00100000:1.0:1746143121.493379:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858438912 00010000:00010000:1.0:1746143121.493413:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 201 pid: 14796 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143121.493462:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6262 00000100:00100000:1.0:1746143121.493470:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858438912:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143121.493484:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.493490:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 201 pid: 14796 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.493501:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 201 pid: 14796 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.493659:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b201200/0x25aee876ca70bebe lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f547 expref: 201 pid: 14796 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.493690:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143121.493694:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.493702:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.493709:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.493727:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143121.493774:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1969:x1830962858438912:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 305us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.493780:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6262 00010000:00010000:1.0:1746143121.493799:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.493804:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:1.0:1746143121.493856:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143121.493861:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143121.493879:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.493910:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bf04 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 11 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.493923:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.493929:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143121.493932:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143121.493935:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd3400, rc 0) 00000100:00100000:1.0:1746143121.493964:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30696:x1830962858438656:12345-192.168.201.28@tcp:101:cat.0 Request processed in 34275us (34495us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.493971:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8048 00000100:00100000:0.0:1746143121.494183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.494506:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858439040 00000100:00100000:1.0:1746143121.494510:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858439040 00000100:00100000:1.0:1746143121.494542:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8050 00000100:00100000:1.0:1746143121.494548:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30691:x1830962858439040:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143121.494566:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143121.494578:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f58d expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.494610:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f58d expref: 201 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.494618:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f58d expref: 201 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.494636:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143121.494639:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143121.494641:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd2800, rc 0) 00000100:00100000:1.0:1746143121.494720:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30691:x1830962858439040:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 171us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.494726:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8050 00010000:00010000:0.0:1746143121.495171:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143121.498025:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.498710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.498762:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.498795:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858439296 00000100:00100000:3.0:1746143121.498804:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858439296 00000100:00100000:0.0:1746143121.498814:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.498842:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858439552 00000100:00100000:3.0:1746143121.498844:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858439552 00002000:00100000:3.0:1746143121.498881:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009f35aa00 x1830962858439552/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.498891:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35aa00 with x1830962858439552 ext(1048576->2097151) 00002000:00010000:3.0:1746143121.498896:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f35aa00 00000100:00100000:3.0:1746143121.498911:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858439808 00000100:00100000:3.0:1746143121.498912:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858439808 00002000:00100000:3.0:1746143121.498920:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009f359180 x1830962858439808/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.498926:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f359180 with x1830962858439808 ext(1048576->2097151) 00002000:00010000:3.0:1746143121.498929:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f359180 00000100:00100000:1.0:1746143121.498937:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858440064 00000100:00100000:1.0:1746143121.498943:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858440064 00000100:00100000:3.0:1746143121.498946:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5746 00000100:00100000:3.0:1746143121.498952:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858439552:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:1.0:1746143121.498968:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f358000 x1830962858440064/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.498977:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358000 with x1830962858440064 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.498982:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f358000 00000100:00100000:1.0:1746143121.498999:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5747 00000100:00100000:1.0:1746143121.499005:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858439808:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143121.499466:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5748 00000100:00100000:1.0:1746143121.499475:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858440064:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:3.0:1746143121.499560:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88012baa0a80 x1830962858439296/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.499568:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0a80 with x1830962858439296 ext(0->1048575) 00002000:00010000:3.0:1746143121.499572:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0a80 00000100:00100000:0.0:1746143121.502251:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5749 00000100:00100000:0.0:1746143121.502267:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858439296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143121.513107:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.513156:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.513157:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858440192 00000100:00100000:2.0:1746143121.513167:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858440192 00000100:00100000:2.0:1746143121.513215:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11847 00000100:00100000:2.0:1746143121.513224:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858440192:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143121.513244:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.513264:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f594 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.513292:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.513294:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.513308:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 17 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.513324:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 17 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.513337:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094234e00, rc 0) 00000100:00100000:2.0:1746143121.513385:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858440192:12345-192.168.201.28@tcp:101:cat.0 Request processed in 162us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.513390:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11847 00000100:00100000:1.0:1746143121.513518:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858440320 00000100:00100000:1.0:1746143121.513523:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858440320 00000100:00100000:1.0:1746143121.513554:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 607 00000100:00100000:1.0:1746143121.513560:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1970:x1830962858440320:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143121.513571:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.513590:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f58d expref: 201 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.513622:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143121.513626:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143121.513657:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1970:x1830962858440320:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 97us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.513664:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 607 00000100:00100000:0.0:1746143121.518123:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.518166:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.518191:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.518214:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858440704 00000100:00100000:0.0:1746143121.518222:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858440704 00000100:00100000:0.0:1746143121.518266:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858440832 00000100:00100000:0.0:1746143121.518269:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858440832 00000100:00100000:0.0:1746143121.518286:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11848 00000100:00100000:0.0:1746143121.518293:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858440704:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.518313:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.518331:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5a2 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.518365:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518367:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518375:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 25 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518392:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 25 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518404:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b200800, rc 0) 00000100:00100000:0.0:1746143121.518459:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858440704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 165us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.518465:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11848 00000100:00100000:0.0:1746143121.518478:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11849 00000100:00100000:0.0:1746143121.518484:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858440832:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.518490:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.518496:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5a9 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.518506:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518508:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518512:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 25 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518525:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 25 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518533:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b201400, rc 0) 00000100:00100000:0.0:1746143121.518549:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1970:x1830962858440832:12345-192.168.201.28@tcp:101:cat.0 Request processed in 65us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.518554:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11849 00000100:00100000:0.0:1746143121.518580:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.518593:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858440960 00000100:00100000:0.0:1746143121.518595:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858440960 00000100:00100000:0.0:1746143121.518611:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11850 00000100:00100000:0.0:1746143121.518615:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858440960:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.518623:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.518633:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5b0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.518644:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518646:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518650:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518660:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518666:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b200e00, rc 0) 00000100:00100000:0.0:1746143121.518681:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858440960:12345-192.168.201.28@tcp:101:cat.0 Request processed in 66us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.518687:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11850 00000100:00100000:0.0:1746143121.518733:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.518745:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858441088 00000100:00100000:0.0:1746143121.518747:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858441088 00000100:00100000:0.0:1746143121.518762:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11851 00000100:00100000:0.0:1746143121.518766:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858441088:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.518772:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.518779:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5b7 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.518791:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518792:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518797:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 19 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518813:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 19 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518821:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b201600, rc 0) 00000100:00100000:0.0:1746143121.518836:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858441088:12345-192.168.201.28@tcp:101:cat.0 Request processed in 69us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.518840:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858440576 00000100:00100000:0.0:1746143121.518841:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11851 00000100:00100000:1.0:1746143121.518845:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858440576 00000100:00100000:0.0:1746143121.518878:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.518890:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858441216 00000100:00100000:0.0:1746143121.518893:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858441216 00000100:00100000:1.0:1746143121.518894:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8051 00000100:00100000:1.0:1746143121.518901:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30691:x1830962858440576:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:0.0:1746143121.518906:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11852 00000100:00100000:0.0:1746143121.518910:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858441216:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143121.518912:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143121.518914:0:1037:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143121.518916:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.518922:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5be expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.518932:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.518933:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.518934:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70bf12 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f586 expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.518937:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 26 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.518945:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 26 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.518952:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143121.518952:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b201000, rc 0) 00010000:00010000:1.0:1746143121.518956:0:1037:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143121.518964:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bf4a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f59b expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.518967:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858441216:12345-192.168.201.28@tcp:101:cat.0 Request processed in 56us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.518971:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11852 00010000:00010000:1.0:1746143121.519011:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.519022:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.519059:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.519072:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.519078:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.519106:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.519118:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143121.519130:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861165312:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143121.519776:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.519786:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 9 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143121.519795:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861165440:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143121.519828:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.519837:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 8 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143121.519845:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094516680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861165568:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143121.519862:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143121.538617:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858439552:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39653us (39897us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143121.538629:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5746 00002000:00100000:3.0:1746143121.538640:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009f35aa00 x1830962858439552/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.538650:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35aa00 with x1830962858439552 ext(1048576->2097151) 00002000:00010000:3.0:1746143121.538656:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f35aa00 00000100:00100000:0.0:1746143121.549409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.549470:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.549521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.549658:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861165312:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143121.549679:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861165440:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143121.549689:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094516680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861165568:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143121.549728:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:3.0:1746143121.550607:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858441472 00000100:00100000:2.0:1746143121.550607:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858441344 00000100:00100000:3.0:1746143121.550614:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858441472 00000100:00100000:2.0:1746143121.550614:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858441344 00010000:00010000:3.0:1746143121.550648:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 11 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143121.550659:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 11 pid: 1037 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.550659:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.550680:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858441600 00000100:00100000:3.0:1746143121.550683:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858441600 00000100:00100000:2.0:1746143121.550690:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6263 00010000:00010000:3.0:1746143121.550693:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 9 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143121.550699:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858441472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143121.550709:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6264 00000100:00100000:3.0:1746143121.550714:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858441344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143121.550727:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143121.550727:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143121.550733:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 11 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.550743:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 11 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143121.550743:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 11 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143121.550753:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 11 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.550771:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd3400/0x25aee876ca70bf0b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f57f expref: 11 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.550802:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143121.550803:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22000/0x25aee876ca70bee8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f555 expref: 10 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.550807:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143121.550816:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143121.550821:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143121.550833:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143121.550838:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.550844:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.550849:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143121.550862:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858441344:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 147us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.550869:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6264 00000100:00100000:0.0:1746143121.550876:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6265 00000100:00100000:2.0:1746143121.550877:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858441472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 180us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.550891:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858441600:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143121.550897:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6263 00010000:00010000:0.0:1746143121.550900:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.550911:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 9 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.550921:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 9 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.550940:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66de00/0x25aee876ca70bdf3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f501 expref: 9 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.550971:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143121.550980:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143121.550988:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143121.550994:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143121.551017:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.551077:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858441600:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 182us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.551083:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6265 00010000:00010000:0.0:1746143121.551216:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143121.551223:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000040:00080000:0.0:1746143121.552344:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2305, 88 off195544 00000004:00080000:0.0:1746143121.552361:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903392328800ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.552449:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2332, 88 off197664 00000004:00080000:0.0:1746143121.552455:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903392423649ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143121.552698:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2333, 88 off197752 00000004:00080000:0.0:1746143121.552702:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903392670255ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143121.552711:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2306, 88 off195632 00000004:00080000:0.0:1746143121.552715:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903392683102ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.552721:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2307, 88 off195720 00000004:00080000:0.0:1746143121.552723:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903392691974ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.552734:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2334, 88 off197840 00000004:00080000:0.0:1746143121.552772:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903392740662ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143121.552788:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2335, 88 off197928 00000004:00080000:0.0:1746143121.552791:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903392759478ns, next at 860119223596ns, rc = 0 00000100:00100000:1.0:1746143121.552840:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858441728 00000100:00100000:1.0:1746143121.552845:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858441728 00000100:00100000:1.0:1746143121.552891:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8052 00000100:00100000:1.0:1746143121.552897:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30696:x1830962858441728:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143121.552914:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143121.552927:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5c5 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1746143121.559444:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2336, 88 off198016 00000004:00080000:0.0:1746143121.559458:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903399426230ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143121.559483:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2308, 88 off195808 00000004:00080000:0.0:1746143121.559487:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903399455307ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.559509:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2337, 88 off198104 00000004:00080000:0.0:1746143121.559513:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903399481378ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143121.559520:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2309, 88 off195896 00000004:00080000:0.0:1746143121.559523:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903399491595ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.559530:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2338, 88 off198192 00000004:00080000:0.0:1746143121.559533:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903399501270ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143121.559540:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2310, 88 off195984 00000004:00080000:0.0:1746143121.559542:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903399511060ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.559550:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2311, 88 off196072 00000004:00080000:0.0:1746143121.559552:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903399521072ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.559559:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2312, 88 off196160 00000004:00080000:0.0:1746143121.559562:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903399530471ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.559569:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2313, 88 off196248 00000004:00080000:0.0:1746143121.559572:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903399540222ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143121.559578:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2339, 88 off198280 00000004:00080000:0.0:1746143121.559580:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903399548870ns, next at 860119223596ns, rc = 0 00010000:00010000:1.0:1746143121.559735:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.559756:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.559782:0:14795:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143121.559797:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.559817:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143121.559820:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143121.559828:0:14795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.559835:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f4600, rc 0) 00000100:00100000:1.0:1746143121.559896:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30696:x1830962858441728:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6997us (9236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.559906:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8052 00000100:00100000:0.0:1746143121.560316:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1971:x1830962858439296:12345-192.168.201.28@tcp:3:cat.0 Request processed in 58055us (62300us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143121.560326:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5749 00002000:00100000:0.0:1746143121.560335:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88012baa0a80 x1830962858439296/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143121.560344:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0a80 with x1830962858439296 ext(0->1048575) 00002000:00010000:0.0:1746143121.560350:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0a80 00000100:00100000:1.0:1746143121.579296:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858439808:12345-192.168.201.28@tcp:3:cat.0 Request processed in 80280us (80524us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143121.579309:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5747 00002000:00100000:1.0:1746143121.579321:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009f359180 x1830962858439808/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.579331:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f359180 with x1830962858439808 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.579338:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f359180 00000100:00100000:0.0:1746143121.581223:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.581258:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858441856 00000100:00100000:0.0:1746143121.581273:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858441856 00000100:00100000:0.0:1746143121.581316:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8053 00000100:00100000:0.0:1746143121.581324:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:30697:x1830962858441856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.581343:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.581359:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5cc expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.581415:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 203 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.581442:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 203 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.581454:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143121.581457:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143121.581461:0:14795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.581473:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f23800, rc 0) 00000100:00100000:0.0:1746143121.581540:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:30697:x1830962858441856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 216us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.581547:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8053 00000100:00100000:0.0:1746143121.587085:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1971:x1830962858440064:12345-192.168.201.28@tcp:3:cat.0 Request processed in 87600us (88261us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143121.587099:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5748 00002000:00100000:0.0:1746143121.587112:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f358000 x1830962858440064/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143121.587123:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f358000 with x1830962858440064 ext(1048576->2097151) 00002000:00010000:0.0:1746143121.587129:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f358000 00000001:00080000:1.0:1746143121.606546:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942257 is committed 00000004:00080000:1.0:1746143121.606559:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1757 committed 00000004:00080000:1.0:1746143121.606578:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1737 committed 00000004:00080000:1.0:1746143121.606585:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1736 committed 00000004:00080000:1.0:1746143121.606587:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1735 committed 00000004:00080000:1.0:1746143121.606588:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1734 committed 00000004:00080000:1.0:1746143121.606590:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1756 committed 00000004:00080000:1.0:1746143121.606592:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1733 committed 00000004:00080000:1.0:1746143121.606594:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1755 committed 00000004:00080000:1.0:1746143121.606596:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1732 committed 00000004:00080000:1.0:1746143121.606597:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1754 committed 00000004:00080000:1.0:1746143121.606601:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1753 committed 00000004:00080000:1.0:1746143121.606602:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1752 committed 00000004:00080000:1.0:1746143121.606605:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1731 committed 00000004:00080000:1.0:1746143121.606606:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1730 committed 00000004:00080000:1.0:1746143121.606608:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1751 committed 00000004:00080000:1.0:1746143121.606609:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1750 committed 00000004:00080000:1.0:1746143121.606611:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1729 committed 00000001:00080000:1.0:1746143121.606621:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942255 is committed 00000001:00080000:1.0:1746143121.606643:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942252 is committed 00000100:00100000:3.0:1746143121.606746:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861165696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.606746:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861166080:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143121.606958:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 200 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.606972:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143121.606975:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143121.606979:0:1037:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 6 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.606989:0:1037:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 6 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.606995:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 6 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.607001:0:1037:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.607008:0:1037:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.607014:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.607057:0:1037:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.607067:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861167744:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143121.607152:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607206:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861166208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143121.607223:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607236:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861166720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143121.607249:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607260:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861167232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143121.607272:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607296:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861165952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143121.607312:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607323:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861166592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143121.607335:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607344:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861166976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143121.607357:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607367:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861167488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143121.607378:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607390:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1746143121.607396:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861165824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143121.607428:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607443:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861166336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143121.607456:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607466:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861166848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143121.607479:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607488:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861167360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143121.607498:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607520:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861165696 00000100:00100000:3.0:1746143121.607526:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861165696 00000100:00100000:3.0:1746143121.607556:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861166208 00000100:00100000:3.0:1746143121.607558:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861166208 00000100:00100000:3.0:1746143121.607567:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861166720 00000100:00100000:3.0:1746143121.607569:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861166720 00000100:00100000:3.0:1746143121.607575:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861167232 00000100:00100000:3.0:1746143121.607577:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861167232 00000100:00100000:3.0:1746143121.607583:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861165952 00000100:00100000:3.0:1746143121.607584:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861165952 00000100:00100000:3.0:1746143121.607592:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861166592 00000100:00100000:3.0:1746143121.607594:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861166592 00000100:00100000:3.0:1746143121.607600:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861166976 00000100:00100000:3.0:1746143121.607602:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861166976 00000100:00100000:3.0:1746143121.607608:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861167488 00000100:00100000:3.0:1746143121.607609:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861167488 00000100:00100000:3.0:1746143121.607622:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861165824 00000100:00100000:3.0:1746143121.607625:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861165824 00000100:00100000:3.0:1746143121.607631:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861166336 00000100:00100000:3.0:1746143121.607633:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861166336 00000100:00100000:3.0:1746143121.607640:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861166848 00000100:00100000:3.0:1746143121.607641:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861166848 00000100:00100000:3.0:1746143121.607647:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861167360 00000100:00100000:3.0:1746143121.607649:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861167360 00000100:00100000:1.0:1746143121.607656:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143121.607659:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11853 00000100:00100000:3.0:1746143121.607667:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3300:x1830962861165696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.607669:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861166464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.607685:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143121.607692:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861167104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.607704:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143121.607711:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861167616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143121.607722:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143121.607740:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861166080 00000100:00100000:1.0:1746143121.607743:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861166080 00000100:00100000:1.0:1746143121.607755:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861166464 00000100:00100000:1.0:1746143121.607756:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861166464 00000100:00100000:1.0:1746143121.607763:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861167104 00000100:00100000:1.0:1746143121.607765:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861167104 00000100:00100000:1.0:1746143121.607770:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861167616 00000100:00100000:1.0:1746143121.607771:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861167616 00000100:00100000:1.0:1746143121.607781:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11854 00000100:00100000:1.0:1746143121.607786:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861166208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143121.607860:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143121.607863:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143117 -> 1746143117 00002000:00010000:3.0:1746143121.607865:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143117 -> 1746143117 00002000:00010000:3.0:1746143121.607868:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143117 -> 1746143117 00002000:00010000:3.0:1746143121.607870:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746143121.607891:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143121.607894:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143118 -> 1746143118 00002000:00010000:1.0:1746143121.607896:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143118 -> 1746143118 00002000:00010000:1.0:1746143121.607898:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143118 -> 1746143118 00000100:00100000:3.0:1746143121.607900:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861165696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (748us total) trans 17179872670 rc 0/0 00002000:00010000:1.0:1746143121.607900:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143121.607906:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11853 00000100:00100000:1.0:1746143121.607917:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861166208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (693us total) trans 21474839924 rc 0/0 00000100:00100000:3.0:1746143121.607921:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11855 00000100:00100000:1.0:1746143121.607923:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11854 00000100:00100000:3.0:1746143121.607925:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3300:x1830962861166720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.607931:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11856 00000100:00100000:1.0:1746143121.607935:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861167232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143121.607993:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143121.607995:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143121.607997:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143121.607999:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143121.608001:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143121.608006:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861166720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (755us total) trans 17179872671 rc 0/0 00000100:00100000:3.0:1746143121.608011:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11855 00000100:00100000:1.0:1746143121.608016:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861167232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (743us total) trans 21474839925 rc 0/0 00000100:00100000:3.0:1746143121.608021:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11857 00000100:00100000:3.0:1746143121.608025:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3302:x1830962861165952:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143121.608354:0:1037:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 6 pid: 14795 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.608365:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861167872:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143121.608381:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143121.608752:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11856 00000100:00100000:1.0:1746143121.608764:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11858 00000100:00100000:1.0:1746143121.608769:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861166592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143121.608856:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861166592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1519us total) trans 21474839926 rc 0/0 00000100:00100000:1.0:1746143121.608862:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11858 00000100:00100000:1.0:1746143121.608872:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11859 00000100:00100000:1.0:1746143121.608876:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861166976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143121.608946:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861166976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1587us total) trans 21474839927 rc 0/0 00000100:00100000:1.0:1746143121.608952:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11859 00000100:00100000:1.0:1746143121.608961:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11860 00000100:00100000:1.0:1746143121.608965:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3302:x1830962861167488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.609049:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861167488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1669us total) trans 17179872672 rc 0/0 00000100:00100000:1.0:1746143121.609055:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11860 00000100:00100000:1.0:1746143121.609065:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11861 00000100:00100000:1.0:1746143121.609069:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3302:x1830962861165824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143121.609135:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143121.609137:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143117 -> 1746143117 00002000:00010000:1.0:1746143121.609140:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143117 -> 1746143117 00002000:00010000:1.0:1746143121.609142:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143117 -> 1746143117 00002000:00010000:1.0:1746143121.609144:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143121.609160:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861165824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1741us total) trans 17179872673 rc 0/0 00000100:00100000:1.0:1746143121.609165:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11861 00000100:00100000:1.0:1746143121.609173:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11862 00000100:00100000:1.0:1746143121.609177:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861166336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143121.609243:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:1.0:1746143121.609246:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143118 -> 1746143118 00002000:00010000:1.0:1746143121.609248:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143118 -> 1746143118 00002000:00010000:1.0:1746143121.609250:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143118 -> 1746143118 00002000:00010000:1.0:1746143121.609253:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:1.0:1746143121.609270:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861166336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1812us total) trans 21474839928 rc 0/0 00000100:00100000:1.0:1746143121.609275:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11862 00000100:00100000:1.0:1746143121.609284:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11863 00000100:00100000:1.0:1746143121.609289:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861166848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143121.609356:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861166848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1876us total) trans 21474839929 rc 0/0 00000100:00100000:1.0:1746143121.609361:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11863 00000100:00100000:1.0:1746143121.609370:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11864 00000100:00100000:1.0:1746143121.609375:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3302:x1830962861167360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.609458:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861167360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (1958us total) trans 17179872674 rc 0/0 00000100:00100000:1.0:1746143121.609463:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11864 00000100:00100000:1.0:1746143121.609472:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11865 00000100:00100000:1.0:1746143121.609476:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861166080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143121.609541:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143121.609543:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143118 -> 1746143118 00002000:00010000:1.0:1746143121.609546:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143115 -> 1746143115 00002000:00010000:1.0:1746143121.609548:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143118 -> 1746143118 00002000:00010000:1.0:1746143121.609550:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 2001 -> 2001 00000100:00100000:1.0:1746143121.609570:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861166080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1915us total) trans 21474839930 rc 0/0 00000100:00100000:1.0:1746143121.609575:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11865 00000100:00100000:1.0:1746143121.609585:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11866 00000100:00100000:1.0:1746143121.609589:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3299:x1830962861166464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.609664:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861166464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1978us total) trans 17179872675 rc 0/0 00000100:00100000:1.0:1746143121.609670:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11866 00000100:00100000:1.0:1746143121.609679:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11867 00000100:00100000:1.0:1746143121.609684:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3299:x1830962861167104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143121.609747:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861167104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (2042us total) trans 17179872676 rc 0/0 00000100:00100000:1.0:1746143121.609753:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11867 00000100:00100000:1.0:1746143121.609761:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11868 00000100:00100000:1.0:1746143121.609765:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861167616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143121.609830:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861167616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (2106us total) trans 21474839931 rc 0/0 00000100:00100000:1.0:1746143121.609835:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11868 00000004:00080000:1.0:1746143121.609874:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f575500/2, rc 0, transno 17179872673 00000100:00100000:1.0:1746143121.609880:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861165824:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143121.609889:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094514700/2, rc 0, transno 21474839928 00000100:00100000:1.0:1746143121.609896:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861166336:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143121.609902:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094517480/2, rc 0, transno 21474839929 00000100:00100000:1.0:1746143121.609906:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861166848:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143121.609912:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091948000/2, rc 0, transno 17179872674 00000100:00100000:1.0:1746143121.609915:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861167360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143121.609921:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094515f80/2, rc 0, transno 21474839926 00000100:00100000:1.0:1746143121.609924:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861166592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143121.609930:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094514380/2, rc 0, transno 21474839927 00000100:00100000:1.0:1746143121.609933:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861166976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143121.609939:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091949500/2, rc 0, transno 17179872672 00000100:00100000:1.0:1746143121.609941:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861167488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143121.609985:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094516680/2, rc 0, transno 21474839930 00000100:00100000:1.0:1746143121.609988:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861166080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143121.609994:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f575f80/2, rc 0, transno 17179872675 00000100:00100000:1.0:1746143121.609997:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861166464:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143121.610002:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009194b100/2, rc 0, transno 17179872676 00000100:00100000:1.0:1746143121.610005:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861167104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143121.610011:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094514e00/2, rc 0, transno 21474839931 00000100:00100000:1.0:1746143121.610014:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861167616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143121.610021:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143121.610026:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861168000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143121.610060:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143121.610077:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861168000 00000100:00100000:1.0:1746143121.610080:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861168000 00000100:00100000:1.0:1746143121.610096:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11869 00000100:00100000:1.0:1746143121.610100:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861168000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143121.610180:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3299:x1830962861168000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (119us total) trans 21474839932 rc 0/0 00000100:00100000:1.0:1746143121.610185:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11869 00000004:00080000:1.0:1746143121.610203:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e97480/2, rc 0, transno 21474839932 00000100:00100000:1.0:1746143121.610207:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861168000:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143121.610362:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143121.610365:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143118 -> 1746143118 00002000:00010000:3.0:1746143121.610367:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143117 -> 1746143117 00002000:00010000:3.0:1746143121.610369:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143118 -> 1746143118 00002000:00010000:3.0:1746143121.610371:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143121.610398:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861165952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2373us (3085us total) trans 17179872677 rc 0/0 00000100:00100000:3.0:1746143121.610408:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11857 00000004:00080000:3.0:1746143121.610458:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f576300/2, rc 0, transno 17179872670 00000100:00100000:3.0:1746143121.610462:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861165696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143121.610472:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094515180/2, rc 0, transno 21474839924 00000100:00100000:3.0:1746143121.610474:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861166208:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143121.610482:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f574e00/2, rc 0, transno 17179872671 00000100:00100000:3.0:1746143121.610484:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861166720:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143121.610491:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094515c00/2, rc 0, transno 21474839925 00000100:00100000:3.0:1746143121.610494:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861167232:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143121.612591:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f575180/2, rc 0, transno 17179872677 00000100:00100000:1.0:1746143121.612604:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861165952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143121.618338:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861167744:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143121.618353:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861167872:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143121.618403:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2e00/0x25aee876ca70bf4a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 200 pid: 1037 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746143121.618626:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 199 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.618664:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cd2800, rc 0) 00000100:00100000:2.0:1746143121.618728:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30691:x1830962858440576:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 99825us (100613us total) trans 8589942257 rc 0/0 00000100:00100000:2.0:1746143121.618738:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8051 00000100:00100000:0.0:1746143121.619676:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.619731:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.620084:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858441984 00000100:00100000:2.0:1746143121.620091:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858441984 00000100:00100000:2.0:1746143121.620126:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858442112 00000100:00100000:2.0:1746143121.620128:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858442112 00000100:00100000:2.0:1746143121.620144:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3379 00000100:00100000:2.0:1746143121.620150:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30696:x1830962858441984:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143121.620259:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30696:x1830962858441984:12345-192.168.201.28@tcp:49:cat.0 Request processed in 105us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.620265:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3379 00000100:00100000:2.0:1746143121.620277:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3380 00000100:00100000:2.0:1746143121.620283:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30697:x1830962858442112:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143121.620328:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30697:x1830962858442112:12345-192.168.201.28@tcp:49:cat.0 Request processed in 45us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.620334:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3380 00000100:00100000:0.0:1746143121.633603:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.634275:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858442240 00000100:00100000:3.0:1746143121.634285:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858442240 00000100:00100000:3.0:1746143121.634336:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3381 00000100:00100000:3.0:1746143121.634344:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30691:x1830962858442240:12345-192.168.201.28@tcp:49:multiop.0 00000100:00100000:3.0:1746143121.634771:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30691:x1830962858442240:12345-192.168.201.28@tcp:49:multiop.0 Request processed in 425us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.634779:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3381 00000100:00100000:0.0:1746143121.648843:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.649077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.649895:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.650098:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.650138:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858442496 00000100:00100000:2.0:1746143121.650147:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858442496 00002000:00100000:2.0:1746143121.650198:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009ad59500 x1830962858442496/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143121.650210:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59500 with x1830962858442496 ext(0->1048575) 00002000:00010000:2.0:1746143121.650216:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad59500 00000100:00100000:2.0:1746143121.650238:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858442752 00000100:00100000:2.0:1746143121.650240:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858442752 00002000:00100000:2.0:1746143121.650252:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009ad58380 x1830962858442752/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143121.650259:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58380 with x1830962858442752 ext(1048576->2097151) 00002000:00010000:2.0:1746143121.650263:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad58380 00000100:00100000:2.0:1746143121.650272:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858443008 00000100:00100000:2.0:1746143121.650273:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858443008 00002000:00100000:2.0:1746143121.650283:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009ad58000 x1830962858443008/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143121.650289:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58000 with x1830962858443008 ext(1048576->2097151) 00002000:00010000:2.0:1746143121.650293:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad58000 00000100:00100000:2.0:1746143121.650304:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5750 00000100:00100000:2.0:1746143121.650310:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858442496:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143121.651305:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5751 00000100:00100000:3.0:1746143121.651313:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858442752:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143121.654333:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.654356:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858443392 00000100:00100000:0.0:1746143121.654361:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858443392 00000100:00100000:0.0:1746143121.654396:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11870 00000100:00100000:0.0:1746143121.654402:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:30691:x1830962858443392:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143121.654429:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.654446:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5d3 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.654475:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 7 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.654484:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.654491:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 33 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.654496:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.654497:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.654501:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1572864->1974271] (req 1572864->1974271) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 33 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.654530:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 33 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.654541:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 33 pid: 26949 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.654552:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861168128:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.654615:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.654624:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.654631:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861168256:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.654653:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 7 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.654660:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 7 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.654668:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861168384:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143121.654682:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.654701:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858443264 00000100:00100000:0.0:1746143121.654704:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858443264 00002000:00100000:0.0:1746143121.654729:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009ad58a80 x1830962858443264/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143121.654737:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58a80 with x1830962858443264 ext(1048576->2097151) 00010000:00010000:0.0:1746143121.654742:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 21 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.654751:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 21 pid: 20836 timeout: 1003 lvb_type: 1 00002000:00010000:0.0:1746143121.654756:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad58a80 00000100:00100000:0.0:1746143121.654772:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1904 00000100:00100000:0.0:1746143121.654777:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858443264:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143121.656638:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5752 00000100:00100000:2.0:1746143121.656648:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858443008:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143121.657573:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.657666:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858443648 00000100:00100000:1.0:1746143121.657671:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858443648 00002000:00100000:1.0:1746143121.657699:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094e95180 x1830962858443648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.657709:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95180 with x1830962858443648 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.657713:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e95180 00000100:00100000:1.0:1746143121.657728:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5753 00000100:00100000:1.0:1746143121.657734:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858443648:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143121.670019:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.670087:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858443776 00000100:00100000:1.0:1746143121.670096:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858443776 00010000:00010000:1.0:1746143121.670134:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 34 pid: 26949 timeout: 1003 lvb_type: 1 00000100:00100000:1.0:1746143121.670167:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6266 00000100:00100000:1.0:1746143121.670175:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1971:x1830962858443776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143121.670189:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.670212:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 34 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.670224:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 34 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.670252:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143121.670301:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1971:x1830962858443776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 126us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.670308:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6266 00010000:00010000:2.0:1746143121.671616:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b200000/0x25aee876ca70bed3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f56a expref: 33 pid: 26949 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143121.671636:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861168128:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.671647:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861168256:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.671655:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861168384:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.671683:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1572864->1974271] (req 1572864->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.671694:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f22000, rc 0) 00000100:00100000:2.0:1746143121.671735:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:30691:x1830962858443392:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 17331us (17407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.671742:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11870 00000100:00100000:0.0:1746143121.674833:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.675287:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858442752:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23973us (26207us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143121.675296:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5751 00002000:00100000:2.0:1746143121.675307:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009ad58380 x1830962858442752/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143121.675322:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58380 with x1830962858442752 ext(1048576->2097151) 00002000:00010000:2.0:1746143121.675328:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad58380 00000100:00100000:3.0:1746143121.675924:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858443904 00000100:00100000:3.0:1746143121.675932:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858443904 00010000:00010000:3.0:1746143121.675960:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 8 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143121.676861:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6267 00000100:00100000:3.0:1746143121.676869:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858443904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143121.676883:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143121.676903:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 8 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143121.676914:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 8 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143121.676937:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9e00/0x25aee876ca70be24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f524 expref: 8 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143121.676964:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143121.676989:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858443904:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 121us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.676995:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6267 00000100:00100000:3.0:1746143121.692659:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858442496:12345-192.168.201.28@tcp:3:cat.0 Request processed in 42334us (43813us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143121.692674:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5750 00002000:00100000:3.0:1746143121.692689:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009ad59500 x1830962858442496/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.692699:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59500 with x1830962858442496 ext(0->1048575) 00002000:00010000:3.0:1746143121.692705:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad59500 00000100:00100000:0.0:1746143121.715672:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.715907:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858444032 00000100:00100000:2.0:1746143121.715916:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858444032 00000100:00100000:2.0:1746143121.715974:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11871 00000100:00100000:2.0:1746143121.715981:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:30694:x1830962858444032:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143121.716001:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.716017:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5da expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.716071:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.716080:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 29 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.716087:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 26 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.716093:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.716095:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.716098:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2539520->3145727] (req 2539520->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.716124:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 26 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.716140:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 26 pid: 22204 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143121.716151:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861168512:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.718149:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 29 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.718160:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 29 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143121.718171:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861168640:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.718372:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.718381:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 7 pid: 4758 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143121.718389:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861168768:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.718406:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143121.720573:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858443008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 63920us (70670us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143121.720584:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5752 00002000:00100000:2.0:1746143121.720594:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009ad58000 x1830962858443008/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143121.720604:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58000 with x1830962858443008 ext(1048576->2097151) 00002000:00010000:2.0:1746143121.720609:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad58000 00000100:00100000:1.0:1746143121.737202:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858443648:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 79455us (79619us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143121.737216:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5753 00002000:00100000:1.0:1746143121.737229:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094e95180 x1830962858443648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.737239:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95180 with x1830962858443648 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.737246:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e95180 00000100:00100000:0.0:1746143121.738532:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.738556:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.738577:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.738605:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.738642:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858444288 00000100:00100000:0.0:1746143121.738649:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858444288 00010000:00010000:0.0:1746143121.738677:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 28 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.738701:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858444160 00000100:00100000:0.0:1746143121.738703:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858444160 00010000:00010000:0.0:1746143121.738913:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 25 pid: 22204 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.738926:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858444416 00000100:00100000:0.0:1746143121.738928:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858444416 00010000:00010000:0.0:1746143121.738937:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 8 pid: 4758 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.738949:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6268 00000100:00100000:0.0:1746143121.738954:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858444288:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.738966:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.738985:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 28 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.738994:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 28 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.739017:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.739053:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858444288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 99us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.739058:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6268 00000100:00100000:0.0:1746143121.739069:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6269 00000100:00100000:0.0:1746143121.739073:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858444160:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.739078:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.739083:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 25 pid: 22204 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.739090:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 25 pid: 22204 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.739099:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.739108:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858444160:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.739112:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6269 00000100:00100000:0.0:1746143121.739118:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6270 00000100:00100000:0.0:1746143121.739121:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858444416:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.739125:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.739130:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 8 pid: 4758 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.739138:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 8 pid: 4758 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.739147:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.739148:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.739154:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.739162:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.739188:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 27 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.739198:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861168896:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143121.739250:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b630fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.739267:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858444544 00000100:00100000:0.0:1746143121.739270:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858444544 00000100:00100000:0.0:1746143121.739289:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11872 00000100:00100000:0.0:1746143121.739293:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:30696:x1830962858444544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.739304:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.739317:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5e1 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.739330:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.739335:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1572864->1974271] (req 1572864->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.739340:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143121.739342:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.739362:0:26949:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1572864->1974271] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.739371:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.739378:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fb5e00, rc 0) 00000100:00100000:0.0:1746143121.739393:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:30696:x1830962858444544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 100us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.739398:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11872 00010000:00010000:3.0:1746143121.740761:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70bef6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f578 expref: 24 pid: 22204 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143121.740782:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861168512:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143121.740793:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b201000/0x25aee876ca70bf43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5be expref: 27 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143121.740801:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861168640:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143121.740811:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094444a00/0x25aee876ca70be1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f532 expref: 8 pid: 4758 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143121.740820:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861168768:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143121.740844:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.740852:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444e00, rc 0) 00000100:00100000:3.0:1746143121.741073:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30694:x1830962858444032:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 25092us (25411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.741080:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11871 00000100:00100000:0.0:1746143121.742135:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858443264:12345-192.168.201.28@tcp:3:cat.0 Request processed in 87355us (92034us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143121.742145:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1904 00002000:00100000:0.0:1746143121.742156:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009ad58a80 x1830962858443264/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143121.742165:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58a80 with x1830962858443264 ext(1048576->2097151) 00010000:00010000:0.0:1746143121.742174:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.742187:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 1003 lvb_type: 1 00002000:00010000:0.0:1746143121.742196:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad58a80 00000100:00100000:2.0:1746143121.746024:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861168896:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143121.746066:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143121.746121:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858444416:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6996us (7540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.746133:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6270 00000100:00100000:1.0:1746143121.748355:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.748673:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858444800 00000100:00100000:0.0:1746143121.748682:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858444800 00002000:00100000:0.0:1746143121.748728:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2539520->2543615) req@ffff880094e96a00 x1830962858444800/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143121.748739:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e96a00 with x1830962858444800 ext(2539520->2543615) 00002000:00010000:0.0:1746143121.748745:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e96a00 00000100:00100000:0.0:1746143121.748778:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5754 00000100:00100000:0.0:1746143121.748785:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858444800:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143121.751628:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858444800:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 2833us (3271us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143121.751642:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5754 00002000:00100000:0.0:1746143121.751655:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2539520->2543615) req@ffff880094e96a00 x1830962858444800/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/4536 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143121.751665:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e96a00 with x1830962858444800 ext(2539520->2543615) 00002000:00010000:0.0:1746143121.751671:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e96a00 00000100:00100000:1.0:1746143121.751838:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.763951:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.764077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.764136:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858445184 00000100:00100000:1.0:1746143121.764145:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858445184 00002000:00100000:1.0:1746143121.764187:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009ad5aa00 x1830962858445184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.764197:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5aa00 with x1830962858445184 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.764203:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad5aa00 00000100:00100000:1.0:1746143121.764220:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5755 00000100:00100000:1.0:1746143121.764225:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858445184:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143121.767314:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858444928 00000100:00100000:3.0:1746143121.767329:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858444928 00010000:00010000:3.0:1746143121.767372:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143121.767425:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6271 00000100:00100000:3.0:1746143121.767433:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858444928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143121.767446:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143121.767466:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143121.767483:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143121.767508:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b200e00/0x25aee876ca70bf35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b0 expref: 20 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143121.767534:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.767536:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.767542:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.767550:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.767582:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.767592:0:16965:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 31 pid: 4758 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143121.767603:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861169152:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143121.767670:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143121.768209:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858445312 00000100:00100000:2.0:1746143121.768213:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858445312 00000100:00100000:2.0:1746143121.768246:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11873 00000100:00100000:2.0:1746143121.768252:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30694:x1830962858445312:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143121.768263:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.768275:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5e8 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.768292:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 6 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.768299:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 21 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.768305:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 31 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.768310:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.768312:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.768315:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->3452927] (req 3145728->3452927) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.768330:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 31 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.768338:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 31 pid: 10061 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143121.768345:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861169280:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.768601:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 21 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.768608:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 21 pid: 26949 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143121.768615:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861169408:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.768636:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 6 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.768642:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 6 pid: 4758 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143121.768649:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861169536:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.768660:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143121.781074:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861169152:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143121.781100:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143121.781176:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858444928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13741us (29337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.781188:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6271 00000100:00100000:2.0:1746143121.785209:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861169280:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.788403:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861169408:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.792121:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861169536:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.792166:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->3452927] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.792187:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094445400, rc 0) 00000100:00100000:3.0:1746143121.792329:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30694:x1830962858445312:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 24074us (28249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.792340:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11873 00000100:00100000:0.0:1746143121.793236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.793866:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.793914:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.793932:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858445568 00000100:00100000:0.0:1746143121.793939:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858445568 00010000:00010000:0.0:1746143121.793966:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 32 pid: 10061 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.793985:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858445824 00000100:00100000:0.0:1746143121.793986:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858445824 00010000:00010000:0.0:1746143121.793994:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 7 pid: 4758 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.794005:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858445696 00000100:00100000:0.0:1746143121.794007:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858445696 00010000:00010000:0.0:1746143121.794014:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 20 pid: 26949 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.794026:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6272 00000100:00100000:0.0:1746143121.794047:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858445568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.794060:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.794179:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 32 pid: 10061 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.794192:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 32 pid: 10061 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.794217:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70beda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f571 expref: 32 pid: 10061 timeout: 1003 lvb_type: 1 00000100:00100000:1.0:1746143121.794303:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6273 00000100:00100000:1.0:1746143121.794311:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858445824:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143121.794319:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.794329:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 7 pid: 4758 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.794337:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 7 pid: 4758 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.794356:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094445a00/0x25aee876ca70be2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f52b expref: 7 pid: 4758 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.794374:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143121.794401:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858445824:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 91us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.794407:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6273 00000100:00100000:1.0:1746143121.794435:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6274 00000100:00100000:1.0:1746143121.794440:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858445696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143121.794449:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.794457:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 20 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.794465:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 20 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.794477:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b201600/0x25aee876ca70bf3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5b7 expref: 20 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.794485:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.794487:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.794494:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.794501:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.794530:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.794542:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091980e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861169664:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143121.794591:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143121.794623:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.795331:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858445184:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 31104us (31392us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143121.795339:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5755 00002000:00100000:1.0:1746143121.795349:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009ad5aa00 x1830962858445184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.795358:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5aa00 with x1830962858445184 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.795363:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad5aa00 00000100:00100000:1.0:1746143121.795377:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858445952 00000100:00100000:1.0:1746143121.795380:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858445952 00002000:00100000:1.0:1746143121.795400:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1572864->1576959) req@ffff880091982d80 x1830962858445952/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.795408:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982d80 with x1830962858445952 ext(1572864->1576959) 00010000:00010000:1.0:1746143121.795425:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.795438:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.795450:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091982d80 00010000:00010000:0.0:1746143121.795509:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.795528:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858445568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1496us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.795538:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6272 00000100:00100000:2.0:1746143121.797622:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1905 00000100:00100000:2.0:1746143121.797636:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858445952:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143121.798749:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858445952:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1116us (4122us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143121.798756:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1905 00002000:00100000:2.0:1746143121.798763:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1572864->1576959) req@ffff880091982d80 x1830962858445952/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/4536 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143121.798771:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982d80 with x1830962858445952 ext(1572864->1576959) 00010000:00010000:2.0:1746143121.798780:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 31 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143121.798792:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 31 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143121.798798:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091982d80 00000100:00100000:0.0:1746143121.813022:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.813414:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858446208 00000100:00100000:2.0:1746143121.813432:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858446208 00000100:00100000:0.0:1746143121.813446:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.813500:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.813512:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858446464 00000100:00100000:3.0:1746143121.813515:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858446464 00002000:00100000:3.0:1746143121.813545:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1970176->1974271) req@ffff88009ad5b800 x1830962858446464/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.813555:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5b800 with x1830962858446464 ext(1970176->1974271) 00010000:00010000:3.0:1746143121.813565:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.813580:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143121.813588:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5b800 00000100:00100000:3.0:1746143121.813607:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858446720 00000100:00100000:3.0:1746143121.813609:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858446720 00002000:00100000:3.0:1746143121.813619:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1974272->2097151) req@ffff880090f23100 x1830962858446720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.813625:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23100 with x1830962858446720 ext(1974272->2097151) 00010000:00010000:3.0:1746143121.813629:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 33 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.813637:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 33 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143121.813642:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090f23100 00000100:00100000:3.0:1746143121.813658:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1906 00000100:00100000:3.0:1746143121.813665:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858446464:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143121.813833:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858446464:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 167us (385us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143121.813839:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1906 00002000:00100000:3.0:1746143121.813844:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1970176->1974271) req@ffff88009ad5b800 x1830962858446464/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/4536 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.813851:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5b800 with x1830962858446464 ext(1970176->1974271) 00010000:00010000:3.0:1746143121.813855:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 33 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.813863:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 33 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143121.813869:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5b800 00000100:00100000:3.0:1746143121.813881:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1907 00000100:00100000:3.0:1746143121.813885:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858446720:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143121.815145:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.815237:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.815322:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091980e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861169664:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143121.815345:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746143121.815356:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->1572863) req@ffff88009ad59c00 x1830962858446208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143121.815365:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59c00 with x1830962858446208 ext(1048576->1572863) 00000100:00100000:1.0:1746143121.815371:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858445696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 20930us (21456us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143121.815372:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 33 pid: 4758 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143121.815380:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6274 00010000:00010000:2.0:1746143121.815384:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 33 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143121.815391:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad59c00 00000100:00100000:1.0:1746143121.815412:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858446976 00000100:00100000:1.0:1746143121.815424:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858446976 00000100:00100000:2.0:1746143121.815440:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1908 00002000:00100000:1.0:1746143121.815442:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3448832->3452927) req@ffff880090f20380 x1830962858446976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143121.815447:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858446208:12345-192.168.201.28@tcp:3:multiop.0 00002000:00100000:1.0:1746143121.815450:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20380 with x1830962858446976 ext(3448832->3452927) 00002000:00010000:1.0:1746143121.815453:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f20380 00000100:00100000:1.0:1746143121.815472:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5756 00000100:00100000:1.0:1746143121.815478:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858446976:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143121.815733:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858447104 00000100:00100000:3.0:1746143121.815737:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858447104 00000100:00100000:3.0:1746143121.816062:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11874 00000100:00100000:3.0:1746143121.816069:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:30697:x1830962858447104:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143121.816077:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143121.816096:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5ef expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.816117:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143121.816122:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.816134:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.816142:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b43b400, rc 0) 00000100:00100000:1.0:1746143121.816551:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858446976:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1072us (1409us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143121.816558:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5756 00002000:00100000:1.0:1746143121.816564:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3448832->3452927) req@ffff880090f20380 x1830962858446976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/4536 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.816572:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20380 with x1830962858446976 ext(3448832->3452927) 00002000:00010000:1.0:1746143121.816575:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f20380 00000100:00100000:3.0:1746143121.817056:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:30697:x1830962858447104:12345-192.168.201.28@tcp:101:cat.0 Request processed in 986us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.817062:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11874 00000100:00100000:0.0:1746143121.821524:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.822538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.822602:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858447616 00000100:00100000:3.0:1746143121.822612:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858447616 00000100:00100000:3.0:1746143121.822663:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3382 00000100:00100000:1.0:1746143121.822670:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858447360 00000100:00100000:3.0:1746143121.822671:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30691:x1830962858447616:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143121.822673:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858447360 00002000:00100000:1.0:1746143121.822703:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1572864->1974271) req@ffff880090f21180 x1830962858447360/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.822712:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21180 with x1830962858447360 ext(1572864->1974271) 00010000:00010000:1.0:1746143121.822720:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 35 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.822734:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 35 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.822741:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090f21180 00000100:00100000:2.0:1746143121.822747:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858446720:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 8858us (9244us total) trans 0 rc 122880/122880 00000100:00100000:2.0:1746143121.822756:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1907 00002000:00100000:2.0:1746143121.822763:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1974272->2097151) req@ffff880090f23100 x1830962858446720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 122880/122880 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143121.822763:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1909 00000100:00100000:1.0:1746143121.822768:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858447360:12345-192.168.201.28@tcp:4:multiop.0 00002000:00100000:2.0:1746143121.822771:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23100 with x1830962858446720 ext(1974272->2097151) 00010000:00010000:2.0:1746143121.822776:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 35 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143121.822965:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 35 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143121.822971:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090f23100 00000100:00100000:3.0:1746143121.823158:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30691:x1830962858447616:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 487us (621us total) trans 8589942258 rc 0/0 00000100:00100000:3.0:1746143121.823164:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3382 00000100:00100000:0.0:1746143121.841191:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.841218:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858447872 00000100:00100000:0.0:1746143121.841227:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858447872 00000100:00100000:0.0:1746143121.841263:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3383 00000100:00100000:0.0:1746143121.841270:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30694:x1830962858447872:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143121.841325:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858446208:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 25877us (28312us total) trans 0 rc 524288/524288 00000100:00100000:3.0:1746143121.841333:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1908 00002000:00100000:3.0:1746143121.841342:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->1572863) req@ffff88009ad59c00 x1830962858446208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 524288/524288 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143121.841358:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59c00 with x1830962858446208 ext(1048576->1572863) 00010000:00010000:3.0:1746143121.841367:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 34 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.841380:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 34 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143121.841387:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad59c00 00000100:00100000:0.0:1746143121.841449:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30694:x1830962858447872:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 179us (267us total) trans 8589942259 rc 0/0 00000100:00100000:0.0:1746143121.841454:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3383 00000100:00100000:0.0:1746143121.841502:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.841520:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858448000 00000100:00100000:2.0:1746143121.841524:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858448000 00000100:00100000:2.0:1746143121.842504:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8054 00000100:00100000:2.0:1746143121.842511:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:30698:x1830962858448000:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143121.842525:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.842541:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094445800/0x25aee876ca70bf89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5f6 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.842588:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842601:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842611:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842623:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842628:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842633:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842736:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842743:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842748:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:2.0:1746143121.842972:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143121.842976:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143121.842989:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.842997:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843004:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843009:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843014:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843019:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094444600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143121.843022:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843027:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843052:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143121.843055:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143121.843058:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843063:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70bf90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843072:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843078:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843082:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843085:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094444c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143121.843087:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843091:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843096:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531d00) 00010000:00010000:2.0:1746143121.843098:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143121.843100:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843104:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444c00/0x25aee876ca70bf97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.843123:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094445800/0x25aee876ca70bf89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 8 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.843133:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 7 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.843140:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143121.843142:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143121.843144:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444200, rc 0) 00000100:00100000:2.0:1746143121.843174:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30698:x1830962858448000:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 663us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.843180:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8054 00000100:00100000:0.0:1746143121.852065:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.852098:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.852116:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858448256 00000100:00100000:0.0:1746143121.852124:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858448256 00000100:00100000:0.0:1746143121.852155:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858448128 00000100:00100000:0.0:1746143121.852157:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858448128 00000100:00100000:0.0:1746143121.852169:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11875 00000100:00100000:0.0:1746143121.852176:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858448256:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143121.852193:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.852211:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009494b600/0x25aee876ca70bfa5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f604 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.852259:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861169792:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143121.852264:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11876 00000100:00100000:2.0:1746143121.852273:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858448128:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143121.852280:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.852289:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094445200/0x25aee876ca70bfac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f5fd expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.852315:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861169920:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143121.852335:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143121.852339:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.852375:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.852391:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858448384 00000100:00100000:0.0:1746143121.852394:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858448384 00000100:00100000:0.0:1746143121.852429:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11877 00000100:00100000:0.0:1746143121.852435:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858448384:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143121.852442:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.852452:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5649800/0x25aee876ca70bfb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f60b expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.852491:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861170048:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143121.852515:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143121.855981:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858447360:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 33203us (34461us total) trans 21474839933 rc 0/0 00000100:00100000:1.0:1746143121.855993:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1909 00002000:00100000:1.0:1746143121.856003:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1572864->1974271) req@ffff880090f21180 x1830962858447360/t21474839933(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/448 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.856013:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21180 with x1830962858447360 ext(1572864->1974271) 00010000:00010000:1.0:1746143121.856023:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 34 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.856052:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 34 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.856060:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090f21180 00002000:00010000:0.0:1746143121.857217:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143118 -> 1746143120 00002000:00010000:0.0:1746143121.857223:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143118 -> 1746143120 00002000:00010000:0.0:1746143121.857225:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143118 -> 1746143120 00000100:00100000:0.0:1746143121.857247:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861169920:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143121.857282:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094445200/0x25aee876ca70bfac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5fd expref: 9 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.857294:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094445200/0x25aee876ca70bfac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5fd expref: 9 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.857304:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094445200, rc 0) 00000100:00100000:0.0:1746143121.857331:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858448128:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 5059us (5231us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143121.857338:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11876 00002000:00010000:0.0:1746143121.857368:0:26949:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143118 -> 1746143120 00002000:00010000:0.0:1746143121.857370:0:26949:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143117 -> 1746143120 00002000:00010000:0.0:1746143121.857372:0:26949:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143118 -> 1746143120 00000100:00100000:0.0:1746143121.857383:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861170048:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143121.857398:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5649800/0x25aee876ca70bfb3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f60b expref: 8 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.857407:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5649800/0x25aee876ca70bfb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f60b expref: 8 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.857430:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5649800, rc 0) 00000100:00100000:0.0:1746143121.857448:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858448384:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 5013us (5073us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143121.857453:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11877 00002000:00010000:0.0:1746143121.857479:0:8448:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143118 -> 1746143120 00002000:00010000:0.0:1746143121.857482:0:8448:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143118 -> 1746143120 00002000:00010000:0.0:1746143121.857484:0:8448:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143118 -> 1746143120 00000100:00100000:0.0:1746143121.857493:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861169792:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143121.857512:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009494b600/0x25aee876ca70bfa5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f604 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.857521:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009494b600/0x25aee876ca70bfa5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f604 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.857532:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009494b600, rc 0) 00000100:00100000:0.0:1746143121.857550:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858448256:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 5374us (5492us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143121.857555:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11875 00000100:00100000:1.0:1746143121.866245:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.866334:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858448768 00000100:00100000:0.0:1746143121.866344:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858448768 00010000:00010000:0.0:1746143121.866378:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 34 pid: 4758 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.866407:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6275 00000100:00100000:0.0:1746143121.866427:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858448768:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.866440:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.866463:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 34 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.866475:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 34 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.866498:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f22000/0x25aee876ca70bf66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1572864->1974271) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5d3 expref: 34 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.866512:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.866513:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.866520:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 18 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.866534:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 18 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.866543:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.866544:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.866548:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 33 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.866554:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 33 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.866583:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 33 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.866595:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861170176:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143121.866673:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 18 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.866680:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861170304:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143121.866697:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.868227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.868309:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858448640 00000100:00100000:2.0:1746143121.868314:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858448640 00000100:00100000:2.0:1746143121.868564:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8055 00000100:00100000:2.0:1746143121.868571:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30698:x1830962858448640:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143121.868589:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.868604:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094445e00/0x25aee876ca70bfba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f612 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.868693:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.868705:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 8 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.869619:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143121.869645:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 8 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.869658:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 8 pid: 1037 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143121.869669:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861170432:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.869736:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.873575:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861170176:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143121.873651:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.874251:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858449152 00000100:00100000:1.0:1746143121.874257:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858449152 00002000:00100000:1.0:1746143121.874297:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880090f21500 x1830962858449152/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.874306:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21500 with x1830962858449152 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.874311:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21500 00000100:00100000:1.0:1746143121.874330:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5757 00000100:00100000:1.0:1746143121.874336:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858449152:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143121.880313:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861170304:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143121.880339:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.883248:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858448768:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 16656us (16838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.883261:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6275 00000100:00100000:1.0:1746143121.883361:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.883411:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861170432:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143121.883446:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143121.883992:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858449280 00000100:00100000:0.0:1746143121.883998:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858449280 00010000:00010000:0.0:1746143121.884022:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.884054:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6276 00000100:00100000:0.0:1746143121.884060:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858449280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.884072:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.884078:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.884088:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.884109:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70bf9e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5f6 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.884122:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143121.884127:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143121.884135:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143121.884141:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143121.884164:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.884181:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858449280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 122us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.884187:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6276 00010000:00010000:3.0:1746143121.884356:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143121.884363:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143121.884382:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143121.884740:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094445e00/0x25aee876ca70bfba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f612 expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.884760:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f612 expref: 8 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.884766:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143121.884768:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143121.884771:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094445200, rc 0) 00000100:00100000:3.0:1746143121.884800:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30698:x1830962858448640:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 16229us (16576us total) trans 8589942260 rc 0/0 00000100:00100000:3.0:1746143121.884807:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8055 00000100:00100000:0.0:1746143121.889182:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.897653:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858449536 00000100:00100000:1.0:1746143121.897670:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858449536 00002000:00100000:1.0:1746143121.897719:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880090f20000 x1830962858449536/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.897729:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20000 with x1830962858449536 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.897933:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f20000 00000100:00100000:1.0:1746143121.897964:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5758 00000100:00100000:1.0:1746143121.897972:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858449536:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143121.903203:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.903445:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858449152:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 29106us (29792us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143121.903670:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5757 00002000:00100000:1.0:1746143121.903684:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880090f21500 x1830962858449152/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.903694:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21500 with x1830962858449152 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.903701:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21500 00000100:00100000:2.0:1746143121.903846:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858449792 00000100:00100000:2.0:1746143121.903854:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858449792 00000100:00100000:2.0:1746143121.903899:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8056 00000100:00100000:2.0:1746143121.903907:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30698:x1830962858449792:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143121.903926:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.903930:0:1037:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143121.903957:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094445200/0x25aee876ca70bfc1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f612 expref: 8 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.903972:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143121.903976:0:1037:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143121.903988:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094444a00/0x25aee876ca70bfcf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f619 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.912699:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143121.912723:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143121.912735:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143121.912751:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143121.913077:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444a00/0x25aee876ca70bfcf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.913094:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.913103:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143121.913106:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143121.913109:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490a400, rc 0) 00000100:00100000:3.0:1746143121.913176:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30698:x1830962858449792:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 9268us (9981us total) trans 8589942261 rc 0/0 00000100:00100000:3.0:1746143121.913185:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8056 00000100:00100000:0.0:1746143121.926976:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.927004:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858449920 00000100:00100000:0.0:1746143121.927014:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858449920 00000100:00100000:0.0:1746143121.927068:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11878 00000100:00100000:0.0:1746143121.927076:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858449920:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.927093:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.927111:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132051c00/0x25aee876ca70bfe4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f620 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.927166:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861170560:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143121.927508:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.927545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.927664:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.927679:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858450048 00000100:00100000:0.0:1746143121.927682:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858450048 00000100:00100000:0.0:1746143121.927698:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11879 00000100:00100000:0.0:1746143121.927703:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858450048:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143121.927711:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.927722:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132050e00/0x25aee876ca70bfeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f627 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.927922:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861170688:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143121.927944:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.928006:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858450176 00000100:00100000:0.0:1746143121.928009:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858450176 00000100:00100000:0.0:1746143121.928052:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8057 00000100:00100000:0.0:1746143121.928058:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30698:x1830962858450176:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143121.928073:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143121.928085:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e12800/0x25aee876ca70bff2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f62e expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.928137:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e12800/0x25aee876ca70bff2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f62e expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.928150:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e12800/0x25aee876ca70bff2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f62e expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.928173:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143121.928175:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143121.928178:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e12800, rc 0) 00000100:00100000:0.0:1746143121.928204:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30698:x1830962858450176:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 146us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.928210:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8057 00000100:00100000:1.0:1746143121.932769:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858449536:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 34785us (43584us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143121.932781:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5758 00002000:00100000:1.0:1746143121.932793:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880090f20000 x1830962858449536/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.932803:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20000 with x1830962858449536 ext(1048576->2097151) 00002000:00010000:1.0:1746143121.932808:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f20000 00000100:00100000:1.0:1746143121.934208:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861170560:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143121.934242:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132051c00/0x25aee876ca70bfe4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f620 expref: 34 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.934257:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132051c00/0x25aee876ca70bfe4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f620 expref: 34 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.934271:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132051c00, rc 0) 00000100:00100000:1.0:1746143121.934302:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858449920:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7226us (7531us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143121.936125:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11878 00000100:00100000:1.0:1746143121.936201:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.936275:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.936298:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.936324:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143121.936338:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.936344:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858450432 00000100:00100000:3.0:1746143121.936352:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858450432 00000100:00100000:1.0:1746143121.936352:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143121.936382:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858450688 00000100:00100000:3.0:1746143121.936384:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858450688 00000100:00100000:3.0:1746143121.936394:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858450304 00000100:00100000:1.0:1746143121.936394:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858450944 00000100:00100000:3.0:1746143121.936396:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858450304 00000100:00100000:1.0:1746143121.936398:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858450944 00000100:00100000:3.0:1746143121.936405:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858450560 00000100:00100000:3.0:1746143121.936407:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858450560 00000100:00100000:1.0:1746143121.936429:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858450816 00000100:00100000:1.0:1746143121.936432:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858450816 00000100:00100000:3.0:1746143121.936441:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11880 00000100:00100000:3.0:1746143121.936447:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858450432:12345-192.168.201.28@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143121.936453:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11881 00000100:00100000:1.0:1746143121.936458:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858450688:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143121.936487:0:10061:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.936488:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.936505:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 18 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.936506:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 9 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143121.936515:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 25 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.936515:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.936521:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.936522:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 25 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.936523:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143121.936525:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.936528:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.936529:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.936531:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.936553:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 25 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.936554:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.936565:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 25 pid: 8449 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.936565:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143121.936578:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861170816:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143121.936580:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861170944:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143121.936633:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11882 00000100:00100000:3.0:1746143121.936638:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858450304:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143121.936642:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 18 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.936652:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 18 pid: 26949 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143121.936654:0:4756:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.936660:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861171072:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143121.936664:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143121.936670:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143121.936676:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 32 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143121.936680:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143121.936682:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.936683:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143121.936685:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.936697:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11883 00010000:00010000:3.0:1746143121.936699:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 32 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143121.936703:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858450944:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143121.936707:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 32 pid: 8449 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143121.936718:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861171200:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143121.936720:0:8449:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.936730:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.936736:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143121.936738:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746143121.936740:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11884 00010000:00010000:1.0:1746143121.936740:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.936745:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143121.936748:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858450560:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143121.936753:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 18 pid: 22204 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.936755:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.936763:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 25 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143121.936764:0:21048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143121.936766:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861171328:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143121.936771:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861171456:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.936773:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 9 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.936781:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 25 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.936787:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 25 pid: 26949 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143121.936792:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3900 going to sleep for 11 seconds 00010000:00010000:3.0:1746143121.936793:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 8 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.936793:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.936795:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.936796:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.936801:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 8 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:1.0:1746143121.936806:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11885 00000100:00100000:3.0:1746143121.936810:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861171584:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.936810:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 25 pid: 26949 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143121.936811:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858450816:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143121.936818:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 25 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.936825:0:754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.936826:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861171712:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143121.936833:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.936838:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143121.936839:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143121.936841:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.936849:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 25 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143121.936853:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.936856:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 25 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.936860:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 18 pid: 4758 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143121.936863:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861171840:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143121.936866:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143121.936866:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861171968:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143121.936878:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00010000:00010000:2.0:1746143121.936882:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 9 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143121.936889:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 9 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143121.936891:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 25 pid: 20836 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143121.936897:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861172096:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143121.936899:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 25 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143121.936907:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861172224:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.936909:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450540 going to sleep for 11 seconds 00010000:00010000:3.0:1746143121.936932:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 9 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143121.936940:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 9 pid: 26949 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143121.936947:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861172352:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143121.936964:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143121.937328:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861170688:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143121.937351:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132050e00/0x25aee876ca70bfeb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f627 expref: 25 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.937367:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132050e00/0x25aee876ca70bfeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f627 expref: 25 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143121.937374:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050e00, rc 0) 00000100:00100000:0.0:1746143121.937404:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858450048:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9701us (9859us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143121.937410:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11879 00000100:00100000:0.0:1746143121.951713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.951745:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.951761:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.951774:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.952014:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.952078:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861170816:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143121.952089:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861171072:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.952118:0:10061:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.952146:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861170944:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143121.952155:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861172224:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143121.952162:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861172352:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.952179:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.952202:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861171200:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143121.952209:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861171328:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143121.952216:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861171584:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143121.952230:0:4756:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143121.952252:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858451072 00000100:00100000:0.0:1746143121.952257:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858451072 00010000:00010000:0.0:1746143121.952290:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 24 pid: 8449 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.952315:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6277 00000100:00100000:0.0:1746143121.952323:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858451072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.952337:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.952578:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 24 pid: 8449 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.952588:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 24 pid: 8449 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.952610:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd3600/0x25aee876ca70bec5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f55c expref: 24 pid: 8449 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.952625:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.952666:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858451072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 344us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.952672:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6277 00000100:00100000:0.0:1746143121.952727:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858451200 00000100:00100000:0.0:1746143121.952730:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858451200 00010000:00010000:0.0:1746143121.952740:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 33 pid: 8449 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.952753:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858451328 00000100:00100000:0.0:1746143121.952755:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858451328 00010000:00010000:0.0:1746143121.952763:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 19 pid: 26949 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.952772:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858451456 00000100:00100000:0.0:1746143121.952773:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858451456 00010000:00010000:0.0:1746143121.952780:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 20 pid: 22204 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.952790:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6278 00000100:00100000:0.0:1746143121.952794:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1970:x1830962858451200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143121.953068:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861171456:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143121.953080:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.953103:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861171968:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143121.953112:0:754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.953130:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6279 00000100:00100000:1.0:1746143121.953135:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858451328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143121.953144:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.953158:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 20 pid: 26949 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.953166:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 20 pid: 26949 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.953178:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093fb5e00/0x25aee876ca70bf74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e1 expref: 20 pid: 26949 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.953190:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143121.953203:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858451328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 69us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.953208:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6279 00000100:00100000:1.0:1746143121.953218:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6280 00000100:00100000:1.0:1746143121.953221:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858451456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143121.953227:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143121.953236:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 18 pid: 22204 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.953243:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 18 pid: 22204 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.953251:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094234e00/0x25aee876ca70bf20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f594 expref: 18 pid: 22204 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746143121.953258:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143121.953266:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858451456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 45us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.953271:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6280 00000100:00100000:1.0:1746143121.953285:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858451584 00000100:00100000:1.0:1746143121.953287:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858451584 00002000:00100000:1.0:1746143121.953310:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2539520->3145727) req@ffff88012b801880 x1830962858451584/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.953319:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801880 with x1830962858451584 ext(2539520->3145727) 00010000:00010000:1.0:1746143121.953324:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.953332:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.953338:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b801880 00000100:00100000:1.0:1746143121.953347:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1910 00000100:00100000:1.0:1746143121.953351:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858451584:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143121.955111:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861171712:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.955126:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861171840:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143121.955135:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861172096:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143121.955159:0:21048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.957247:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.957283:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 33 pid: 8449 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.957299:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 33 pid: 8449 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.957320:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cd3c00/0x25aee876ca70beb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f54e expref: 33 pid: 8449 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.957338:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.957381:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858451200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4584us (5634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.957391:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6278 00000100:00100000:0.0:1746143121.957628:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.957659:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.957680:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.957756:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.957774:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.957788:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.957801:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.958005:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.958027:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858451840 00000100:00100000:0.0:1746143121.958051:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858451840 00010000:00010000:0.0:1746143121.958073:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 9 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.958088:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858451712 00000100:00100000:0.0:1746143121.958090:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858451712 00010000:00010000:0.0:1746143121.958103:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 23 pid: 26949 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.958112:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858452480 00000100:00100000:0.0:1746143121.958114:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858452480 00010000:00010000:0.0:1746143121.958122:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.958136:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858452224 00000100:00100000:0.0:1746143121.958138:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858452224 00010000:00010000:0.0:1746143121.958147:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 28 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.958155:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858452608 00000100:00100000:0.0:1746143121.958157:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858452608 00010000:00010000:0.0:1746143121.958165:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 29 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.958173:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858452096 00000100:00100000:0.0:1746143121.958174:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858452096 00010000:00010000:0.0:1746143121.958185:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 10 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.958193:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858452352 00000100:00100000:0.0:1746143121.958195:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858452352 00010000:00010000:0.0:1746143121.958202:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 11 pid: 26949 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143121.958212:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6281 00000100:00100000:0.0:1746143121.958218:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858451840:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.958227:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.958238:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 9 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958250:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 9 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958263:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b66dc00/0x25aee876ca70be08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f50f expref: 9 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958272:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.958274:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.958279:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.958288:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.958307:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.958326:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858451840:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 108us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.958332:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6281 00000100:00100000:0.0:1746143121.958342:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6282 00000100:00100000:0.0:1746143121.958347:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858451712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.958354:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143121.958365:0:4759:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746143121.958369:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 23 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958377:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 23 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958389:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cd4e00/0x25aee876ca70becc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f563 expref: 23 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958398:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.958411:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858451712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 63us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.958431:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6282 00000100:00100000:0.0:1746143121.958441:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6283 00000100:00100000:0.0:1746143121.958446:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1971:x1830962858452480:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.958452:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.958461:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.958469:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.958479:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b43b400/0x25aee876ca70bf82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5ef expref: 32 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.958489:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.958490:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.958493:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.958499:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.958513:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.958527:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858452480:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 81us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.958532:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6283 00000100:00100000:0.0:1746143121.958542:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6284 00000100:00100000:0.0:1746143121.958547:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858452224:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.958553:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.958560:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 29 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958569:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 29 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958579:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b201400/0x25aee876ca70bf2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a9 expref: 29 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958587:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.958601:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858452224:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 54us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.958606:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6284 00000100:00100000:0.0:1746143121.958635:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6285 00000100:00100000:0.0:1746143121.958639:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858452608:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.958645:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.958654:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 27 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958663:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 27 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143121.958674:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b200800/0x25aee876ca70bf27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5a2 expref: 27 pid: 20836 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143121.958718:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6286 00000100:00100000:2.0:1746143121.958725:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858452096:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143121.958731:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143121.958739:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 11 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143121.958747:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 11 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143121.958756:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66ce00/0x25aee876ca70be16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f51d expref: 11 pid: 20836 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143121.958765:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.958766:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.958769:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.958775:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.958787:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143121.958801:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858452096:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 77us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.958806:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6286 00000100:00100000:2.0:1746143121.958816:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6287 00000100:00100000:2.0:1746143121.958819:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858452352:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143121.958824:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143121.960156:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858451968 00000100:00100000:1.0:1746143121.960166:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858451968 00002000:00100000:1.0:1746143121.960199:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3452927) req@ffff88012b800380 x1830962858451968/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.960209:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800380 with x1830962858451968 ext(3145728->3452927) 00010000:00010000:1.0:1746143121.960216:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 17 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.960227:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 17 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.960233:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b800380 00000100:00100000:1.0:1746143121.960246:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1911 00000100:00100000:1.0:1746143121.960252:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858451968:12345-192.168.201.28@tcp:4:cat.0 00010000:00010000:1.0:1746143121.962107:0:10061:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.962119:0:10061:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.962148:0:10061:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.962156:0:10061:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.962175:0:10061:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.962182:0:10061:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b375400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143121.962187:0:10061:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.962195:0:10061:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.962214:0:10061:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.962221:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b375400/0x25aee876ca70bff9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.962285:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858450688:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 25824us (26007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.962295:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11881 00010000:00010000:3.0:1746143121.963363:0:21048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.963375:0:21048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.963398:0:21048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.963405:0:21048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.963655:0:21048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.963664:0:21048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094444600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143121.963667:0:21048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.963679:0:21048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.963694:0:21048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.963701:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094444600/0x25aee876ca70c015 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143121.963819:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858450560:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 27067us (27474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143121.963826:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11884 00010000:00010000:1.0:1746143121.965217:0:4756:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.965229:0:4756:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.965255:0:4756:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.965263:0:4756:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.965270:0:4756:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.965276:0:4756:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095328e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143121.965280:0:4756:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.965287:0:4756:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.965301:0:4756:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.965307:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095328e00/0x25aee876ca70c007 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.965366:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858450304:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 28725us (29039us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.965373:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11882 00010000:00010000:0.0:1746143121.968370:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.968647:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143121.969686:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 8 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143121.969702:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 8 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143121.969725:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cd2000/0x25aee876ca70be0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f516 expref: 8 pid: 26949 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143121.969738:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.969741:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143121.969746:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.969755:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.969790:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143121.970021:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.970045:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143121.970047:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858452352:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11223us (12038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.970057:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6287 00010000:00010000:3.0:1746143121.970077:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.970086:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.970094:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.970111:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f59600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143121.970116:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.970124:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.970136:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143121.970142:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f59600/0x25aee876ca70c000 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.970146:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858452864 00000100:00100000:1.0:1746143121.970155:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858452864 00000100:00100000:3.0:1746143121.970192:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858450432:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 33744us (33993us total) trans 0 rc 0/0 00002000:00100000:1.0:1746143121.970197:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88012b801c00 x1830962858452864/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/0 e 0 to 0 dl 1746143132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143121.970201:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11880 00002000:00100000:1.0:1746143121.970211:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801c00 with x1830962858452864 ext(2097152->3145727) 00010000:00010000:1.0:1746143121.970219:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.970228:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.970235:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b801c00 00000100:00100000:1.0:1746143121.970265:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1912 00000100:00100000:1.0:1746143121.970271:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858452864:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143121.971558:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143121.971602:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858452992 00000100:00100000:2.0:1746143121.971606:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858452992 00000100:00100000:2.0:1746143121.971633:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11886 00000100:00100000:2.0:1746143121.971639:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:30697:x1830962858452992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143121.971651:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143121.971666:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f635 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.971688:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143121.971693:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.971699:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143121.971703:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.971716:0:4758:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.971728:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143121.971737:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444c00, rc 0) 00000100:00100000:2.0:1746143121.971937:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:30697:x1830962858452992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 298us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.971944:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11886 00000100:00100000:2.0:1746143121.972534:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858452608:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13890us (14741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143121.972544:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6285 00000100:00100000:1.0:1746143121.989120:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858451968:12345-192.168.201.28@tcp:4:cat.0 Request processed in 28857us (31353us total) trans 21474839934 rc 0/0 00000100:00100000:1.0:1746143121.989133:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1911 00002000:00100000:1.0:1746143121.989146:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3452927) req@ffff88012b800380 x1830962858451968/t21474839934(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/448 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.989155:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800380 with x1830962858451968 ext(3145728->3452927) 00010000:00010000:1.0:1746143121.989166:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 21 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.989180:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 21 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.989186:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b800380 00000100:00100000:1.0:1746143121.994131:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858452864:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23849us (25479us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143121.994144:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1912 00002000:00100000:1.0:1746143121.994156:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88012b801c00 x1830962858452864/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/440 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.994167:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801c00 with x1830962858452864 ext(2097152->3145727) 00010000:00010000:1.0:1746143121.994178:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.994192:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.994198:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b801c00 00000100:00100000:1.0:1746143121.994237:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858451584:12345-192.168.201.28@tcp:4:cat.0 Request processed in 40885us (42222us total) trans 17179872678 rc 0/0 00000100:00100000:1.0:1746143121.994243:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1910 00002000:00100000:1.0:1746143121.994247:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2539520->3145727) req@ffff88012b801880 x1830962858451584/t17179872678(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:272/0 lens 488/448 e 0 to 0 dl 1746143132 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143121.994254:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801880 with x1830962858451584 ext(2539520->3145727) 00010000:00010000:1.0:1746143121.994259:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143121.994266:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143121.994271:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b801880 00000100:00100000:2.0:1746143121.997590:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143121.997619:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858453120 00000100:00100000:0.0:1746143121.997628:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858453120 00010000:00010000:0.0:1746143121.997664:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143121.997704:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6288 00000100:00100000:0.0:1746143121.997713:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858453120:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143121.997727:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143121.997749:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.997933:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.997956:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094444e00/0x25aee876ca70bf6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5da expref: 26 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143121.997976:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.997978:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143121.997983:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.997991:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143121.998025:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143121.998091:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858453120:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 378us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143121.998098:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6288 00010000:00010000:1.0:1746143121.998380:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.998390:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.998424:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.998432:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.998440:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.998446:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b375800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143121.998450:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.998457:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.998468:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143121.998475:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c00e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143121.998532:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858450944:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 61828us (62232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143121.998541:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11883 00000100:00100000:1.0:1746143122.004271:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.004298:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858453248 00000100:00100000:0.0:1746143122.004308:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858453248 00000100:00100000:0.0:1746143122.004347:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11887 00000100:00100000:0.0:1746143122.004355:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30696:x1830962858453248:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143122.004365:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143122.004373:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143122.004590:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f63c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.005377:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858453376 00000100:00100000:1.0:1746143122.005381:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858453376 00002000:00010000:0.0:1746143122.005392:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x68140790, atime: 0x6814078d, ctime: 0x68140790, blocks: 0x1029 00010000:00010000:1.0:1746143122.005401:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143122.005426:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143122.005428:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143122.005442:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6289 00000100:00100000:1.0:1746143122.005448:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858453376:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143122.005457:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143122.005475:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143122.005486:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143122.005505:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094445400/0x25aee876ca70bf7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5e8 expref: 19 pid: 4758 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143122.005518:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.005520:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.005523:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.005525:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005535:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.005540:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.005549:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b200600, rc 0) 00010000:00010000:1.0:1746143122.005556:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143122.005603:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858453376:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 154us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.005610:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6289 00010000:00010000:1.0:1746143122.005632:0:754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005641:0:754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005660:0:754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005667:0:754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005674:0:754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005681:0:754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b374800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143122.005684:0:754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005696:0:754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005704:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.005705:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.005709:0:754:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005715:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.005738:0:754:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.005750:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861172480:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143122.006102:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30696:x1830962858453248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1746us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.006108:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11887 00000100:00100000:1.0:1746143122.006767:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000001:00080000:2.0:1746143122.008899:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872666 is committed 00000001:00080000:2.0:1746143122.008913:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872652 is committed 00000001:00080000:2.0:1746143122.008933:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872676 is committed 00000001:00080000:2.0:1746143122.008950:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872661 is committed 00000001:00080000:2.0:1746143122.008956:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872657 is committed 00000001:00080000:2.0:1746143122.009020:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872677 is committed 00000100:00100000:1.0:1746143122.013495:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861172480:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143122.013527:0:754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.013538:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b374800/0x25aee876ca70c01c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.013618:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858450816:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 76805us (77263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.013631:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11885 00000100:00100000:2.0:1746143122.014116:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.014324:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858453632 00000100:00100000:1.0:1746143122.014331:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858453632 00002000:00100000:1.0:1746143122.014590:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008eb21180 x1830962858453632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.014600:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21180 with x1830962858453632 ext(2097152->3145727) 00002000:00010000:1.0:1746143122.014606:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb21180 00000100:00100000:1.0:1746143122.014624:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5759 00000100:00100000:1.0:1746143122.014631:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858453632:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143122.015707:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.015828:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858453888 00000100:00100000:0.0:1746143122.015834:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858453888 00000100:00080000:2.0:1746143122.015859:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1746143122.015869:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009a708700 x1830962858453888/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.015883:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a708700 with x1830962858453888 ext(2097152->3145727) 00002000:00010000:0.0:1746143122.015887:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a708700 00000100:00100000:0.0:1746143122.015900:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5760 00000100:00100000:0.0:1746143122.015906:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858453888:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143122.015954:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.018490:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858454144 00000100:00100000:1.0:1746143122.018500:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858454144 00000100:00100000:1.0:1746143122.018552:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8058 00000100:00100000:1.0:1746143122.018559:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30698:x1830962858454144:12345-192.168.201.28@tcp:36:mirror_io.0 00010000:00010000:1.0:1746143122.018606:0:14795:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143122.018636:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e12800/0x25aee876ca70bff2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f62e expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.018656:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143122.018661:0:14795:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143122.018691:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.018703:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 199 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.018711:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 7 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.018719:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 199 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.018726:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.018757:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 199 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.018768:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 199 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143122.018779:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861172608:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143122.018869:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 7 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.018877:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 7 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143122.018886:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861172736:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143122.018915:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 199 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.018922:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 199 pid: 1037 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143122.018930:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861172864:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143122.018951:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.030540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.030586:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.030676:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861172608:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143122.030687:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861172736:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143122.030694:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861172864:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143122.030720:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:1.0:1746143122.032678:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.034406:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858454272 00000100:00100000:2.0:1746143122.034427:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858454272 00010000:00010000:2.0:1746143122.034476:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 200 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143122.034503:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858454400 00000100:00100000:3.0:1746143122.034508:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858454400 00010000:00010000:3.0:1746143122.034528:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 8 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143122.034549:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858454528 00000100:00100000:3.0:1746143122.034552:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858454528 00010000:00010000:3.0:1746143122.034561:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 201 pid: 1037 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143122.034594:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6290 00000100:00100000:3.0:1746143122.034601:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1971:x1830962858454400:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143122.034612:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6291 00010000:00010000:3.0:1746143122.034618:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143122.034619:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858454528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143122.034624:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 8 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143122.034627:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143122.034630:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 201 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143122.034634:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 8 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143122.034647:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 201 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143122.034667:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cd2800/0x25aee876ca70bf51 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f59b expref: 201 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143122.034692:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143122.034697:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.034705:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143122.034743:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1969:x1830962858454528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 126us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.034753:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6291 00000100:00100000:0.0:1746143122.035320:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858453632:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20688us (21204us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746143122.035886:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70bf58 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5c5 expref: 8 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143122.035897:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143122.035900:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143122.035906:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.035923:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6292 00000100:00100000:3.0:1746143122.035925:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1971:x1830962858454400:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1325us (5339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.035930:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6290 00000100:00100000:2.0:1746143122.035932:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1969:x1830962858454272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.035942:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.035946:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 199 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143122.035954:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 199 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143122.035966:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23800/0x25aee876ca70bf5f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f5cc expref: 199 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143122.035986:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143122.035989:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143122.035997:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143122.036004:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143122.036169:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.036192:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:1969:x1830962858454272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 261us (5663us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.036199:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6292 00010000:00010000:1.0:1746143122.036340:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.036348:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000040:00080000:1.0:1746143122.037660:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2314, 88 off196336 00000004:00080000:1.0:1746143122.037669:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877636568ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037716:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2340, 88 off198368 00000004:00080000:1.0:1746143122.037722:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903877690078ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143122.037736:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2341, 88 off198456 00000004:00080000:1.0:1746143122.037739:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903877707526ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143122.037747:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2315, 88 off196424 00000004:00080000:1.0:1746143122.037749:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877717886ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037756:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2316, 88 off196512 00000004:00080000:1.0:1746143122.037759:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877727478ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037766:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2342, 88 off198544 00000004:00080000:1.0:1746143122.037769:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903877737804ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143122.037776:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2343, 88 off198632 00000004:00080000:1.0:1746143122.037779:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903877747358ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143122.037786:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2344, 88 off198720 00000004:00080000:1.0:1746143122.037789:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903877757412ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143122.037820:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2318, 88 off196696 00000004:00080000:1.0:1746143122.037824:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877792579ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037833:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2345, 88 off198808 00000004:00080000:1.0:1746143122.037836:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903877804244ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143122.037843:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2319, 88 off196784 00000004:00080000:1.0:1746143122.037846:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877814479ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037852:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2346, 88 off198896 00000004:00080000:1.0:1746143122.037855:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903877823321ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143122.037862:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2320, 88 off196872 00000004:00080000:1.0:1746143122.037864:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877833048ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037871:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2321, 88 off196960 00000004:00080000:1.0:1746143122.037874:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877842359ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037881:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2322, 88 off197048 00000004:00080000:1.0:1746143122.037883:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877851841ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037890:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2323, 88 off197136 00000004:00080000:1.0:1746143122.037894:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903877862696ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143122.037901:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2347, 88 off198984 00000004:00080000:1.0:1746143122.037904:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903877872493ns, next at 860119223596ns, rc = 0 00000100:00100000:0.0:1746143122.039549:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5759 00002000:00100000:0.0:1746143122.039566:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008eb21180 x1830962858453632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.039578:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21180 with x1830962858453632 ext(2097152->3145727) 00002000:00010000:0.0:1746143122.039585:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb21180 00000100:00080000:2.0:1746143122.040540:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143122.042301:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858453888:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26390us (26593us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143122.042311:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5760 00002000:00100000:3.0:1746143122.042320:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009a708700 x1830962858453888/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.042336:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a708700 with x1830962858453888 ext(2097152->3145727) 00002000:00010000:3.0:1746143122.042342:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a708700 00000100:00100000:3.0:1746143122.055371:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.055474:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.055589:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858454656 00000100:00100000:0.0:1746143122.055599:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858454656 00000100:00100000:2.0:1746143122.055738:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858454784 00000100:00100000:2.0:1746143122.055743:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858454784 00000100:00100000:1.0:1746143122.055772:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11888 00000100:00100000:2.0:1746143122.055778:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11889 00000100:00100000:2.0:1746143122.055783:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30697:x1830962858454784:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143122.055783:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30696:x1830962858454656:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.055800:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.055800:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.055821:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f64a expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.055821:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f643 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.055850:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.055850:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.055852:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.055852:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.055860:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 17 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.055860:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.055876:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 17 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.055876:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.055887:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094445200, rc 0) 00010000:00010000:1.0:1746143122.055889:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66ca00, rc 0) 00000100:00100000:2.0:1746143122.056773:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:30697:x1830962858454784:12345-192.168.201.28@tcp:101:cat.0 Request processed in 985us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.056773:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30696:x1830962858454656:12345-192.168.201.28@tcp:101:cat.0 Request processed in 988us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.056780:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11889 00000100:00100000:1.0:1746143122.056783:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11888 00000100:00080000:2.0:1746143122.056803:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143122.061629:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.062109:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.063437:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858454912 00000100:00100000:3.0:1746143122.063445:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858454912 00000100:00100000:3.0:1746143122.063479:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858455040 00000100:00100000:3.0:1746143122.063481:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858455040 00000100:00100000:3.0:1746143122.063498:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8059 00000100:00100000:3.0:1746143122.063505:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30696:x1830962858454912:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.063528:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.063546:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f651 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.063601:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143122.063610:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.063626:0:17079:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143122.063637:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.063650:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143122.063653:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143122.063657:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.063664:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f22a00, rc 0) 00000100:00100000:3.0:1746143122.063708:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30696:x1830962858454912:12345-192.168.201.28@tcp:101:cat.0 Request processed in 204us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.063714:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8059 00000100:00100000:3.0:1746143122.063727:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8060 00000100:00100000:3.0:1746143122.063732:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:30697:x1830962858455040:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.063739:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.063744:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f658 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.063762:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.063771:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.063777:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143122.063779:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143122.063782:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.063787:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f23200, rc 0) 00000100:00100000:3.0:1746143122.063799:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30697:x1830962858455040:12345-192.168.201.28@tcp:101:cat.0 Request processed in 68us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.063804:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8060 00000100:00100000:3.0:1746143122.085010:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.085054:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858455296 00000100:00100000:1.0:1746143122.085063:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858455296 00000100:00100000:1.0:1746143122.085118:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8061 00000100:00100000:1.0:1746143122.085126:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30702:x1830962858455296:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143122.085143:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.085160:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c800/0x25aee876ca70c054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f65f expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.085246:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143122.085258:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143122.085267:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143122.085277:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143122.085282:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143122.085291:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00010000:1.0:1746143122.097314:0:14795:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a70a300 reply state ffff880136ba7400 transno 8589942262 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00000100:00100000:1.0:1746143122.097329:0:14795:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746143122.097394:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.097653:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 11 pid: 1037 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.097654:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30698:x1830962858454144:12345-192.168.201.28@tcp:36:mirror_io.0 Request processed in 79089us (81693us total) trans 8589942262 rc 0/0 00000100:00100000:1.0:1746143122.097662:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8058 00010000:00010000:0.0:1746143122.097663:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00000001:00080000:1.0:1746143122.097699:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942259 is committed 00010000:00010000:0.0:1746143122.097703:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746143122.097715:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942262 is committed 00000004:00080000:1.0:1746143122.097718:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1765 committed 00010000:00010000:0.0:1746143122.097720:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00000004:00080000:1.0:1746143122.097733:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1746 committed 00000004:00080000:1.0:1746143122.097738:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1745 committed 00000004:00080000:1.0:1746143122.097739:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1744 committed 00000004:00080000:1.0:1746143122.097741:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1743 committed 00000100:00100000:0.0:1746143122.097918:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861172992:192.168.201.28@tcp:104: 00000004:00080000:1.0:1746143122.097927:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1764 committed 00000004:00080000:1.0:1746143122.097930:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1742 committed 00000004:00080000:1.0:1746143122.097931:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1763 committed 00000004:00080000:1.0:1746143122.097933:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1741 committed 00000004:00080000:1.0:1746143122.097934:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1762 committed 00000004:00080000:1.0:1746143122.097936:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1761 committed 00000004:00080000:1.0:1746143122.097937:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1760 committed 00000004:00080000:1.0:1746143122.097939:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1740 committed 00000004:00080000:1.0:1746143122.097940:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1739 committed 00000004:00080000:1.0:1746143122.097942:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1759 committed 00000004:00080000:1.0:1746143122.097943:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1758 committed 00000004:00080000:1.0:1746143122.097945:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1738 committed 00000001:00080000:1.0:1746143122.097956:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942258 is committed 00000100:00100000:0.0:1746143122.097999:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143122.098185:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861173248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098226:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.098245:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861173760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098258:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.098272:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143122.098276:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861173120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098288:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.098299:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861173632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098310:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.098325:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861173376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098339:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.098349:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861173888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098362:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.098371:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746143122.098375:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861173504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098386:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.098395:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861174016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098406:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.098445:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861173248 00000100:00100000:3.0:1746143122.098451:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861173248 00000100:00100000:3.0:1746143122.098483:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861173760 00000100:00100000:3.0:1746143122.098485:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861173760 00000100:00100000:3.0:1746143122.098495:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861173120 00000100:00100000:3.0:1746143122.098497:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861173120 00000100:00100000:3.0:1746143122.098505:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861173632 00000100:00100000:3.0:1746143122.098507:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861173632 00000100:00100000:3.0:1746143122.098515:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861173376 00000100:00100000:3.0:1746143122.098517:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861173376 00000100:00100000:3.0:1746143122.098523:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861173888 00000100:00100000:3.0:1746143122.098524:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861173888 00000100:00100000:3.0:1746143122.098531:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861173504 00000100:00100000:3.0:1746143122.098532:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861173504 00000100:00100000:3.0:1746143122.098540:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861174016 00000100:00100000:3.0:1746143122.098541:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861174016 00000100:00100000:3.0:1746143122.098550:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11890 00000100:00100000:3.0:1746143122.098556:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861173248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098779:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861173248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (552us total) trans 17179872679 rc 0/0 00000100:00100000:3.0:1746143122.098786:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11890 00000100:00100000:3.0:1746143122.098798:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11891 00000100:00100000:3.0:1746143122.098802:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861173760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098876:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861173760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (617us total) trans 17179872680 rc 0/0 00000100:00100000:3.0:1746143122.098881:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11891 00000100:00100000:3.0:1746143122.098890:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11892 00000100:00100000:3.0:1746143122.098894:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861173120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.098975:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861173120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (686us total) trans 17179872681 rc 0/0 00000100:00100000:3.0:1746143122.098981:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11892 00000100:00100000:3.0:1746143122.098989:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11893 00000100:00100000:3.0:1746143122.098993:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861173632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.099099:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861173632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (787us total) trans 17179872682 rc 0/0 00000100:00100000:3.0:1746143122.099108:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11893 00000100:00100000:3.0:1746143122.099118:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11894 00000100:00100000:3.0:1746143122.099122:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861173376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143122.099197:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143122.099200:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143120 -> 1746143120 00002000:00010000:3.0:1746143122.099202:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143117 -> 1746143117 00002000:00010000:3.0:1746143122.099204:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143120 -> 1746143120 00002000:00010000:3.0:1746143122.099205:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143122.099227:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861173376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (888us total) trans 17179872683 rc 0/0 00000100:00100000:3.0:1746143122.099232:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11894 00000100:00100000:3.0:1746143122.099242:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11895 00000100:00100000:3.0:1746143122.099246:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861173888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.099326:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861173888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (962us total) trans 17179872684 rc 0/0 00000100:00100000:3.0:1746143122.099331:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11895 00000100:00100000:3.0:1746143122.099341:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11896 00000100:00100000:3.0:1746143122.099346:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861173504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.099647:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861173504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 300us (1259us total) trans 17179872685 rc 0/0 00000100:00100000:3.0:1746143122.099652:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11896 00000100:00100000:3.0:1746143122.099663:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11897 00000100:00100000:3.0:1746143122.099667:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861174016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.099747:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861174016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1339us total) trans 17179872686 rc 0/0 00000100:00100000:3.0:1746143122.099753:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11897 00000100:00080000:3.0:1746143122.099775:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143122.099813:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872677 gen 2 00000004:00080000:3.0:1746143122.099818:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb57480, transno 17179872662 00000004:00080000:3.0:1746143122.099824:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb55500, transno 17179872663 00000004:00080000:3.0:1746143122.099827:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb55f80, transno 17179872664 00000004:00080000:3.0:1746143122.099829:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb56a00, transno 17179872665 00000004:00080000:3.0:1746143122.099831:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb56d80, transno 17179872666 00000004:00080000:3.0:1746143122.099833:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb55180, transno 17179872667 00000004:00080000:3.0:1746143122.099835:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb54e00, transno 17179872668 00000004:00080000:3.0:1746143122.099837:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb57b80, transno 17179872669 00000004:00080000:3.0:1746143122.099839:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f576300, transno 17179872670 00000004:00080000:3.0:1746143122.099841:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f574e00, transno 17179872671 00000004:00080000:3.0:1746143122.099843:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091949500, transno 17179872672 00000004:00080000:3.0:1746143122.099845:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f575500, transno 17179872673 00000004:00080000:3.0:1746143122.099848:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091948000, transno 17179872674 00000004:00080000:3.0:1746143122.099849:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f575f80, transno 17179872675 00000004:00080000:3.0:1746143122.099851:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009194b100, transno 17179872676 00000004:00080000:3.0:1746143122.099853:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f575180, transno 17179872677 00000100:00100000:3.0:1746143122.099859:0:3299:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009a708a80 x1830962861173504/t17179872685(17179872685) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143138 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746143122.099868:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a708a80/2, rc 0, transno 17179872685 00000100:00100000:3.0:1746143122.099872:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861173504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.099880:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aeca80/2, rc 0, transno 17179872686 00000100:00100000:3.0:1746143122.099883:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861174016:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.099889:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a70b800/2, rc 0, transno 17179872683 00000100:00100000:3.0:1746143122.099893:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861173376:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.099899:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aed880/2, rc 0, transno 17179872684 00000100:00100000:3.0:1746143122.099902:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861173888:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.099917:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a709c00/2, rc 0, transno 17179872681 00000100:00100000:3.0:1746143122.099920:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861173120:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.099925:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a709f80/2, rc 0, transno 17179872682 00000100:00100000:3.0:1746143122.099928:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861173632:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.099933:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a709880/2, rc 0, transno 17179872679 00000100:00100000:3.0:1746143122.099936:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861173248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.099941:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aece00/2, rc 0, transno 17179872680 00000100:00100000:3.0:1746143122.099943:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861173760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.100154:0:14837:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 16 done 00010000:00010000:1.0:1746143122.100347:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.100358:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.100364:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.100369:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a6cc00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143122.100372:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.100378:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.100393:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143122.100609:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143122.100616:0:3286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 6 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.100630:0:3286:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 6 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.100638:0:3286:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 6 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.100648:0:3286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.100654:0:3286:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.100663:0:3286:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.100693:0:3286:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.100704:0:3286:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3286:1830962861174144:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143122.100772:0:3286:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 6 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.100780:0:3286:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3286:1830962861174272:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143122.100797:0:3286:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143122.100891:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861174528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.100927:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143122.100940:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861174528 00000100:00100000:1.0:1746143122.100946:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861174528 00000100:00100000:2.0:1746143122.100950:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861175040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.100969:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.100985:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143122.100987:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861175040 00000100:00100000:2.0:1746143122.100989:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861174400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.100990:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861175040 00000100:00100000:1.0:1746143122.101002:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11898 00000100:00100000:2.0:1746143122.101006:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143122.101008:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3302:x1830962861174528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.101019:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861174912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.101053:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.101074:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861174400 00000100:00100000:2.0:1746143122.101079:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861174400 00000100:00100000:2.0:1746143122.101100:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861174912 00000100:00100000:2.0:1746143122.101102:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861174912 00000100:00100000:2.0:1746143122.101113:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11899 00000100:00100000:2.0:1746143122.101118:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3302:x1830962861175040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.101209:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3302:x1830962861174528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (280us total) trans 21474839935 rc 0/0 00000100:00100000:1.0:1746143122.101215:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11898 00000100:00100000:1.0:1746143122.101230:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11900 00000100:00100000:1.0:1746143122.101236:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3302:x1830962861174400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.101240:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3302:x1830962861175040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (269us total) trans 21474839936 rc 0/0 00000100:00100000:2.0:1746143122.101246:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11899 00000100:00100000:2.0:1746143122.101259:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11901 00000100:00100000:2.0:1746143122.101263:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3302:x1830962861174912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.101319:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3302:x1830962861174400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (312us total) trans 21474839937 rc 0/0 00000100:00100000:1.0:1746143122.101327:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11900 00000100:00100000:2.0:1746143122.101560:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3302:x1830962861174912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 296us (505us total) trans 21474839938 rc 0/0 00000100:00100000:2.0:1746143122.101567:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11901 00000004:00080000:2.0:1746143122.101602:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d6d80/2, rc 0, transno 21474839937 00000100:00100000:2.0:1746143122.101625:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861174400:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143122.101651:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d5500/2, rc 0, transno 21474839938 00000100:00100000:2.0:1746143122.101654:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861174912:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143122.101662:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314d500/2, rc 0, transno 21474839936 00000100:00100000:2.0:1746143122.101664:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861175040:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143122.101672:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d5880/2, rc 0, transno 21474839935 00000100:00100000:2.0:1746143122.101675:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861174528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.101682:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746143122.101686:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861175424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.101704:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.101725:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861175424 00000100:00100000:2.0:1746143122.101727:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861175424 00000100:00100000:2.0:1746143122.101743:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11902 00000100:00100000:2.0:1746143122.101748:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3302:x1830962861175424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.103122:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3302:x1830962861175424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1370us (1413us total) trans 21474839939 rc 0/0 00000100:00100000:2.0:1746143122.103129:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11902 00000100:00100000:2.0:1746143122.105174:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861174784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.105225:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143122.105313:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e300/2, rc 0, transno 21474839939 00000100:00100000:0.0:1746143122.105321:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861175424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.105406:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861175296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.105438:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.105456:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746143122.105461:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861174656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.105474:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.105483:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861175168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.105495:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1746143122.105512:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143122.105514:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.105525:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861174784 00000100:00100000:0.0:1746143122.105530:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861175296 00000100:00100000:0.0:1746143122.105536:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861175296 00000100:00100000:1.0:1746143122.105549:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861174656 00000100:00100000:1.0:1746143122.105554:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861174656 00000100:00100000:0.0:1746143122.105561:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861175168 00000100:00100000:0.0:1746143122.105563:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861175168 00000100:00100000:0.0:1746143122.105585:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11903 00000100:00100000:1.0:1746143122.105591:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11904 00000100:00100000:0.0:1746143122.105592:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3300:x1830962861175296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143122.105597:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11905 00000100:00100000:1.0:1746143122.105598:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3300:x1830962861175168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143122.105605:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3300:x1830962861174656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.105645:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858455424 00000100:00100000:1.0:1746143122.105649:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858455424 00000100:00100000:1.0:1746143122.105669:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8062 00000100:00100000:1.0:1746143122.105674:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30698:x1830962858455424:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143122.105686:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.105700:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f666 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.105744:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143122.105750:0:8448:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:3.0:1746143122.105753:0:8448:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143120 -> 1746143120 00010000:00010000:1.0:1746143122.105755:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143122.105756:0:8448:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143120 -> 1746143118 00002000:00010000:3.0:1746143122.105758:0:8448:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143120 -> 1746143120 00002000:00010000:3.0:1746143122.105760:0:8448:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:0.0:1746143122.105762:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3300:x1830962861175296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (323us total) trans 21474839940 rc 0/0 00000100:00100000:0.0:1746143122.105769:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11903 00010000:00010000:1.0:1746143122.105770:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143122.105773:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143122.105776:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094445a00, rc 0) 00000100:00100000:3.0:1746143122.105783:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3300:x1830962861174656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (308us total) trans 21474839941 rc 0/0 00000100:00100000:3.0:1746143122.105789:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11905 00000100:00100000:0.0:1746143122.105801:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861172992:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143122.105812:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30698:x1830962858455424:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 136us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.105817:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8062 00010000:00010000:0.0:1746143122.105818:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:2.0:1746143122.105867:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861174784 00000100:00100000:2.0:1746143122.105918:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11906 00000100:00100000:2.0:1746143122.105924:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3300:x1830962861174784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.106080:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3300:x1830962861174784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (855us total) trans 21474839942 rc 0/0 00000100:00100000:2.0:1746143122.106085:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11906 00000004:00080000:2.0:1746143122.106117:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d4a80/2, rc 0, transno 21474839941 00000100:00100000:2.0:1746143122.106122:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861174656:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143122.106131:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d4380/2, rc 0, transno 21474839942 00000100:00100000:2.0:1746143122.106134:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861174784:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143122.106142:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314ce00/2, rc 0, transno 21474839940 00000100:00100000:2.0:1746143122.106146:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861175296:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143122.106388:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143122.106391:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143122.106394:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143122.106395:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143122.106397:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143122.106429:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3300:x1830962861175168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 832us (932us total) trans 21474839943 rc 0/0 00000100:00100000:1.0:1746143122.106435:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11904 00000004:00080000:2.0:1746143122.106685:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314d180/2, rc 0, transno 21474839943 00000100:00100000:2.0:1746143122.106690:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861175168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143122.108461:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.108501:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.108520:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858455552 00000100:00100000:2.0:1746143122.108528:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858455552 00010000:00010000:2.0:1746143122.108554:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143122.108578:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6293 00000100:00100000:2.0:1746143122.108584:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858455552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143122.108591:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858455808 00010000:00010000:2.0:1746143122.108595:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143122.108595:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858455808 00010000:00010000:2.0:1746143122.108599:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143122.108610:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143122.108615:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8063 00000100:00100000:1.0:1746143122.108619:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30704:x1830962858455808:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143122.108627:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009490a400/0x25aee876ca70bfd6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f619 expref: 9 pid: 1037 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143122.108629:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.108636:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143122.108638:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70c077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f66d expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.108641:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143122.108651:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143122.108657:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143122.108673:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.108706:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858455552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 123us (257us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143122.108710:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00000100:00100000:2.0:1746143122.108712:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6293 00010000:00010000:1.0:1746143122.108718:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143122.108725:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143122.108733:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143122.108738:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143122.108743:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.108948:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.108956:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:0.0:1746143122.108974:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143122.109055:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143122.109062:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143122.109067:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:1.0:1746143122.109074:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143122.109141:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109147:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109154:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109857:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b200a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143122.109862:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109869:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109882:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143122.109884:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143122.109888:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109893:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200a00/0x25aee876ca70c069 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109924:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109930:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109935:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109939:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b66c400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143122.109941:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109946:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109953:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143122.109955:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143122.109958:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109963:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c400/0x25aee876ca70c05b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109972:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109977:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109982:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109986:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b66ce00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143122.109990:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.109994:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.110001:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008fddf000) 00010000:00010000:0.0:1746143122.110003:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143122.110005:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.110009:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66ce00/0x25aee876ca70c062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143122.110114:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c800/0x25aee876ca70c054 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f65f expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.110123:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b66c800/0x25aee876ca70c054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f65f expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.110131:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66c800, rc 0) 00000100:00100000:0.0:1746143122.110173:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30702:x1830962858455296:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 25046us (25166us total) trans 8589942263 rc 301/301 00000100:00100000:0.0:1746143122.110180:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8061 00010000:00010000:0.0:1746143122.110224:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110230:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110235:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110243:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c044c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143122.110245:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110249:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110257:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143122.110259:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143122.110262:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110266:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c044c00/0x25aee876ca70c093 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110277:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110282:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110286:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00000100:00100000:3.0:1746143122.110287:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143122.110290:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094444600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143122.110293:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110298:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00000100:00100000:3.0:1746143122.110302:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143122.110304:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143122.110306:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143122.110308:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110313:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444600/0x25aee876ca70c07e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110322:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110327:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110332:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110336:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fd5c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143122.110338:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110342:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00000100:00100000:3.0:1746143122.110344:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143122.110347:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008fddf000) 00010000:00010000:0.0:1746143122.110350:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143122.110352:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110357:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd5c00/0x25aee876ca70c085 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.110383:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70c077 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f66d expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.110389:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094444200/0x25aee876ca70c077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f66d expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.110397:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094444200, rc 0) 00000100:00100000:0.0:1746143122.110440:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30704:x1830962858455808:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1819us (1938us total) trans 8589942264 rc 301/301 00000100:00100000:0.0:1746143122.110446:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8063 00000100:00100000:1.0:1746143122.110471:0:3286:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3286:1830962861174144:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143122.110484:0:3286:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3286:1830962861174272:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143122.110507:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143122.110513:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a6cc00/0x25aee876ca70c031 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14795 initiator: MDT0 00000100:00100000:2.0:1746143122.110525:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858455936 00000100:00100000:2.0:1746143122.110531:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858455936 00000100:00100000:2.0:1746143122.110644:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858456064 00000100:00100000:2.0:1746143122.110647:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858456064 00000100:00100000:2.0:1746143122.110659:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858456320 00000100:00100000:2.0:1746143122.110661:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858456320 00000100:00100000:2.0:1746143122.110672:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3384 00000100:00100000:2.0:1746143122.110677:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30696:x1830962858455936:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143122.110942:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30696:x1830962858455936:12345-192.168.201.28@tcp:49:cat.0 Request processed in 264us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.110948:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3384 00000100:00100000:2.0:1746143122.110958:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3385 00000100:00100000:2.0:1746143122.110964:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30697:x1830962858456064:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:0.0:1746143122.110989:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3386 00000100:00100000:0.0:1746143122.110995:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093940c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30698:x1830962858456320:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143122.110997:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30697:x1830962858456064:12345-192.168.201.28@tcp:49:cat.0 Request processed in 34us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.111001:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3385 00000100:00100000:0.0:1746143122.111114:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093940c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30698:x1830962858456320:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 118us (767us total) trans 8589942265 rc 0/0 00000100:00100000:0.0:1746143122.111120:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3386 00000100:00100000:0.0:1746143122.113161:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.116174:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858456576 00000100:00100000:2.0:1746143122.116187:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858456576 00000100:00100000:2.0:1746143122.116251:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3387 00000100:00100000:2.0:1746143122.116260:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30698:x1830962858456576:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143122.116534:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30698:x1830962858456576:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 274us (3378us total) trans 8589942266 rc 0/0 00000100:00100000:2.0:1746143122.116542:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3387 00000100:00100000:0.0:1746143122.121151:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.121250:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858456832 00000100:00100000:2.0:1746143122.121259:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858456832 00000100:00100000:2.0:1746143122.121302:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8064 00000100:00100000:2.0:1746143122.121309:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30704:x1830962858456832:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143122.121343:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.121347:0:1037:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143122.121375:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f22a00/0x25aee876ca70c046 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f651 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.121403:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143122.121407:0:1037:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143122.121431:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdc200/0x25aee876ca70c0a1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f674 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.121484:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.121496:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 198 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.121503:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.121513:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.121542:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.121553:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 8 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143122.121564:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a24a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861175552:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.121669:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 198 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.121677:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 198 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143122.121685:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a248380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861175680:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.121708:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.126003:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.126070:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.126113:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858457088 00000100:00100000:1.0:1746143122.126126:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858457088 00000100:00100000:0.0:1746143122.126131:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.126165:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:1.0:1746143122.126173:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88012b802a00 x1830962858457088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.126182:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802a00 with x1830962858457088 ext(3145728->4194303) 00002000:00010000:1.0:1746143122.126188:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b802a00 00000100:00100000:1.0:1746143122.126208:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858457344 00000100:00100000:1.0:1746143122.126211:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858457344 00002000:00100000:1.0:1746143122.126222:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88012b800000 x1830962858457344/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.126233:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800000 with x1830962858457344 ext(3145728->4194303) 00002000:00010000:1.0:1746143122.126237:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b800000 00000100:00100000:1.0:1746143122.126249:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5761 00000100:00100000:1.0:1746143122.126257:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858457088:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143122.126341:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858457472 00000100:00100000:2.0:1746143122.126348:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858457472 00010000:00010000:2.0:1746143122.126379:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 9 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143122.126403:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858457600 00000100:00100000:2.0:1746143122.126405:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858457600 00010000:00010000:2.0:1746143122.126428:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143122.126448:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6294 00000100:00100000:2.0:1746143122.126454:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858457472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.126466:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.126472:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 9 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143122.126482:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 9 pid: 14795 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143122.126503:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143122.126507:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.126514:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.126519:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.126558:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858457472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 104us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.126565:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6294 00000100:00100000:2.0:1746143122.126580:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6295 00000100:00100000:2.0:1746143122.126585:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1971:x1830962858457600:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.126592:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.126596:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143122.126609:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 199 pid: 17079 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143122.126618:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143122.126621:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.126627:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.126634:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.126649:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.126665:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1971:x1830962858457600:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 79us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.126670:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6295 00010000:00010000:2.0:1746143122.126707:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094445a00/0x25aee876ca70c070 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f666 expref: 8 pid: 14795 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143122.126722:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a24a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861175552:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.126732:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f23200/0x25aee876ca70c04d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f658 expref: 198 pid: 17079 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143122.126741:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a248380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861175680:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.126759:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.126786:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143122.126791:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:3.0:1746143122.127632:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5762 00000100:00100000:3.0:1746143122.127645:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1970:x1830962858457344:12345-192.168.201.28@tcp:3:multiop.0 00000040:00080000:2.0:1746143122.132714:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2324, 88 off197224 00000004:00080000:2.0:1746143122.132730:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903972697188ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.133953:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2348, 88 off199072 00000004:00080000:2.0:1746143122.133960:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903973928038ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143122.134024:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2349, 88 off199160 00000004:00080000:2.0:1746143122.134043:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903973996972ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143122.134053:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2325, 88 off197312 00000004:00080000:2.0:1746143122.134056:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903974024513ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.134286:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2326, 88 off197400 00000004:00080000:2.0:1746143122.134289:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903974258059ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.134297:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2350, 88 off199248 00000004:00080000:2.0:1746143122.134300:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903974268191ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143122.134308:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2351, 88 off199336 00000004:00080000:2.0:1746143122.134310:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903974278749ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143122.134316:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2352, 88 off199424 00000004:00080000:2.0:1746143122.134319:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903974287439ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143122.134325:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2327, 88 off197488 00000004:00080000:2.0:1746143122.134327:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903974295716ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.134333:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2353, 88 off199512 00000004:00080000:2.0:1746143122.134335:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903974303751ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143122.134341:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2328, 88 off197576 00000004:00080000:2.0:1746143122.134344:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903974312659ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.134350:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2354, 88 off199600 00000004:00080000:2.0:1746143122.134352:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903974320826ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143122.134358:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2329, 88 off197664 00000004:00080000:2.0:1746143122.134360:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903974328772ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.134366:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2330, 88 off197752 00000004:00080000:2.0:1746143122.134368:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903974336394ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.134373:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2331, 88 off197840 00000004:00080000:2.0:1746143122.134375:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903974343872ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.134381:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2332, 88 off197928 00000004:00080000:2.0:1746143122.134383:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903974351456ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143122.134388:0:1037:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2355, 88 off199688 00000004:00080000:2.0:1746143122.134391:0:1037:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903974359872ns, next at 860119223596ns, rc = 0 00000100:00100000:1.0:1746143122.150902:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.151795:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858458112 00000100:00100000:0.0:1746143122.151806:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858458112 00002000:00100000:0.0:1746143122.151858:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009314c700 x1830962858458112/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.151869:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c700 with x1830962858458112 ext(3145728->4194303) 00002000:00010000:0.0:1746143122.151876:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314c700 00000100:00100000:0.0:1746143122.151925:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5763 00000100:00100000:0.0:1746143122.151935:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858458112:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143122.162546:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.162752:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858457856 00000100:00100000:2.0:1746143122.162763:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858457856 00002000:00100000:2.0:1746143122.162811:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009314d880 x1830962858457856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.162822:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314d880 with x1830962858457856 ext(2097152->3145727) 00002000:00010000:2.0:1746143122.162828:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314d880 00000100:00100000:2.0:1746143122.162874:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5764 00000100:00100000:2.0:1746143122.162882:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858457856:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143122.166729:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.168183:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858458240 00000100:00100000:2.0:1746143122.168195:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858458240 00002000:00100000:2.0:1746143122.168243:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009314ed80 x1830962858458240/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.168255:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314ed80 with x1830962858458240 ext(3145728->4194303) 00002000:00010000:2.0:1746143122.168262:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314ed80 00000100:00100000:2.0:1746143122.168285:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5765 00000100:00100000:2.0:1746143122.168293:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858458240:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143122.171064:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858457088:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 44800us (45064us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143122.171076:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5761 00002000:00100000:0.0:1746143122.171086:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88012b802a00 x1830962858457088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.171097:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802a00 with x1830962858457088 ext(3145728->4194303) 00002000:00010000:0.0:1746143122.171103:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b802a00 00000100:00100000:3.0:1746143122.180730:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1970:x1830962858457344:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 53080us (54650us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143122.180745:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5762 00002000:00100000:3.0:1746143122.180762:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88012b800000 x1830962858457344/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.180772:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800000 with x1830962858457344 ext(3145728->4194303) 00002000:00010000:3.0:1746143122.180779:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b800000 00000100:00100000:1.0:1746143122.187329:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.187393:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858458496 00000100:00100000:0.0:1746143122.187405:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858458496 00000100:00100000:0.0:1746143122.187461:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8065 00000100:00100000:0.0:1746143122.187470:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30696:x1830962858458496:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143122.187490:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143122.187510:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f67b expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.187566:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.187575:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.187592:0:14796:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143122.187601:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.187617:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143122.187620:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143122.187623:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.187629:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b200e00, rc 0) 00000100:00100000:0.0:1746143122.187671:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30696:x1830962858458496:12345-192.168.201.28@tcp:101:cat.0 Request processed in 203us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.187677:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8065 00000100:00100000:1.0:1746143122.187755:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858458112:12345-192.168.201.28@tcp:3:cat.0 Request processed in 35821us (36866us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143122.187764:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5763 00002000:00100000:1.0:1746143122.187786:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009314c700 x1830962858458112/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.187799:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c700 with x1830962858458112 ext(3145728->4194303) 00002000:00010000:1.0:1746143122.187804:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314c700 00000100:00100000:1.0:1746143122.207183:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858457856:12345-192.168.201.28@tcp:3:cat.0 Request processed in 44286us (44632us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143122.207197:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5764 00002000:00100000:1.0:1746143122.207214:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009314d880 x1830962858457856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.207225:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314d880 with x1830962858457856 ext(2097152->3145727) 00002000:00010000:1.0:1746143122.207231:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314d880 00000001:00080000:1.0:1746143122.213899:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942265 is committed 00000001:00080000:1.0:1746143122.213917:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942263 is committed 00000001:00080000:1.0:1746143122.213924:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942264 is committed 00000001:00080000:1.0:1746143122.213932:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942267 is committed 00000004:00080000:1.0:1746143122.213936:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1773 committed 00000004:00080000:1.0:1746143122.213951:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1755 committed 00000004:00080000:1.0:1746143122.213959:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1754 committed 00000004:00080000:1.0:1746143122.213961:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1753 committed 00000004:00080000:1.0:1746143122.213963:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1752 committed 00000004:00080000:1.0:1746143122.213965:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1772 committed 00000004:00080000:1.0:1746143122.213967:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1751 committed 00000004:00080000:1.0:1746143122.213969:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1771 committed 00000004:00080000:1.0:1746143122.213970:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1750 committed 00000004:00080000:1.0:1746143122.213972:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1770 committed 00000004:00080000:1.0:1746143122.213973:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1769 committed 00000004:00080000:1.0:1746143122.213975:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1768 committed 00000004:00080000:1.0:1746143122.213977:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1749 committed 00000004:00080000:1.0:1746143122.213979:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1748 committed 00000004:00080000:1.0:1746143122.213980:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1767 committed 00000004:00080000:1.0:1746143122.213982:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1766 committed 00000004:00080000:1.0:1746143122.213984:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1747 committed 00000001:00080000:1.0:1746143122.213989:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942266 is committed 00010000:00010000:2.0:1746143122.214248:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.214262:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143122.214265:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143122.214269:0:1037:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.214280:0:1037:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.214287:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.214313:0:1037:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143122.214324:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a248380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861176192:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143122.214406:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143122.215048:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861175808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.215093:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143122.215116:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861176448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.215130:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143122.215141:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861176960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.215155:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143122.215172:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143122.215177:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861176320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.215192:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.215486:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861176064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143122.215510:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.215525:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861176704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.215540:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.215733:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861175936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143122.215755:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.215767:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861176576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143122.215779:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.215792:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861177088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.215809:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.215821:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861177600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.215837:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.215851:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746143122.215855:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861177216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143122.216070:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861175808 00000100:00100000:0.0:1746143122.216079:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861175808 00000100:00100000:0.0:1746143122.216112:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861176448 00000100:00100000:0.0:1746143122.216114:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861176448 00000100:00100000:0.0:1746143122.216124:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861176960 00000100:00100000:0.0:1746143122.216126:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861176960 00000100:00100000:0.0:1746143122.216132:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861176320 00000100:00100000:0.0:1746143122.216134:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861176320 00000100:00100000:0.0:1746143122.216139:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861176064 00000100:00100000:0.0:1746143122.216140:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861176064 00000100:00100000:0.0:1746143122.216147:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861176704 00000100:00100000:0.0:1746143122.216149:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861176704 00000100:00100000:0.0:1746143122.216154:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861175936 00000100:00100000:0.0:1746143122.216155:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861175936 00000100:00100000:0.0:1746143122.216160:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861176576 00000100:00100000:0.0:1746143122.216162:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861176576 00000100:00100000:0.0:1746143122.216167:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861177088 00000100:00100000:0.0:1746143122.216168:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861177088 00000100:00100000:0.0:1746143122.216173:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861177600 00000100:00100000:0.0:1746143122.216175:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861177600 00000100:00100000:0.0:1746143122.216184:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11907 00000100:00100000:0.0:1746143122.216191:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3302:x1830962861175808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143122.216394:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3302:x1830962861175808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (1301us total) trans 21474839944 rc 0/0 00000100:00100000:0.0:1746143122.216401:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11907 00000100:00100000:0.0:1746143122.216425:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11908 00000100:00100000:0.0:1746143122.216429:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3302:x1830962861176448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143122.216699:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3302:x1830962861176448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 268us (1567us total) trans 21474839945 rc 0/0 00000100:00100000:0.0:1746143122.216704:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11908 00000100:00100000:0.0:1746143122.216714:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11909 00000100:00100000:0.0:1746143122.216719:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3302:x1830962861176960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143122.216793:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3302:x1830962861176960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1637us total) trans 21474839946 rc 0/0 00000100:00100000:0.0:1746143122.216797:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11909 00000100:00100000:0.0:1746143122.216805:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11910 00000100:00100000:0.0:1746143122.216809:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3302:x1830962861176320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143122.216871:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:0.0:1746143122.216874:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143120 -> 1746143120 00002000:00010000:0.0:1746143122.216876:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143118 -> 1746143118 00002000:00010000:0.0:1746143122.216878:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143120 -> 1746143120 00002000:00010000:0.0:1746143122.216880:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:0.0:1746143122.216895:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3302:x1830962861176320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1702us total) trans 21474839947 rc 0/0 00000100:00100000:0.0:1746143122.216899:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11910 00000100:00100000:0.0:1746143122.216906:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11911 00000100:00100000:0.0:1746143122.216910:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3300:x1830962861176064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143122.217007:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3300:x1830962861176064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (1497us total) trans 17179872687 rc 0/0 00000100:00100000:0.0:1746143122.217012:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11911 00000100:00100000:0.0:1746143122.217019:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11912 00000100:00100000:0.0:1746143122.217023:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3300:x1830962861176704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143122.217116:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3300:x1830962861176704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1575us total) trans 21474839948 rc 0/0 00000100:00100000:0.0:1746143122.217121:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11912 00000100:00100000:0.0:1746143122.217130:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11913 00000100:00100000:0.0:1746143122.217134:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3299:x1830962861175936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143122.217216:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3299:x1830962861175936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1459us total) trans 21474839949 rc 0/0 00000100:00100000:0.0:1746143122.217221:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11913 00000100:00100000:0.0:1746143122.217231:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11914 00000100:00100000:1.0:1746143122.217350:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861176832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.217593:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861177344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.217618:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143122.217630:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861177856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.217641:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143122.217652:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143122.217656:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861177472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.217668:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143122.217688:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861177344 00000100:00100000:1.0:1746143122.217692:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861177344 00000100:00100000:1.0:1746143122.217705:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861177856 00000100:00100000:1.0:1746143122.217707:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861177856 00000100:00100000:1.0:1746143122.217713:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861177472 00000100:00100000:1.0:1746143122.217714:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861177472 00000100:00100000:1.0:1746143122.217721:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11915 00000100:00100000:1.0:1746143122.217726:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3299:x1830962861177088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.217826:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3299:x1830962861177088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (2015us total) trans 17179872688 rc 0/0 00000100:00100000:1.0:1746143122.217831:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11915 00000100:00100000:1.0:1746143122.217841:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11916 00000100:00100000:1.0:1746143122.217846:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3299:x1830962861177600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.217921:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3299:x1830962861177600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (2083us total) trans 17179872689 rc 0/0 00000100:00100000:1.0:1746143122.217927:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11916 00000100:00100000:1.0:1746143122.217936:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11917 00000100:00100000:1.0:1746143122.217941:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3301:x1830962861177344:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143122.218004:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aeea00/2, rc 0, transno 17179872687 00000100:00100000:2.0:1746143122.218011:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861176064:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143122.218022:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d5f80/2, rc 0, transno 21474839948 00000100:00100000:2.0:1746143122.218043:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861176704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.218046:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861177344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (428us total) trans 17179872690 rc 0/0 00000100:00100000:1.0:1746143122.218051:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11917 00000100:00100000:2.0:1746143122.218060:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11918 00000100:00100000:2.0:1746143122.218066:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3301:x1830962861177856:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143122.218068:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb57480/2, rc 0, transno 17179872690 00000100:00100000:1.0:1746143122.218071:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861177344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.218080:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11919 00000100:00100000:1.0:1746143122.218084:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3301:x1830962861177472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.218156:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3301:x1830962861177472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (486us total) trans 17179872691 rc 0/0 00000100:00100000:1.0:1746143122.218161:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11919 00000100:00100000:2.0:1746143122.218163:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3301:x1830962861177856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (520us total) trans 17179872692 rc 0/0 00000100:00100000:2.0:1746143122.218168:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11918 00000004:00080000:1.0:1746143122.218177:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb55500/2, rc 0, transno 17179872691 00000100:00100000:1.0:1746143122.218181:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861177472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143122.218187:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb56d80/2, rc 0, transno 17179872692 00000100:00100000:1.0:1746143122.218189:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861177856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.218209:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143122.218225:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314df80/2, rc 0, transno 21474839944 00000100:00100000:1.0:1746143122.218228:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861175808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143122.218234:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314f100/2, rc 0, transno 21474839945 00000100:00100000:1.0:1746143122.218237:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861176448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143122.218242:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e80f100/2, rc 0, transno 21474839946 00000100:00100000:1.0:1746143122.218245:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861176960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143122.218252:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314fb80/2, rc 0, transno 21474839947 00000100:00100000:1.0:1746143122.218255:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861176320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143122.218265:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861176832 00000100:00100000:2.0:1746143122.218268:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861176832 00000100:00100000:2.0:1746143122.218283:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11920 00000100:00100000:2.0:1746143122.218287:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3302:x1830962861176832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143122.218356:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143122.218358:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143122.218360:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143122.218362:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143122.218364:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143122.218384:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3302:x1830962861176832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (174us total) trans 21474839950 rc 0/0 00000100:00100000:2.0:1746143122.218389:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11920 00000100:00100000:3.0:1746143122.218402:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.218424:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861177216 00000100:00100000:2.0:1746143122.218427:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861177216 00000100:00100000:3.0:1746143122.218429:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861177728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143122.218439:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11921 00000100:00100000:2.0:1746143122.218443:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3299:x1830962861177216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.218448:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143122.218464:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314c380/2, rc 0, transno 21474839949 00000100:00100000:3.0:1746143122.218467:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861175936:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143122.218474:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aedc00/2, rc 0, transno 17179872688 00000100:00100000:3.0:1746143122.218477:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861177088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.218483:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb55f80/2, rc 0, transno 17179872689 00000100:00100000:3.0:1746143122.218485:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861177600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143122.218501:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861177728 00000100:00100000:3.0:1746143122.218503:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861177728 00002000:00010000:2.0:1746143122.218511:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143122.218513:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143120 -> 1746143120 00002000:00010000:2.0:1746143122.218516:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143117 -> 1746143117 00002000:00010000:2.0:1746143122.218518:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143120 -> 1746143120 00002000:00010000:2.0:1746143122.218520:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143122.218521:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11922 00000100:00100000:3.0:1746143122.218525:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861177728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143122.218542:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861177216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (140us total) trans 17179872693 rc 0/0 00000100:00100000:2.0:1746143122.218547:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11921 00000100:00100000:3.0:1746143122.218609:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861177728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (159us total) trans 17179872694 rc 0/0 00000100:00100000:3.0:1746143122.218615:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11922 00000004:00080000:3.0:1746143122.218656:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aefb80/2, rc 0, transno 17179872693 00000100:00100000:3.0:1746143122.218659:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861177216:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143122.218664:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb56a00/2, rc 0, transno 17179872694 00000100:00100000:3.0:1746143122.218666:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861177728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143122.218761:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143122.218769:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861177984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143122.218788:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143122.218812:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3299:x1830962861176576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143122.218911:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3299:x1830962861176576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1675us (3130us total) trans 21474839951 rc 0/0 00000100:00100000:0.0:1746143122.218916:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11914 00000004:00080000:2.0:1746143122.218955:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e680/2, rc 0, transno 21474839951 00000100:00100000:2.0:1746143122.218958:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861176576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143122.219755:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861177984 00000100:00100000:3.0:1746143122.219759:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861177984 00000100:00100000:3.0:1746143122.219818:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11923 00000100:00100000:3.0:1746143122.219824:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3301:x1830962861177984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143122.219920:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3301:x1830962861177984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1131us total) trans 21474839952 rc 0/0 00000100:00100000:3.0:1746143122.219928:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11923 00000004:00080000:1.0:1746143122.219961:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b6a00/2, rc 0, transno 21474839952 00000100:00100000:1.0:1746143122.219966:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861177984:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143122.219982:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d6a00/2, rc 0, transno 21474839950 00000100:00100000:1.0:1746143122.219988:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861176832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143122.220214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.220565:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858458624 00000100:00100000:1.0:1746143122.220569:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858458624 00000100:00100000:1.0:1746143122.220599:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8066 00000100:00100000:1.0:1746143122.220604:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:30697:x1830962858458624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143122.220619:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.220636:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f682 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.220683:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 198 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.220697:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 198 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.220711:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143122.220714:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143122.220716:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2a000, rc 0) 00000100:00100000:1.0:1746143122.220746:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:30697:x1830962858458624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 142us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.220754:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8066 00000100:00100000:3.0:1746143122.220875:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a248380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861176192:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143122.220910:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdc200/0x25aee876ca70c0a1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 9 pid: 1037 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143122.220923:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 8 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.220937:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbddc00, rc 0) 00000100:00100000:3.0:1746143122.220958:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30704:x1830962858456832:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 99650us (99819us total) trans 8589942267 rc 0/0 00000100:00100000:3.0:1746143122.220964:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8064 00000100:00100000:2.0:1746143122.221617:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858458240:12345-192.168.201.28@tcp:3:cat.0 Request processed in 53320us (54889us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143122.221627:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5765 00002000:00100000:2.0:1746143122.221635:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009314ed80 x1830962858458240/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.221644:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314ed80 with x1830962858458240 ext(3145728->4194303) 00002000:00010000:2.0:1746143122.221650:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314ed80 00000100:00100000:0.0:1746143122.221990:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.222095:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858458752 00000100:00100000:2.0:1746143122.222099:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858458752 00000100:00100000:2.0:1746143122.222124:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3388 00000100:00100000:2.0:1746143122.222130:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30696:x1830962858458752:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143122.222204:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30696:x1830962858458752:12345-192.168.201.28@tcp:49:cat.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.222209:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3388 00000100:00100000:0.0:1746143122.223944:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.224020:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858458880 00000100:00100000:1.0:1746143122.224026:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858458880 00000100:00100000:1.0:1746143122.226618:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3389 00000100:00100000:1.0:1746143122.226635:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30704:x1830962858458880:12345-192.168.201.28@tcp:49:multiop.0 00000100:00100000:1.0:1746143122.226780:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30704:x1830962858458880:12345-192.168.201.28@tcp:49:multiop.0 Request processed in 150us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.226787:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3389 00000100:00100000:0.0:1746143122.233098:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.233150:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858459136 00000100:00100000:2.0:1746143122.233160:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858459136 00002000:00100000:2.0:1746143122.233205:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88012b800a80 x1830962858459136/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.233217:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800a80 with x1830962858459136 ext(3145728->4194303) 00002000:00010000:2.0:1746143122.233222:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b800a80 00000100:00100000:2.0:1746143122.233265:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5766 00000100:00100000:2.0:1746143122.233276:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858459136:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143122.241195:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.241265:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858459392 00000100:00100000:1.0:1746143122.241275:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858459392 00002000:00100000:1.0:1746143122.241321:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88012b803480 x1830962858459392/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.241331:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803480 with x1830962858459392 ext(3145728->4194303) 00002000:00010000:1.0:1746143122.241337:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b803480 00000100:00100000:1.0:1746143122.241574:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5767 00000100:00100000:1.0:1746143122.241582:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858459392:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143122.247612:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.248798:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.248892:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858459648 00000100:00100000:3.0:1746143122.248902:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858459648 00002000:00100000:3.0:1746143122.248948:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88012b801f80 x1830962858459648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.248960:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801f80 with x1830962858459648 ext(3145728->4194303) 00002000:00010000:3.0:1746143122.248965:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b801f80 00000100:00100000:3.0:1746143122.249002:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5768 00000100:00100000:3.0:1746143122.249011:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858459648:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143122.250130:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858459776 00000100:00100000:1.0:1746143122.250136:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858459776 00000100:00100000:1.0:1746143122.250177:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11924 00000100:00100000:1.0:1746143122.250184:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30704:x1830962858459776:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143122.250196:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.250222:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f689 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143122.250243:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x68140790, atime: 0x6814078e, ctime: 0x68140790, blocks: 0x821 00010000:00010000:1.0:1746143122.250266:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.250268:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.250277:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.250294:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.250305:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2ae00, rc 0) 00000100:00100000:1.0:1746143122.250352:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30704:x1830962858459776:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 168us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.250364:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11924 00000100:00100000:2.0:1746143122.261055:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858459136:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 27755us (27944us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143122.261068:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5766 00002000:00100000:2.0:1746143122.261079:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88012b800a80 x1830962858459136/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.261089:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800a80 with x1830962858459136 ext(3145728->4194303) 00002000:00010000:2.0:1746143122.261095:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b800a80 00000100:00100000:1.0:1746143122.265607:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.265656:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858460032 00000100:00100000:2.0:1746143122.265669:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858460032 00002000:00100000:2.0:1746143122.265713:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1826816->1830911) req@ffff88008e80dc00 x1830962858460032/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.265723:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80dc00 with x1830962858460032 ext(1826816->1830911) 00002000:00010000:2.0:1746143122.265728:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80dc00 00000100:00100000:2.0:1746143122.265752:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5769 00000100:00100000:2.0:1746143122.265760:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858460032:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143122.265912:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858460032:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 152us (314us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143122.265918:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5769 00002000:00100000:2.0:1746143122.265925:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1826816->1830911) req@ffff88008e80dc00 x1830962858460032/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.265933:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80dc00 with x1830962858460032 ext(1826816->1830911) 00002000:00010000:2.0:1746143122.265936:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80dc00 00000100:00100000:1.0:1746143122.271776:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858459392:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30183us (30593us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143122.271789:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5767 00002000:00100000:1.0:1746143122.271800:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88012b803480 x1830962858459392/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.271811:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803480 with x1830962858459392 ext(3145728->4194303) 00002000:00010000:1.0:1746143122.272018:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b803480 00000100:00100000:2.0:1746143122.274460:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.274487:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.274508:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.274532:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858460160 00000100:00100000:2.0:1746143122.274541:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858460160 00000100:00100000:2.0:1746143122.274575:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858460288 00000100:00100000:2.0:1746143122.274577:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858460288 00000100:00100000:2.0:1746143122.274586:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858460416 00000100:00100000:2.0:1746143122.274588:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858460416 00000100:00100000:2.0:1746143122.274599:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11925 00000100:00100000:2.0:1746143122.274606:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858460160:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.274622:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.274638:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f690 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143122.274661:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x6814078e, atime: 0x6814078b, ctime: 0x6814078e, blocks: 0x7d1 00010000:00010000:2.0:1746143122.274677:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.274678:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.274687:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 21 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.274699:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 21 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.274714:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135e9ac00, rc 0) 00000100:00100000:2.0:1746143122.274754:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858460160:12345-192.168.201.28@tcp:101:cat.0 Request processed in 147us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.274760:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11925 00000100:00100000:2.0:1746143122.274774:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11926 00000100:00100000:2.0:1746143122.274779:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858460288:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.274786:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.274795:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f697 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143122.274809:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x6814078d, atime: 0x6814078d, ctime: 0x6814078d, blocks: 0x821 00010000:00010000:2.0:1746143122.274817:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.274818:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.274822:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.274833:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.274839:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135e9a800, rc 0) 00000100:00100000:2.0:1746143122.274864:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858460288:12345-192.168.201.28@tcp:101:cat.0 Request processed in 85us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.274869:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11926 00000100:00100000:2.0:1746143122.274878:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11927 00000100:00100000:2.0:1746143122.274882:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858460416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.274888:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.274894:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f69e expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143122.274903:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x6814078d, atime: 0x6814078d, ctime: 0x6814078d, blocks: 0x821 00010000:00010000:2.0:1746143122.274910:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.274911:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.274914:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.274922:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.274929:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135e9a000, rc 0) 00000100:00100000:2.0:1746143122.274942:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858460416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 60us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.274946:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11927 00000100:00100000:1.0:1746143122.276525:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858459648:12345-192.168.201.28@tcp:3:cat.0 Request processed in 27506us (27724us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143122.276537:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5768 00002000:00100000:1.0:1746143122.276549:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88012b801f80 x1830962858459648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.276565:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801f80 with x1830962858459648 ext(3145728->4194303) 00002000:00010000:1.0:1746143122.276571:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b801f80 00000100:00100000:1.0:1746143122.280697:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.280731:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858460672 00000100:00100000:1.0:1746143122.280739:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858460672 00002000:00100000:1.0:1746143122.280782:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1851392->1855487) req@ffff88008e80ce00 x1830962858460672/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.280792:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80ce00 with x1830962858460672 ext(1851392->1855487) 00002000:00010000:1.0:1746143122.280798:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80ce00 00000100:00100000:1.0:1746143122.280824:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5770 00000100:00100000:1.0:1746143122.280832:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858460672:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143122.281004:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858460672:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 172us (317us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143122.281011:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5770 00002000:00100000:1.0:1746143122.281016:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1851392->1855487) req@ffff88008e80ce00 x1830962858460672/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.281023:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80ce00 with x1830962858460672 ext(1851392->1855487) 00002000:00010000:1.0:1746143122.281026:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80ce00 00000100:00100000:1.0:1746143122.292619:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.292656:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858460928 00000100:00100000:1.0:1746143122.292666:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858460928 00002000:00100000:1.0:1746143122.292711:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008e80e300 x1830962858460928/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.292728:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80e300 with x1830962858460928 ext(4194304->5210111) 00002000:00010000:1.0:1746143122.292734:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80e300 00000100:00100000:1.0:1746143122.292754:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5771 00000100:00100000:1.0:1746143122.292762:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858460928:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143122.297050:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.297429:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858461184 00000100:00100000:2.0:1746143122.297439:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858461184 00000100:00100000:2.0:1746143122.297480:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3390 00000100:00100000:2.0:1746143122.297489:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30704:x1830962858461184:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143122.297789:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30704:x1830962858461184:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 300us (1418us total) trans 8589942268 rc 0/0 00000100:00100000:2.0:1746143122.297796:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3390 00000100:00100000:1.0:1746143122.302832:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.302947:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.302967:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.302987:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.303082:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858461312 00000100:00100000:2.0:1746143122.303092:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858461312 00000100:00100000:2.0:1746143122.303132:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858461568 00000100:00100000:2.0:1746143122.303135:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858461568 00000100:00100000:2.0:1746143122.303147:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858461440 00000100:00100000:2.0:1746143122.303148:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858461440 00000100:00100000:2.0:1746143122.303158:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858461696 00000100:00100000:2.0:1746143122.303161:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858461696 00000100:00100000:2.0:1746143122.303175:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11928 00000100:00100000:2.0:1746143122.303183:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858461312:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.303203:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.303223:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6a5 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.303248:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.303251:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.303260:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 34 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143122.303271:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11929 00010000:00010000:2.0:1746143122.303277:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 34 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143122.303279:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858461568:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.303290:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.303290:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8600, rc 0) 00010000:00010000:3.0:1746143122.303301:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6b3 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.303314:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.303316:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.303321:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 19 pid: 8169 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143122.303322:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858461312:12345-192.168.201.28@tcp:101:cat.0 Request processed in 140us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.303329:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11928 00010000:00010000:3.0:1746143122.303333:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 19 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.303342:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c044e00, rc 0) 00000100:00100000:2.0:1746143122.303345:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11930 00000100:00100000:2.0:1746143122.303351:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858461440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.303357:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143122.303362:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858461568:12345-192.168.201.28@tcp:101:cat.0 Request processed in 83us (416us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143122.303364:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6ac expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143122.303368:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11929 00010000:00010000:2.0:1746143122.303375:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.303377:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143122.303380:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11931 00010000:00010000:2.0:1746143122.303381:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 19 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143122.303385:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858461696:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.303391:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.303392:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 19 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.303398:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70c0ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6ba expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.303399:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8800, rc 0) 00000100:00100000:2.0:1746143122.303432:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858461440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 81us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.303437:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11930 00000100:00100000:3.0:1746143122.303453:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861178112:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143122.303726:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f540 going to sleep for 11 seconds 00002000:00010000:3.0:1746143122.317651:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143120 -> 1746143121 00002000:00010000:3.0:1746143122.317658:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143118 -> 1746143121 00002000:00010000:3.0:1746143122.317661:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143120 -> 1746143121 00000100:00100000:1.0:1746143122.318176:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858460928:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25219us (25373us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143122.318189:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5771 00002000:00100000:1.0:1746143122.318202:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008e80e300 x1830962858460928/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.318212:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80e300 with x1830962858460928 ext(4194304->5210111) 00002000:00010000:1.0:1746143122.318219:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80e300 00000100:00100000:3.0:1746143122.318232:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861178112:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143122.318262:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70c0ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ba expref: 34 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.318276:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c044000/0x25aee876ca70c0ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ba expref: 34 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.318293:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c044000, rc 0) 00000100:00100000:3.0:1746143122.318317:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858461696:12345-192.168.201.28@tcp:101:cat.0 Request processed in 14932us (15329us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143122.318324:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11931 00000100:00100000:0.0:1746143122.321120:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861178240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746143122.322066:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1830962861178496:0@lo:400:kworker.0 00000100:00100000:3.0:1746143122.322124:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.322166:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143122.322174:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1830962861178624:0@lo:400:kworker.0 00000100:00100000:3.0:1746143122.322205:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143122.323398:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861178496 00000100:00100000:0.0:1746143122.323508:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143122.323534:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830962861178752:0@lo:400:kworker.0 00000100:00100000:0.0:1746143122.323557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143122.323571:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143122.323576:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3299:1830962861178368:0@lo:400:kworker.0 00000100:00100000:0.0:1746143122.323603:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143122.323637:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861178624 00000100:00100000:0.0:1746143122.323642:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861178624 00000100:00100000:0.0:1746143122.323680:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861178752 00000100:00100000:0.0:1746143122.323683:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861178752 00000100:00100000:0.0:1746143122.323698:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1746143122.323704:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830962861178624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143122.323744:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830962861178624:12345-0@lo:400:kworker.0 Request processed in 40us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.323750:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1746143122.323967:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1746143122.323972:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830962861178752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143122.323999:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830962861178752:12345-0@lo:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.324005:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1746143122.324044:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861178240 00000100:00100000:0.0:1746143122.324047:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861178240 00000100:00100000:0.0:1746143122.324065:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1746143122.324070:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3299:x1830962861178240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746143122.324084:0:8451:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 469172224 pending 27262976 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746143122.324110:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3299:x1830962861178240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.324116:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1746143122.324140:0:14791:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861178368 00000100:00100000:0.0:1746143122.324143:0:14791:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861178368 00000100:00100000:0.0:1746143122.324162:0:14791:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1746143122.324166:0:14791:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3299:x1830962861178368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143122.324191:0:14791:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3299:x1830962861178368:12345-0@lo:400:kworker.0 Request processed in 24us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.324196:0:14791:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1746143122.324216:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143122.324285:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3299:1830962861178368:0@lo:400:kworker.0 00000100:00100000:0.0:1746143122.324295:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830962861178752:0@lo:400:kworker.0 00000100:00100000:0.0:1746143122.324309:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861178240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746143122.324980:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861178496 00000100:00100000:3.0:1746143122.325852:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1830962861178624:0@lo:400:kworker.0 00000100:00080000:0.0:1746143122.325898:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143122.325909:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1746143122.325914:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830962861178496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143122.325953:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830962861178496:12345-0@lo:400:kworker.0 Request processed in 38us (3831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.325958:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1746143122.325980:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1830962861178496:0@lo:400:kworker.0 00000100:00100000:1.0:1746143122.328890:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.330043:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858461952 00000100:00100000:2.0:1746143122.330053:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858461952 00000100:00100000:2.0:1746143122.330095:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3391 00000100:00100000:2.0:1746143122.330103:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093940050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30696:x1830962858461952:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:2.0:1746143122.330304:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093940050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30696:x1830962858461952:12345-192.168.201.28@tcp:35:cat.0 Request processed in 201us (1419us total) trans 8589942269 rc 0/0 00000100:00100000:2.0:1746143122.330311:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3391 00000100:00100000:1.0:1746143122.331170:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.331192:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858462208 00000100:00100000:1.0:1746143122.331196:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858462208 00002000:00100000:1.0:1746143122.331227:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008e80f800 x1830962858462208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.331239:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f800 with x1830962858462208 ext(4194304->5210111) 00002000:00010000:1.0:1746143122.331245:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80f800 00000100:00100000:1.0:1746143122.331259:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5772 00000100:00100000:1.0:1746143122.331265:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858462208:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143122.362135:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858462208:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30858us (30954us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143122.362148:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5772 00002000:00100000:2.0:1746143122.362162:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008e80f800 x1830962858462208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.362180:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f800 with x1830962858462208 ext(4194304->5210111) 00002000:00010000:2.0:1746143122.362186:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80f800 00000100:00100000:0.0:1746143122.367240:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143122.367260:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861178880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143122.367323:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143122.367346:0:25353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861178880 00000100:00100000:2.0:1746143122.367354:0:25353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861178880 00000100:00100000:2.0:1746143122.367391:0:25353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1746143122.367508:0:25353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861178880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143122.367533:0:25353:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 469041152 pending 1703936 free 3851419648 avail 3836739584 00000100:00100000:2.0:1746143122.367587:0:25353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861178880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.367593:0:25353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1746143122.368309:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861178880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746143122.376476:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.376545:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858462336 00000100:00100000:2.0:1746143122.376557:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858462336 00000100:00100000:2.0:1746143122.376611:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11932 00000100:00100000:2.0:1746143122.376622:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858462336:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.376644:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.376663:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9400/0x25aee876ca70c0f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6c1 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143122.376727:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861179008:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143122.376990:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.381268:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861179008:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143122.381322:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9400/0x25aee876ca70c0f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6c1 expref: 34 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143122.381339:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9400/0x25aee876ca70c0f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6c1 expref: 34 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143122.381356:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d9400, rc 0) 00000100:00100000:0.0:1746143122.381444:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858462336:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4820us (4972us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143122.381454:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11932 00000001:00080000:3.0:1746143122.384518:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839951 is committed 00000001:00080000:3.0:1746143122.384556:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839934 is committed 00000001:00080000:3.0:1746143122.384564:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839933 is committed 00000001:00080000:3.0:1746143122.384694:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839952 is committed 00000100:00100000:0.0:1746143122.386150:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.386263:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858462464 00000100:00100000:2.0:1746143122.386272:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858462464 00000100:00100000:2.0:1746143122.386328:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11933 00000100:00100000:2.0:1746143122.386337:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858462464:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.386356:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.386374:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70c0fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6c8 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143122.386438:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861179136:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143122.386536:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143122.388969:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861179136:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143122.389001:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70c0fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6c8 expref: 14 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.389014:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9600/0x25aee876ca70c0fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6c8 expref: 14 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.389026:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d9600, rc 0) 00000100:00100000:2.0:1746143122.389925:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858462464:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2767us (2959us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143122.389936:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11933 00000100:00100000:0.0:1746143122.406277:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.406633:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858462720 00000100:00100000:3.0:1746143122.406643:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858462720 00000100:00100000:3.0:1746143122.406696:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3392 00000100:00100000:3.0:1746143122.406706:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:30697:x1830962858462720:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:3.0:1746143122.407177:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30697:x1830962858462720:12345-192.168.201.28@tcp:35:cat.0 Request processed in 471us (911us total) trans 8589942270 rc 0/0 00000100:00100000:3.0:1746143122.407184:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3392 00000100:00100000:0.0:1746143122.414625:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.415738:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858462848 00000100:00100000:2.0:1746143122.415749:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858462848 00000100:00100000:2.0:1746143122.415812:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11934 00000100:00100000:2.0:1746143122.415821:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30702:x1830962858462848:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143122.416026:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.416059:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6cf expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.416094:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.416110:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.416117:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.416120:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.416124:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1429504->2097151] (req 1429504->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.416155:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.416168:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 20 pid: 10061 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143122.416182:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861179264:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.418570:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.418585:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143122.418598:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861179392:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.418647:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143122.418980:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861179264:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143122.419139:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.419206:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858462976 00000100:00100000:3.0:1746143122.419212:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858462976 00010000:00010000:3.0:1746143122.419241:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 21 pid: 10061 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143122.419279:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6296 00000100:00100000:3.0:1746143122.419287:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858462976:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143122.419299:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143122.419324:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 21 pid: 10061 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.419333:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 21 pid: 10061 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.419359:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8800/0x25aee876ca70c0e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6ac expref: 21 pid: 10061 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.420105:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143122.420137:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858462976:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 850us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.420144:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6296 00000100:00100000:2.0:1746143122.422178:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861179392:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.422224:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1429504->2097151] (req 1429504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143122.422502:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.422603:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858463104 00000100:00100000:3.0:1746143122.422609:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858463104 00010000:00010000:3.0:1746143122.422633:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 10 pid: 4756 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143122.422657:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6297 00000100:00100000:3.0:1746143122.422664:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858463104:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143122.422675:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143122.422693:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 10 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.422704:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 10 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.422725:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135e9a800/0x25aee876ca70c0cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f697 expref: 10 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.422736:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.422740:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.422746:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.422754:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.422785:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143122.422797:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861179520:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143122.422868:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f780 going to sleep for 11 seconds 00010000:00010000:2.0:1746143122.423336:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8400, rc 0) 00000100:00100000:2.0:1746143122.423374:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30702:x1830962858462848:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7553us (8941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.423383:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11934 00000100:00100000:0.0:1746143122.426142:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.426205:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858463360 00000100:00100000:2.0:1746143122.426214:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858463360 00002000:00100000:2.0:1746143122.426259:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1429504->1433599) req@ffff880092aef480 x1830962858463360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.426269:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aef480 with x1830962858463360 ext(1429504->1433599) 00002000:00010000:2.0:1746143122.426275:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092aef480 00000100:00100000:2.0:1746143122.426294:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5773 00000100:00100000:2.0:1746143122.426302:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858463360:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143122.426459:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861179520:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143122.426475:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143122.426524:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858463104:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3860us (4023us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.426533:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6297 00000100:00100000:2.0:1746143122.426751:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858463360:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 448us (618us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143122.426757:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5773 00002000:00100000:2.0:1746143122.426763:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1429504->1433599) req@ffff880092aef480 x1830962858463360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.426771:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aef480 with x1830962858463360 ext(1429504->1433599) 00002000:00010000:2.0:1746143122.426774:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092aef480 00000100:00100000:0.0:1746143122.433236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.435278:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858463488 00000100:00100000:2.0:1746143122.435289:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858463488 00000100:00100000:2.0:1746143122.436132:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11935 00000100:00100000:2.0:1746143122.436142:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30702:x1830962858463488:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143122.436163:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.436183:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6d6 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.436220:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.436229:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 20 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.436236:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.436238:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.436242:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->1372159] (req 1048576->1372159) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.436272:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 20 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.436285:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 20 pid: 8169 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143122.436297:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861179648:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143122.438167:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143122.438252:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.438270:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 8 pid: 4756 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143122.438281:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861179776:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143122.439020:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858463744 00000100:00100000:3.0:1746143122.439027:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858463744 00000100:00100000:3.0:1746143122.439083:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8067 00000100:00100000:3.0:1746143122.439091:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30711:x1830962858463744:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143122.439111:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.439127:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70c111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6dd expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.439243:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00000100:00100000:2.0:1746143122.439301:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143122.439494:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.439506:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.439521:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.439527:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.439533:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.439651:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.439659:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.439665:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143122.439674:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:1.0:1746143122.439823:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.439896:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861179648:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143122.439991:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.439999:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440006:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440012:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b2734c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143122.440018:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440140:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440154:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143122.440157:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143122.440160:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440165:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734c00/0x25aee876ca70c118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440186:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440191:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440195:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440200:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b2734a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143122.440202:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440207:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440214:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800931f2700) 00010000:00010000:3.0:1746143122.440216:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143122.440218:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440227:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734a00/0x25aee876ca70c11f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.440363:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734400/0x25aee876ca70c111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.440373:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.440380:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143122.440382:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143122.440385:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2734000, rc 0) 00000100:00100000:3.0:1746143122.440927:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30711:x1830962858463744:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1834us (2763us total) trans 8589942271 rc 0/0 00000100:00100000:3.0:1746143122.440936:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8067 00000100:00100000:3.0:1746143122.440963:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858463872 00000100:00100000:3.0:1746143122.440967:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858463872 00010000:00010000:3.0:1746143122.440985:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 21 pid: 8169 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143122.441010:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6298 00000100:00100000:3.0:1746143122.441015:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858463872:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143122.441026:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143122.441060:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 21 pid: 8169 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.441069:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 21 pid: 8169 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.441084:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c044e00/0x25aee876ca70c0e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6b3 expref: 21 pid: 8169 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746143122.441088:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143122.441097:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143122.441101:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858464000 00000100:00100000:0.0:1746143122.441104:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858464000 00010000:00010000:0.0:1746143122.441118:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143122.441942:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858463872:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 925us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.441949:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6298 00000100:00100000:2.0:1746143122.442078:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861179776:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.442113:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->1372159] (req 1048576->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.442123:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8a00, rc 0) 00000100:00100000:2.0:1746143122.442147:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30702:x1830962858463488:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6007us (8924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.442154:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11935 00000100:00100000:3.0:1746143122.442351:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6299 00000100:00100000:3.0:1746143122.442357:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858464000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143122.442365:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143122.442591:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.442601:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.442615:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135e9a000/0x25aee876ca70c0d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f69e expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143122.442625:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.442627:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.442633:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.442641:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.442670:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143122.442681:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861179904:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143122.442737:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143122.449754:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861179904:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143122.449780:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143122.449830:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858464000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7472us (8740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.449842:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6299 00000100:00100000:0.0:1746143122.450974:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.451066:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858464256 00000100:00100000:2.0:1746143122.451075:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858464256 00002000:00100000:2.0:1746143122.451121:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1368064->1372159) req@ffff88012d3d7800 x1830962858464256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.451132:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d7800 with x1830962858464256 ext(1368064->1372159) 00002000:00010000:2.0:1746143122.451139:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3d7800 00000100:00100000:2.0:1746143122.451162:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5774 00000100:00100000:2.0:1746143122.451172:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858464256:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143122.452688:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858464256:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1509us (1708us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143122.452701:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5774 00002000:00100000:2.0:1746143122.452712:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1368064->1372159) req@ffff88012d3d7800 x1830962858464256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.452721:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d7800 with x1830962858464256 ext(1368064->1372159) 00002000:00010000:2.0:1746143122.452726:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3d7800 00000100:00100000:0.0:1746143122.456094:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.456266:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858464512 00000100:00100000:2.0:1746143122.456277:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858464512 00000100:00100000:2.0:1746143122.456328:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3393 00000100:00100000:2.0:1746143122.456335:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30702:x1830962858464512:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143122.456594:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30702:x1830962858464512:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 257us (509us total) trans 8589942272 rc 0/0 00000100:00100000:2.0:1746143122.456601:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3393 00000100:00100000:0.0:1746143122.491074:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.491170:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858464768 00000100:00100000:3.0:1746143122.491179:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858464768 00000100:00100000:3.0:1746143122.491227:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8068 00000100:00100000:3.0:1746143122.491235:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30715:x1830962858464768:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.491265:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.491286:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735c00/0x25aee876ca70c134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6e4 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.491416:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.491433:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.491446:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143122.491464:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143122.491615:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735c00/0x25aee876ca70c134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 15 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.492851:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.492861:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143122.492864:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143122.492867:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b2735200, rc 0) 00000100:00100000:3.0:1746143122.492923:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30715:x1830962858464768:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1688us (1892us total) trans 8589942273 rc 0/0 00000100:00100000:3.0:1746143122.492931:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8068 00000100:00100000:0.0:1746143122.495920:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.498581:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858464896 00000100:00100000:2.0:1746143122.498594:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858464896 00010000:00010000:1.0:1746143122.498786:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143122.499079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.500537:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858465024 00000100:00100000:2.0:1746143122.500545:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858465024 00000100:00100000:2.0:1746143122.500593:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11936 00000100:00100000:2.0:1746143122.500604:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858464896:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.500626:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.500646:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8200/0x25aee876ca70c149 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6eb expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143122.500714:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861180032:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143122.500863:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11937 00000100:00100000:1.0:1746143122.500874:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858465024:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143122.500884:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.500895:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093244c00/0x25aee876ca70c150 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6f2 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.500929:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861180160:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143122.502764:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143122.502901:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143122.504388:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143117 -> 1746143121 00002000:00010000:1.0:1746143122.504395:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143117 -> 1746143121 00002000:00010000:1.0:1746143122.504397:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143117 -> 1746143121 00000100:00100000:1.0:1746143122.504437:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861180160:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143122.504474:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093244c00/0x25aee876ca70c150 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f2 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.504491:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093244c00/0x25aee876ca70c150 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f2 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.504531:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093244c00, rc 0) 00000100:00100000:1.0:1746143122.504587:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858465024:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3711us (5508us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143122.504596:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11937 00002000:00010000:2.0:1746143122.504726:0:4756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143117 -> 1746143121 00002000:00010000:2.0:1746143122.504731:0:4756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143117 -> 1746143121 00002000:00010000:2.0:1746143122.504733:0:4756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143117 -> 1746143121 00000100:00100000:2.0:1746143122.504745:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861180032:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143122.504771:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8200/0x25aee876ca70c149 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6eb expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.504781:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8200/0x25aee876ca70c149 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6eb expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.504796:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8200, rc 0) 00000100:00100000:2.0:1746143122.504826:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1970:x1830962858464896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4223us (8913us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143122.504832:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11936 00000100:00100000:0.0:1746143122.512720:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.513914:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858465280 00000100:00100000:2.0:1746143122.513926:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858465280 00002000:00100000:3.0:1746143122.514694:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800a5842680 x1830962858465280/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.514707:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5842680 with x1830962858465280 ext(0->1048575) 00002000:00010000:3.0:1746143122.514714:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5842680 00000100:00100000:3.0:1746143122.514745:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5775 00000100:00100000:3.0:1746143122.514755:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858465280:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143122.530203:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858465280:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15437us (17485us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143122.530216:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5775 00002000:00100000:3.0:1746143122.530229:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800a5842680 x1830962858465280/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.530245:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5842680 with x1830962858465280 ext(0->1048575) 00002000:00010000:3.0:1746143122.530253:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5842680 00000100:00100000:0.0:1746143122.541298:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.541591:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858465408 00000100:00100000:2.0:1746143122.541602:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858465408 00000100:00100000:2.0:1746143122.541660:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11938 00000100:00100000:2.0:1746143122.541670:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30715:x1830962858465408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.541691:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.541709:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f6f9 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.541739:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.541747:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143122.541750:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143122.541754:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.541785:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.541798:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 18 pid: 8169 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.541811:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861180288:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.542140:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143122.547689:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861180288:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.547726:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.547747:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8e00, rc 0) 00000100:00100000:2.0:1746143122.547805:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30715:x1830962858465408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6134us (6519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.547814:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11938 00000100:00100000:0.0:1746143122.548961:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.549286:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858465536 00000100:00100000:3.0:1746143122.549306:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858465536 00002000:00100000:3.0:1746143122.549357:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1429504->2097151) req@ffff8800a5842a00 x1830962858465536/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.549368:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5842a00 with x1830962858465536 ext(1429504->2097151) 00010000:00010000:3.0:1746143122.549377:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 19 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.549393:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 19 pid: 8169 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143122.549630:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5842a00 00000100:00100000:3.0:1746143122.549660:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1913 00000100:00100000:3.0:1746143122.549669:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858465536:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:3.0:1746143122.566123:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858465536:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 16446us (17158us total) trans 17179872695 rc 0/0 00000100:00100000:3.0:1746143122.566134:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1913 00002000:00100000:3.0:1746143122.566145:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1429504->2097151) req@ffff8800a5842a00 x1830962858465536/t17179872695(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/448 e 0 to 0 dl 1746143133 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.566154:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5842a00 with x1830962858465536 ext(1429504->2097151) 00010000:00010000:3.0:1746143122.566165:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 21 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.566181:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 21 pid: 8169 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143122.566188:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5842a00 00000100:00100000:0.0:1746143122.572339:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.572527:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858465664 00000100:00100000:3.0:1746143122.572539:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858465664 00010000:00010000:3.0:1746143122.572586:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 21 pid: 8169 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143122.572628:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6300 00000100:00100000:3.0:1746143122.572638:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858465664:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143122.572657:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143122.572686:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 21 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.572698:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 21 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.572725:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8400/0x25aee876ca70c103 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6cf expref: 21 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.573386:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.573389:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.573400:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 8 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.573428:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 8 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.573472:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 8 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143122.573487:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861180416:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143122.575199:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.581322:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.582877:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858465920 00000100:00100000:2.0:1746143122.582886:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858465920 00002000:00100000:2.0:1746143122.582929:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800a5840e00 x1830962858465920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.582939:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840e00 with x1830962858465920 ext(1048576->2097151) 00002000:00010000:2.0:1746143122.582944:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840e00 00000100:00100000:2.0:1746143122.582964:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5776 00000100:00100000:2.0:1746143122.582970:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858465920:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143122.584972:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861180416:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143122.584992:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143122.592244:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858465664:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 19594us (19907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.592260:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6300 00000100:00100000:3.0:1746143122.604822:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858465920:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21838us (23496us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143122.604836:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5776 00002000:00100000:3.0:1746143122.604849:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800a5840e00 x1830962858465920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.605049:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840e00 with x1830962858465920 ext(1048576->2097151) 00002000:00010000:3.0:1746143122.605055:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840e00 00000100:00100000:0.0:1746143122.609444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.609551:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858466048 00000100:00100000:2.0:1746143122.609560:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858466048 00000100:00100000:2.0:1746143122.609621:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11939 00000100:00100000:2.0:1746143122.609629:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30715:x1830962858466048:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.609649:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.609667:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f700 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.609696:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.609704:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143122.609706:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143122.609710:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 10 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.609740:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.609755:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 19 pid: 8169 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.609769:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861180544:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.609855:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143122.610566:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.610910:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858466304 00000100:00100000:3.0:1746143122.610918:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858466304 00000100:00100000:3.0:1746143122.610979:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8069 00000100:00100000:3.0:1746143122.610988:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30717:x1830962858466304:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143122.611019:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.611069:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b000/0x25aee876ca70c165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f707 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.611194:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611207:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611219:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611234:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611240:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611246:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611378:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611388:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611396:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143122.611424:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143122.611534:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611546:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611552:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611558:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009051b200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143122.611561:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611568:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611581:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143122.611584:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143122.611588:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611593:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b200/0x25aee876ca70c16c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611633:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611639:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611644:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611649:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009051a600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143122.611652:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611660:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611668:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800931f2e00) 00010000:00010000:3.0:1746143122.611670:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143122.611672:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611677:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a600/0x25aee876ca70c173 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143122.611723:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051b000/0x25aee876ca70c165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 203 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.611737:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 202 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.611743:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143122.611745:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143122.611748:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009051bc00, rc 0) 00000100:00100000:3.0:1746143122.611792:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:30717:x1830962858466304:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 804us (1228us total) trans 8589942274 rc 0/0 00000100:00100000:3.0:1746143122.611799:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8069 00000100:00100000:0.0:1746143122.619702:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.620370:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861180544:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.620420:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 10 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.620650:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d9a00, rc 0) 00000100:00100000:3.0:1746143122.620753:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858466432 00000100:00100000:3.0:1746143122.620760:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858466432 00002000:00100000:3.0:1746143122.620800:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1372159) req@ffff8800a5841180 x1830962858466432/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.620809:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5841180 with x1830962858466432 ext(1048576->1372159) 00010000:00010000:3.0:1746143122.620816:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 20 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.620829:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 20 pid: 8169 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143122.620835:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5841180 00000100:00100000:3.0:1746143122.620855:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1914 00000100:00100000:3.0:1746143122.620862:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858466432:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:2.0:1746143122.622374:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30715:x1830962858466048:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12715us (12911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.622383:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11939 00000100:00100000:0.0:1746143122.624012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.624479:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858466560 00000100:00100000:2.0:1746143122.624488:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858466560 00000100:00100000:2.0:1746143122.624528:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11940 00000100:00100000:2.0:1746143122.624536:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:30717:x1830962858466560:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143122.624554:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.624571:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f70e expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.624600:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.624609:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 14 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.624616:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.624617:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.624621:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [364544->565247] (req 364544->565247) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.624648:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 14 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.624660:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 14 pid: 10061 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143122.624672:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861180672:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.624757:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.624766:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 8 pid: 4756 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143122.624774:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861180800:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.624793:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143122.632433:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861180672:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.632449:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861180800:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.632483:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [364544->565247] (req 364544->565247) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.632502:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8c00, rc 0) 00000100:00100000:2.0:1746143122.632549:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:30717:x1830962858466560:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8012us (8541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.632557:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11940 00000100:00100000:3.0:1746143122.633917:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858466432:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 13050us (14223us total) trans 17179872696 rc 0/0 00000100:00100000:3.0:1746143122.633926:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1914 00002000:00100000:3.0:1746143122.633936:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1372159) req@ffff8800a5841180 x1830962858466432/t17179872696(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/448 e 0 to 0 dl 1746143133 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746143122.634128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.634265:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858466688 00000100:00100000:2.0:1746143122.634271:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858466688 00010000:00010000:2.0:1746143122.634298:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 14 pid: 10061 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143122.634324:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6301 00000100:00100000:2.0:1746143122.634330:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1971:x1830962858466688:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.634343:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.634364:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 14 pid: 10061 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143122.634375:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 14 pid: 10061 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143122.634397:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8600/0x25aee876ca70c0d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6a5 expref: 14 pid: 10061 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143122.634432:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.634453:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1971:x1830962858466688:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 123us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.634458:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6301 00000100:00100000:0.0:1746143122.635898:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.635966:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858466816 00000100:00100000:1.0:1746143122.635972:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858466816 00010000:00010000:1.0:1746143122.636004:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143122.636054:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6302 00000100:00100000:1.0:1746143122.636060:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858466816:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143122.636070:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143122.636084:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143122.636095:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143122.636110:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135e9ac00/0x25aee876ca70c0c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f690 expref: 9 pid: 4756 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143122.636133:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.636136:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.636143:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.636151:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.636182:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.636198:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861180928:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143122.636260:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00002000:00100000:3.0:1746143122.636981:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5841180 with x1830962858466432 ext(1048576->1372159) 00010000:00010000:3.0:1746143122.637002:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 22 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.637014:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 22 pid: 8169 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143122.637020:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5841180 00000100:00100000:0.0:1746143122.643274:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.643325:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.643338:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858467072 00000100:00100000:3.0:1746143122.643346:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858467072 00000100:00100000:1.0:1746143122.643652:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861180928:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143122.643678:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.643696:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858467200 00000100:00100000:2.0:1746143122.643701:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858467200 00010000:00010000:2.0:1746143122.643727:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 22 pid: 8169 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143122.643735:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858466816:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7673us (7839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.643743:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6302 00002000:00100000:3.0:1746143122.643781:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (364544->368639) req@ffff8800a5841c00 x1830962858467072/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.643798:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5841c00 with x1830962858467072 ext(364544->368639) 00002000:00010000:3.0:1746143122.643803:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5841c00 00000100:00100000:3.0:1746143122.643824:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5777 00000100:00100000:3.0:1746143122.643832:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858467072:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143122.644002:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6303 00000100:00100000:2.0:1746143122.644010:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858467200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.644020:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.644066:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 22 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.644079:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 22 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.644102:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8a00/0x25aee876ca70c10a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6d6 expref: 22 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.644128:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.644130:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.644138:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.644149:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.644200:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143122.644212:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861181056:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143122.644265:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143122.644815:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858467072:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 983us (1553us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143122.644821:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5777 00002000:00100000:3.0:1746143122.644826:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (364544->368639) req@ffff8800a5841c00 x1830962858467072/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.644833:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5841c00 with x1830962858467072 ext(364544->368639) 00002000:00010000:3.0:1746143122.644837:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5841c00 00000100:00100000:0.0:1746143122.646235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.646613:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858467456 00000100:00100000:2.0:1746143122.646620:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858467456 00000100:00100000:2.0:1746143122.646669:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8070 00000100:00100000:2.0:1746143122.646676:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:30720:x1830962858467456:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.646699:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.646716:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9600/0x25aee876ca70c18f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f715 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.646996:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.647009:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.647021:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143122.649351:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143122.649530:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d9600/0x25aee876ca70c18f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 205 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.649550:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 204 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.649560:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143122.649563:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143122.649566:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d8800, rc 0) 00000100:00100000:2.0:1746143122.649644:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:30720:x1830962858467456:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2966us (3411us total) trans 8589942275 rc 0/0 00000100:00100000:2.0:1746143122.649653:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8070 00000100:00100000:1.0:1746143122.653527:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.653703:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861181056:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143122.653735:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143122.653845:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858467584 00000100:00100000:3.0:1746143122.653852:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858467584 00000100:00100000:3.0:1746143122.653898:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11941 00000100:00100000:3.0:1746143122.653907:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30711:x1830962858467584:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143122.653925:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.653943:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f71c expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.653974:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 11 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.653983:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 21 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.653995:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.653997:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.654002:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3411968->4194303] (req 3411968->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.654048:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 21 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.654061:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 21 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143122.654074:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861181184:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.654222:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858467200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10212us (10895us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.654233:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6303 00010000:00010000:3.0:1746143122.654918:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 11 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.654929:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 11 pid: 8449 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143122.654939:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861181312:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143122.654964:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.655483:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.656223:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858468096 00000100:00100000:3.0:1746143122.656229:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858468096 00000100:00100000:0.0:1746143122.656248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:3.0:1746143122.656267:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a5841f80 x1830962858468096/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.656277:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5841f80 with x1830962858468096 ext(1048576->2097151) 00000100:00100000:0.0:1746143122.656281:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:3.0:1746143122.656283:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5841f80 00000100:00100000:3.0:1746143122.656302:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5778 00000100:00100000:3.0:1746143122.656309:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858468096:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143122.656311:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.656327:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.656352:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858468224 00000100:00100000:3.0:1746143122.656355:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858468224 00000100:00100000:3.0:1746143122.656371:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858468480 00000100:00100000:0.0:1746143122.656371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.656373:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858468480 00000100:00100000:3.0:1746143122.656386:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858468352 00000100:00100000:3.0:1746143122.656388:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858468352 00000100:00100000:0.0:1746143122.656391:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858468736 00000100:00100000:0.0:1746143122.656396:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858468736 00000100:00100000:3.0:1746143122.656415:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11942 00000100:00100000:3.0:1746143122.656422:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858468224:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.656429:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746143122.656429:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f4fdc00 x1830962858468736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 504/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.656438:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdc00 with x1830962858468736 ext(1048576->2097151) 00010000:00010000:3.0:1746143122.656442:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f723 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143122.656443:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fdc00 00000100:00100000:0.0:1746143122.656455:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858468608 00000100:00100000:0.0:1746143122.656457:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858468608 00010000:00010000:3.0:1746143122.656458:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.656461:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.656469:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 23 pid: 8448 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746143122.656469:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (561152->565247) req@ffff88009f4fc380 x1830962858468608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.656477:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830962858468608 ext(561152->565247) 00002000:00010000:0.0:1746143122.656480:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fc380 00010000:00010000:3.0:1746143122.656484:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 23 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.656494:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ca9200, rc 0) 00000100:00100000:0.0:1746143122.656494:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5779 00000100:00100000:0.0:1746143122.656500:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858468736:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143122.656522:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858468224:12345-192.168.201.28@tcp:101:cat.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.656528:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11942 00000100:00100000:3.0:1746143122.656542:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11943 00000100:00100000:3.0:1746143122.656548:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858468480:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.656555:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.656563:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ca8800/0x25aee876ca70c1b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f731 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143122.656594:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861181440:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143122.656633:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143122.656651:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11944 00000100:00100000:3.0:1746143122.656657:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858468352:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.656663:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.656671:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f72a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.656681:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.656682:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.656687:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.656697:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.656704:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fc5c00, rc 0) 00000100:00100000:3.0:1746143122.656719:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858468352:12345-192.168.201.28@tcp:101:cat.0 Request processed in 62us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.656724:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11944 00000100:00100000:0.0:1746143122.659433:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5780 00000100:00100000:0.0:1746143122.659446:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858468608:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143122.659553:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858468608:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 110us (3180us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143122.659561:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5780 00002000:00100000:0.0:1746143122.659569:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fc:0x0] (561152->565247) req@ffff88009f4fc380 x1830962858468608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.659579:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830962858468608 ext(561152->565247) 00002000:00010000:0.0:1746143122.659586:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fc380 00000100:00100000:3.0:1746143122.664968:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861181184:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143122.664986:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861181312:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143122.665019:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3411968->4194303] (req 3411968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.665063:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81ca00, rc 0) 00000100:00100000:3.0:1746143122.666732:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30711:x1830962858467584:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 12818us (13209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.666743:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11941 00000100:00100000:0.0:1746143122.667021:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.669204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.669571:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861181440:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143122.669608:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ca8800/0x25aee876ca70c1b2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f731 expref: 14 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.669626:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ca8800/0x25aee876ca70c1b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f731 expref: 14 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143122.669658:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ca8800, rc 0) 00000100:00100000:3.0:1746143122.669706:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858468480:12345-192.168.201.28@tcp:101:cat.0 Request processed in 13155us (13423us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143122.669713:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11943 00000100:00100000:2.0:1746143122.669834:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858468992 00000100:00100000:2.0:1746143122.669842:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858468992 00010000:00010000:2.0:1746143122.669870:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 13 pid: 8449 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.669900:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858468864 00000100:00100000:2.0:1746143122.669903:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858468864 00010000:00010000:2.0:1746143122.669913:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 23 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.669928:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6304 00000100:00100000:2.0:1746143122.669935:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858468992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.669947:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.669963:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 13 pid: 8449 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.669973:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 13 pid: 8449 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.669992:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b200600/0x25aee876ca70c02a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f63c expref: 13 pid: 8449 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.670007:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.670025:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858468992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 91us (3183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.670066:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6304 00000100:00100000:2.0:1746143122.670077:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6305 00000100:00100000:2.0:1746143122.670082:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858468864:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.670091:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.670098:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 23 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.670108:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 23 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.670120:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094445200/0x25aee876ca70c03f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f64a expref: 23 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.670130:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.670132:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.670139:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.670148:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.670174:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143122.670185:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861181568:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143122.670230:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143122.684007:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858468736:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 27493us (27682us total) trans 0 rc 1019904/1019904 00000100:00100000:2.0:1746143122.684021:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5779 00002000:00100000:2.0:1746143122.684060:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f4fdc00 x1830962858468736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 504/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.684070:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdc00 with x1830962858468736 ext(1048576->2097151) 00002000:00010000:2.0:1746143122.684078:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fdc00 00000100:00100000:3.0:1746143122.686982:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861181568:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143122.687008:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143122.687010:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143122.687071:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858468864:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 16986us (17872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.687082:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6305 00000100:00100000:3.0:1746143122.687152:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858469248 00000100:00100000:3.0:1746143122.687158:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858469248 00000100:00100000:3.0:1746143122.687199:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3394 00000100:00100000:3.0:1746143122.687206:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:30717:x1830962858469248:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143122.688512:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:30717:x1830962858469248:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 1302us (1504us total) trans 8589942276 rc 0/0 00000100:00100000:3.0:1746143122.688520:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3394 00000100:00100000:2.0:1746143122.695735:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.696092:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.696122:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.696170:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.696195:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858469760 00000100:00100000:2.0:1746143122.696203:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858469760 00002000:00100000:2.0:1746143122.696245:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012b802d80 x1830962858469760/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.696256:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802d80 with x1830962858469760 ext(1048576->2097151) 00002000:00010000:2.0:1746143122.696262:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b802d80 00000100:00100000:2.0:1746143122.696287:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858469632 00000100:00100000:2.0:1746143122.696289:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858469632 00002000:00100000:2.0:1746143122.696300:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88012b802680 x1830962858469632/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 504/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.696308:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802680 with x1830962858469632 ext(0->1048575) 00002000:00010000:2.0:1746143122.696311:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b802680 00000100:00100000:1.0:1746143122.696312:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858470016 00000100:00100000:1.0:1746143122.696317:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858470016 00000100:00100000:2.0:1746143122.696321:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5781 00000100:00100000:2.0:1746143122.696328:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858469760:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:1.0:1746143122.696339:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012b803b80 x1830962858470016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.696347:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803b80 with x1830962858470016 ext(1048576->2097151) 00002000:00010000:1.0:1746143122.696351:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b803b80 00000100:00100000:1.0:1746143122.696368:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5782 00000100:00100000:1.0:1746143122.696375:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1968:x1830962858469632:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143122.696462:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858470144 00000100:00100000:3.0:1746143122.696468:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858470144 00000100:00100000:3.0:1746143122.696495:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11945 00000100:00100000:3.0:1746143122.696500:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30711:x1830962858470144:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143122.696511:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.696529:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f738 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.696557:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.696566:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.696573:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.696575:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143122.696578:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4399103] (req 4194304->4399103) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143122.696602:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5783 00010000:00010000:3.0:1746143122.696605:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143122.696610:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858470016:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:3.0:1746143122.696622:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 9 pid: 754 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143122.696634:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861181696:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143122.696715:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.696723:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 13 pid: 4758 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143122.696731:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861181824:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143122.696748:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.706104:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861181696:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143122.706119:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861181824:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143122.706150:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4399103] (req 4194304->4399103) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.706169:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fc4000, rc 0) 00000100:00100000:1.0:1746143122.706195:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.706215:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30711:x1830962858470144:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9713us (10043us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.706229:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11945 00000100:00100000:1.0:1746143122.706245:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858470272 00000100:00100000:1.0:1746143122.706251:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858470272 00010000:00010000:1.0:1746143122.706277:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 9 pid: 754 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143122.706302:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6306 00000100:00100000:1.0:1746143122.706309:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858470272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143122.706324:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143122.706344:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 9 pid: 754 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.706355:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 9 pid: 754 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.706376:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b66ca00/0x25aee876ca70c038 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f643 expref: 9 pid: 754 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.706392:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143122.706428:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858470272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.706435:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6306 00000100:00100000:3.0:1746143122.712120:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858468096:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 55797us (56624us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143122.712135:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5778 00002000:00100000:3.0:1746143122.712150:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a5841f80 x1830962858468096/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.712161:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5841f80 with x1830962858468096 ext(1048576->2097151) 00002000:00010000:3.0:1746143122.712168:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5841f80 00000100:00100000:0.0:1746143122.716914:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.717083:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858470400 00000100:00100000:1.0:1746143122.717091:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858470400 00010000:00010000:1.0:1746143122.717127:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 15 pid: 4758 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143122.717161:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6307 00000100:00100000:1.0:1746143122.717170:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858470400:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143122.717195:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143122.717220:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 15 pid: 4758 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.717234:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 15 pid: 4758 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.717259:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094444c00/0x25aee876ca70c023 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f635 expref: 15 pid: 4758 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.718122:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.718127:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.718136:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.718146:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.718184:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.718197:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861181952:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143122.718450:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143122.722357:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858469760:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26016us (26619us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143122.722372:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5781 00002000:00100000:1.0:1746143122.722383:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012b802d80 x1830962858469760/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.722391:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802d80 with x1830962858469760 ext(1048576->2097151) 00002000:00010000:1.0:1746143122.722396:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b802d80 00000100:00100000:1.0:1746143122.743565:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861181952:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143122.743590:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143122.743647:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858470400:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 26476us (26742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.743659:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6307 00000100:00100000:2.0:1746143122.744218:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858470016:12345-192.168.201.28@tcp:3:cat.0 Request processed in 47608us (48094us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143122.744232:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5783 00002000:00100000:2.0:1746143122.744242:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012b803b80 x1830962858470016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.744252:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803b80 with x1830962858470016 ext(1048576->2097151) 00002000:00010000:2.0:1746143122.744258:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b803b80 00000100:00100000:0.0:1746143122.745993:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.746056:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858470656 00000100:00100000:2.0:1746143122.746062:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858470656 00002000:00100000:3.0:1746143122.746150:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4395008->4399103) req@ffff88009f4fe300 x1830962858470656/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.746160:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fe300 with x1830962858470656 ext(4395008->4399103) 00002000:00010000:3.0:1746143122.746164:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fe300 00000100:00100000:3.0:1746143122.746778:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5784 00000100:00100000:3.0:1746143122.746787:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858470656:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143122.746987:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858470656:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 202us (1001us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143122.746995:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5784 00002000:00100000:3.0:1746143122.747000:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4395008->4399103) req@ffff88009f4fe300 x1830962858470656/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.747007:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fe300 with x1830962858470656 ext(4395008->4399103) 00002000:00010000:3.0:1746143122.747010:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fe300 00000100:00100000:1.0:1746143122.747970:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:1968:x1830962858469632:12345-192.168.201.28@tcp:3:cat.0 Request processed in 51589us (52196us total) trans 0 rc 847872/847872 00000100:00100000:1.0:1746143122.747979:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5782 00002000:00100000:1.0:1746143122.747986:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88012b802680 x1830962858469632/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 504/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 847872/847872 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.747995:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802680 with x1830962858469632 ext(0->1048575) 00002000:00010000:1.0:1746143122.747999:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b802680 00000100:00100000:0.0:1746143122.757734:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.757778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.757811:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.757844:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.757847:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858471424 00000100:00100000:2.0:1746143122.757858:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858471424 00000100:00100000:0.0:1746143122.757876:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.758122:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858470912 00000100:00100000:3.0:1746143122.758127:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858470912 00000100:00100000:3.0:1746143122.758167:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3395 00000100:00100000:3.0:1746143122.758176:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30711:x1830962858470912:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143122.758270:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858471680 00000100:00100000:1.0:1746143122.758275:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858471680 00002000:00100000:1.0:1746143122.758298:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009f4fd180 x1830962858471680/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.758308:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd180 with x1830962858471680 ext(2097152->3145727) 00002000:00010000:1.0:1746143122.758315:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd180 00000100:00100000:1.0:1746143122.758327:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858471808 00000100:00100000:1.0:1746143122.758329:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858471808 00002000:00100000:1.0:1746143122.758339:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009f4fd500 x1830962858471808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.758347:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd500 with x1830962858471808 ext(3145728->4194303) 00002000:00010000:1.0:1746143122.758349:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd500 00000100:00100000:1.0:1746143122.758366:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858471296 00000100:00100000:1.0:1746143122.758369:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858471296 00002000:00100000:1.0:1746143122.758383:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800906a7800 x1830962858471296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.758391:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a7800 with x1830962858471296 ext(2097152->3145727) 00002000:00010000:1.0:1746143122.758394:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a7800 00000100:00100000:1.0:1746143122.758419:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5785 00000100:00100000:1.0:1746143122.758425:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858471680:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:2.0:1746143122.758430:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3411967) req@ffff88009f4fea00 x1830962858471424/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.758439:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fea00 with x1830962858471424 ext(3145728->3411967) 00002000:00010000:2.0:1746143122.758443:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fea00 00000100:00100000:2.0:1746143122.758467:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5786 00000100:00100000:2.0:1746143122.758473:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858471808:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143122.759168:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5787 00000100:00100000:1.0:1746143122.759174:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858471296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143122.759200:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30711:x1830962858470912:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 1023us (1353us total) trans 8589942277 rc 0/0 00000100:00100000:3.0:1746143122.759207:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3395 00000100:00100000:3.0:1746143122.759231:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5788 00000100:00100000:3.0:1746143122.759237:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858471424:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143122.762109:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.762139:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858472064 00000100:00100000:0.0:1746143122.762147:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858472064 00000100:00100000:0.0:1746143122.762183:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11946 00000100:00100000:0.0:1746143122.762190:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:30720:x1830962858472064:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143122.762208:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143122.762226:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f73f expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.762256:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.762264:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143122.762266:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143122.762269:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.762296:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.762314:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 9 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143122.762327:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861182080:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143122.762390:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.764911:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861182080:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143122.764942:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.764960:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53a9600, rc 0) 00000100:00100000:0.0:1746143122.765000:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:30720:x1830962858472064:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2809us (2901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.765009:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11946 00000100:00100000:0.0:1746143122.772163:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.772208:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858472192 00000100:00100000:0.0:1746143122.772217:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858472192 00002000:00100000:0.0:1746143122.772264:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1826816->1855487) req@ffff8800906a6a00 x1830962858472192/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.772275:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6a00 with x1830962858472192 ext(1826816->1855487) 00010000:00010000:0.0:1746143122.772286:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 12 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143122.772303:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 12 pid: 4756 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746143122.772316:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a6a00 00000100:00100000:0.0:1746143122.772338:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1915 00000100:00100000:0.0:1746143122.772347:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858472192:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143122.780320:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858472192:12345-192.168.201.28@tcp:4:cat.0 Request processed in 7960us (8155us total) trans 21474839953 rc 0/0 00000100:00100000:0.0:1746143122.780334:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1915 00002000:00100000:0.0:1746143122.780346:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1826816->1855487) req@ffff8800906a6a00 x1830962858472192/t21474839953(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/448 e 0 to 0 dl 1746143133 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.780357:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6a00 with x1830962858472192 ext(1826816->1855487) 00010000:00010000:0.0:1746143122.780368:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 14 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143122.780383:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 14 pid: 4756 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746143122.780390:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a6a00 00000100:00100000:3.0:1746143122.791184:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858471680:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32745us (33392us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143122.791197:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5785 00002000:00100000:3.0:1746143122.791208:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009f4fd180 x1830962858471680/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.791226:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd180 with x1830962858471680 ext(2097152->3145727) 00002000:00010000:3.0:1746143122.791232:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd180 00000100:00100000:0.0:1746143122.793156:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.797648:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858471808:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39164us (39825us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143122.797658:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5786 00002000:00100000:2.0:1746143122.797669:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009f4fd500 x1830962858471808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.797675:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd500 with x1830962858471808 ext(3145728->4194303) 00002000:00010000:2.0:1746143122.797681:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd500 00000100:00100000:1.0:1746143122.798672:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858472320 00000100:00100000:1.0:1746143122.798682:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858472320 00010000:00010000:1.0:1746143122.798715:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 10 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143122.798741:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6308 00000100:00100000:1.0:1746143122.798747:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858472320:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143122.798764:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143122.798782:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 10 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.798794:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 10 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.798819:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70c0bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1826816->1855487) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f689 expref: 10 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.798854:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.798856:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.798863:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 12 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.798871:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 12 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.798903:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 12 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.798916:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861182208:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143122.798969:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143122.805656:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861182208:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143122.806185:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143122.806239:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858472320:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7489us (13087us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.806250:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6308 00000100:00100000:2.0:1746143122.808023:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.808390:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858472576 00000100:00100000:3.0:1746143122.808407:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858472576 00002000:00100000:3.0:1746143122.808445:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f35a300 x1830962858472576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.808455:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35a300 with x1830962858472576 ext(1048576->2097151) 00002000:00010000:3.0:1746143122.808459:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f35a300 00000100:00100000:3.0:1746143122.808478:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5789 00000100:00100000:3.0:1746143122.808484:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858472576:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143122.808499:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858471424:12345-192.168.201.28@tcp:3:cat.0 Request processed in 49260us (50774us total) trans 0 rc 266240/266240 00000100:00100000:1.0:1746143122.808507:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5788 00002000:00100000:1.0:1746143122.808514:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3411967) req@ffff88009f4fea00 x1830962858471424/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 266240/266240 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.808522:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fea00 with x1830962858471424 ext(3145728->3411967) 00002000:00010000:1.0:1746143122.808526:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fea00 00000100:00100000:0.0:1746143122.808596:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858471296:12345-192.168.201.28@tcp:3:cat.0 Request processed in 48890us (50188us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143122.808605:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5787 00002000:00100000:0.0:1746143122.808611:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800906a7800 x1830962858471296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143122.808619:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a7800 with x1830962858471296 ext(2097152->3145727) 00002000:00010000:0.0:1746143122.808623:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a7800 00000100:00100000:0.0:1746143122.821703:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.821753:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.821827:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858472832 00000100:00100000:2.0:1746143122.821838:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858472832 00000100:00100000:2.0:1746143122.821895:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858472704 00000100:00100000:2.0:1746143122.821897:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858472704 00000100:00100000:2.0:1746143122.821918:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11947 00000100:00100000:1.0:1746143122.821968:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11948 00000100:00100000:1.0:1746143122.821977:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858472704:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143122.821996:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.822014:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70c1ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f746 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.822100:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861182336:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143122.822181:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143122.822584:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858472832:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143122.822593:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.822601:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f74d expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.822614:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.822617:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.822626:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 12 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.822642:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 12 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.822655:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094234000, rc 0) 00000100:00100000:2.0:1746143122.822681:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858472832:12345-192.168.201.28@tcp:101:cat.0 Request processed in 757us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.822687:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11947 00000100:00100000:3.0:1746143122.828979:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858472576:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20482us (20949us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143122.828991:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5789 00002000:00100000:3.0:1746143122.829004:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f35a300 x1830962858472576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.829014:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f35a300 with x1830962858472576 ext(1048576->2097151) 00002000:00010000:3.0:1746143122.829020:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f35a300 00002000:00010000:1.0:1746143122.834407:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143118 -> 1746143121 00002000:00010000:1.0:1746143122.834417:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143115 -> 1746143121 00002000:00010000:1.0:1746143122.834419:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143118 -> 1746143121 00000100:00100000:1.0:1746143122.834448:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861182336:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143122.834487:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70c1ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f746 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.834502:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70c1ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f746 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.834518:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7aa00, rc 0) 00000100:00100000:1.0:1746143122.834580:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858472704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12603us (12824us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143122.834589:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11948 00000100:00100000:0.0:1746143122.844680:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.844860:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858472960 00000100:00100000:1.0:1746143122.844870:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858472960 00000100:00100000:1.0:1746143122.845166:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11949 00000100:00100000:1.0:1746143122.845175:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1968:x1830962858472960:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143122.845195:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.845214:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b400/0x25aee876ca70c1dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f754 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.845272:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861182464:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143122.845361:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.853345:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.853738:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.853772:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858473344 00000100:00100000:2.0:1746143122.853780:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858473344 00000100:00100000:3.0:1746143122.854486:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858473088 00000100:00100000:3.0:1746143122.854492:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858473088 00000100:00100000:3.0:1746143122.854525:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11950 00000100:00100000:3.0:1746143122.854534:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858473088:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.854554:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.854574:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132050800/0x25aee876ca70c1e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f75b expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143122.854586:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143120 -> 1746143121 00002000:00010000:1.0:1746143122.854591:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143118 -> 1746143121 00002000:00010000:1.0:1746143122.854593:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143120 -> 1746143121 00000100:00100000:1.0:1746143122.854613:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861182464:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143122.854629:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861182592:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143122.854641:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b400/0x25aee876ca70c1dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f754 expref: 14 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.854654:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b400/0x25aee876ca70c1dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f754 expref: 14 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143122.854683:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8071 00000100:00100000:2.0:1746143122.854692:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:30724:x1830962858473344:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:3.0:1746143122.854697:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fb40 going to sleep for 11 seconds 00010000:00010000:2.0:1746143122.854707:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.854721:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094234200/0x25aee876ca70c1ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f762 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.854810:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.854824:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.854832:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 206 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.854839:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.854859:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 206 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.854872:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 206 pid: 1037 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.854880:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861182720:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.854920:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.854928:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 14 pid: 1037 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.854936:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861182848:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.854954:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143122.856188:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7b400, rc 0) 00000100:00100000:1.0:1746143122.856227:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1968:x1830962858472960:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11049us (11555us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143122.856234:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11949 00000100:00100000:0.0:1746143122.856419:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.856536:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858473600 00000100:00100000:3.0:1746143122.856541:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858473600 00002000:00100000:3.0:1746143122.856573:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4399104->5210111) req@ffff8800906a7100 x1830962858473600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.856583:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a7100 with x1830962858473600 ext(4399104->5210111) 00002000:00010000:3.0:1746143122.856588:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a7100 00000100:00100000:3.0:1746143122.856607:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5790 00000100:00100000:3.0:1746143122.856613:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858473600:12345-192.168.201.28@tcp:3:cat.0 00002000:00010000:0.0:1746143122.858048:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143120 -> 1746143121 00002000:00010000:0.0:1746143122.858054:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143117 -> 1746143121 00002000:00010000:0.0:1746143122.858056:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143120 -> 1746143121 00000100:00100000:0.0:1746143122.858073:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861182592:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143122.858106:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132050800/0x25aee876ca70c1e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f75b expref: 23 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143122.858118:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132050800/0x25aee876ca70c1e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f75b expref: 23 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143122.858131:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050800, rc 0) 00000100:00100000:0.0:1746143122.858164:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858473088:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3631us (4831us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143122.858171:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11950 00000100:00100000:0.0:1746143122.858294:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.858320:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.858339:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858473856 00000100:00100000:0.0:1746143122.858342:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858473856 00010000:00010000:0.0:1746143122.858363:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 15 pid: 1037 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143122.858386:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858473728 00000100:00100000:0.0:1746143122.858388:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858473728 00010000:00010000:0.0:1746143122.858410:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 207 pid: 1037 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143122.858426:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6309 00000100:00100000:0.0:1746143122.858432:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858473856:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143122.858443:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143122.858448:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 15 pid: 1037 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143122.858677:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 15 pid: 1037 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143122.858697:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143122.858702:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143122.858709:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143122.858714:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143122.858737:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858473856:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 305us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.858743:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6309 00000100:00100000:0.0:1746143122.858756:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6310 00000100:00100000:0.0:1746143122.858761:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1969:x1830962858473728:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143122.858768:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143122.858772:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 207 pid: 1037 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143122.858781:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 207 pid: 1037 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143122.858793:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143122.858796:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143122.858803:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143122.858811:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143122.858825:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143122.858839:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1969:x1830962858473728:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 78us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.858845:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6310 00010000:00010000:2.0:1746143122.859055:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c17a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f707 expref: 206 pid: 1037 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.859073:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f35b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861182720:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.859085:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2734000/0x25aee876ca70c126 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6dd expref: 14 pid: 1037 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.859094:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861182848:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.859110:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.859117:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.859122:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143122.859142:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143122.859282:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094234200/0x25aee876ca70c1ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 207 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.859296:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 206 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.859302:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143122.859304:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143122.859306:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094234e00, rc 0) 00000100:00100000:2.0:1746143122.859329:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:30724:x1830962858473344:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4639us (5595us total) trans 8589942278 rc 0/0 00000100:00100000:2.0:1746143122.859339:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8071 00000100:00100000:1.0:1746143122.866188:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.868502:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858473984 00000100:00100000:0.0:1746143122.868515:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858473984 00000100:00100000:0.0:1746143122.869263:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11951 00000100:00100000:0.0:1746143122.869275:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:30720:x1830962858473984:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143122.869295:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143122.869314:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f769 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.869354:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 11 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.869362:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143122.869364:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143122.869368:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 14 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.869414:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 11 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.869427:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 11 pid: 8448 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143122.869440:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861182976:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143122.869531:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.877188:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.877189:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858473600:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20575us (20770us total) trans 0 rc 811008/811008 00000100:00100000:3.0:1746143122.877202:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5790 00002000:00100000:3.0:1746143122.877216:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4399104->5210111) req@ffff8800906a7100 x1830962858473600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 811008/811008 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.877227:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a7100 with x1830962858473600 ext(4399104->5210111) 00010000:00010000:3.0:1746143122.877239:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 10 pid: 8448 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.877255:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 10 pid: 8448 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.877258:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858474112 00002000:00010000:3.0:1746143122.877262:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a7100 00000100:00100000:2.0:1746143122.877267:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858474112 00002000:00100000:2.0:1746143122.877302:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4399103) req@ffff8800906a4e00 x1830962858474112/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.877310:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a4e00 with x1830962858474112 ext(4194304->4399103) 00010000:00010000:2.0:1746143122.877315:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 10 pid: 8448 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.877325:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 10 pid: 8448 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143122.877332:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a4e00 00000100:00100000:2.0:1746143122.877355:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1916 00000100:00100000:2.0:1746143122.877363:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858474112:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143122.877526:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861182976:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143122.877552:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 14 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.877574:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a518b400, rc 0) 00000100:00100000:1.0:1746143122.877598:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:30720:x1830962858473984:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8326us (11423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.877606:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11951 00000100:00100000:2.0:1746143122.883563:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858474112:12345-192.168.201.28@tcp:4:cat.0 Request processed in 6188us (6375us total) trans 21474839954 rc 0/0 00000100:00100000:2.0:1746143122.883577:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1916 00002000:00100000:2.0:1746143122.883590:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4399103) req@ffff8800906a4e00 x1830962858474112/t21474839954(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/448 e 0 to 0 dl 1746143133 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143122.883599:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a4e00 with x1830962858474112 ext(4194304->4399103) 00010000:00010000:2.0:1746143122.883611:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 12 pid: 8448 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.883633:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 12 pid: 8448 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143122.883641:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a4e00 00000100:00100000:0.0:1746143122.884237:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.884789:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858474368 00000100:00100000:1.0:1746143122.884798:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858474368 00000100:00100000:1.0:1746143122.884833:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11952 00000100:00100000:1.0:1746143122.884840:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858474368:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143122.884857:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.884872:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70c206 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f777 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.884925:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861183104:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143122.885005:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143122.886516:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.886981:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858474240 00000100:00100000:0.0:1746143122.886987:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858474240 00000100:00100000:0.0:1746143122.887140:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11953 00000100:00100000:1.0:1746143122.887228:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858474240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143122.887243:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.887256:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a200/0x25aee876ca70c20d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f770 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.887299:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092996a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861183232:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143122.888260:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.899977:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.900125:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861183104:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143122.900160:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70c206 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f777 expref: 15 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.900178:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70c206 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f777 expref: 15 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.900211:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a000, rc 0) 00000100:00100000:1.0:1746143122.900267:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858474368:12345-192.168.201.28@tcp:101:cat.0 Request processed in 15425us (16031us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143122.900276:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11952 00000100:00100000:1.0:1746143122.900303:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858474496 00000100:00100000:1.0:1746143122.900309:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858474496 00000100:00100000:1.0:1746143122.900455:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11954 00000100:00100000:1.0:1746143122.900464:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30724:x1830962858474496:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143122.900479:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143122.900495:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f77e expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.900522:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.900531:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.900537:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.900540:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.900543:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1728512->1957887] (req 1728512->1957887) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.900576:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143122.900588:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143122.900599:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092995c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861183360:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143122.900652:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 9 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.900660:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 9 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143122.900669:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861183488:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143122.900688:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143122.903182:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092996a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861183232:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143122.903205:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a200/0x25aee876ca70c20d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f770 expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.903217:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a200/0x25aee876ca70c20d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f770 expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.903231:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a200, rc 0) 00000100:00100000:2.0:1746143122.903261:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858474240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 16113us (16747us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143122.903268:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11953 00000100:00100000:0.0:1746143122.909591:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.909650:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.909689:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092995c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861183360:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143122.909739:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858474624 00000100:00100000:1.0:1746143122.909745:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858474624 00010000:00010000:1.0:1746143122.909779:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 12 pid: 8448 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143122.910114:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858474752 00000100:00100000:3.0:1746143122.910119:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858474752 00000100:00100000:3.0:1746143122.910151:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11955 00000100:00100000:3.0:1746143122.910159:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30715:x1830962858474752:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.910173:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.910188:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f785 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.910213:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143122.910216:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143122.910220:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [5206016->5242879] (req 5206016->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.910232:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [5206016->5242879] (req 5206016->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.910250:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132051200, rc 0) 00000100:00100000:3.0:1746143122.910295:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30715:x1830962858474752:12345-192.168.201.28@tcp:101:cat.0 Request processed in 136us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.910301:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11955 00000100:00100000:1.0:1746143122.912328:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6311 00000100:00100000:1.0:1746143122.912344:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858474624:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143122.912360:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143122.912389:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 13 pid: 8448 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.912412:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 13 pid: 8448 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.912435:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093fc4000/0x25aee876ca70c1c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f738 expref: 13 pid: 8448 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143122.912453:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.912455:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.912461:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 13 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.912470:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 13 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.912478:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.912479:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143122.912482:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.912488:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143122.912736:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.912748:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092995180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861183616:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143122.913302:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 13 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143122.913313:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092997100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861183744:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143122.913349:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143122.914670:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.914693:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858474880 00000100:00100000:3.0:1746143122.914704:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858474880 00010000:00010000:3.0:1746143122.914729:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 10 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143122.914957:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6312 00000100:00100000:3.0:1746143122.914962:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858474880:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143122.914973:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143122.914991:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861183488:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143122.914993:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 10 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.915002:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 10 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.915021:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d9a00/0x25aee876ca70c15e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f700 expref: 10 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.915027:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [1728512->1957887] (req 1728512->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.915053:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143122.915055:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7b800, rc 0) 00000100:00100000:3.0:1746143122.915079:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858474880:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 116us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.915079:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30724:x1830962858474496:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14617us (15120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.915085:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6312 00000100:00100000:2.0:1746143122.915086:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11954 00000100:00100000:0.0:1746143122.918688:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.920193:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858475008 00000100:00100000:2.0:1746143122.920203:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858475008 00010000:00010000:2.0:1746143122.920238:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143122.920267:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6313 00000100:00100000:2.0:1746143122.920273:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858475008:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.920286:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.920307:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143122.920317:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143122.920337:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fc5c00/0x25aee876ca70c1b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f72a expref: 23 pid: 8449 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143122.920355:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.920357:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.920364:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.920372:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.920421:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143122.920437:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861183872:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143122.920511:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143122.923086:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092995180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861183616:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143122.923087:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.923098:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092997100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861183744:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143122.923117:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143122.923119:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.923159:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858474624:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10820us (13578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143122.923169:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6311 00000100:00100000:3.0:1746143122.923385:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858475136 00000100:00100000:3.0:1746143122.923391:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858475136 00000100:00100000:3.0:1746143122.923436:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858475264 00000100:00100000:3.0:1746143122.923438:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858475264 00000100:00100000:3.0:1746143122.923455:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11956 00000100:00100000:3.0:1746143122.923462:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858475136:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.923480:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.923496:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132050e00/0x25aee876ca70c222 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f78c expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143122.924416:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861184000:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143122.924475:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143122.924491:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11957 00000100:00100000:3.0:1746143122.924497:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858475264:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.925570:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.925584:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70c229 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f793 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143122.925617:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861184128:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143122.925672:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.929020:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.932463:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861184000:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143122.932467:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143122.932509:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132050e00/0x25aee876ca70c222 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f78c expref: 13 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.932526:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132050e00/0x25aee876ca70c222 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f78c expref: 13 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143122.932621:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858475520 00000100:00100000:3.0:1746143122.932628:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858475520 00002000:00100000:3.0:1746143122.932677:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008eb75c00 x1830962858475520/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.932687:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb75c00 with x1830962858475520 ext(2097152->3145727) 00002000:00010000:3.0:1746143122.932692:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb75c00 00000100:00100000:3.0:1746143122.932714:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858475776 00000100:00100000:3.0:1746143122.932716:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858475776 00002000:00100000:3.0:1746143122.932730:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1728512->1732607) req@ffff880092997100 x1830962858475776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.932737:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092997100 with x1830962858475776 ext(1728512->1732607) 00002000:00010000:3.0:1746143122.932741:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092997100 00000100:00100000:3.0:1746143122.932754:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5791 00000100:00100000:3.0:1746143122.932761:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858475520:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143122.933340:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5792 00000100:00100000:1.0:1746143122.933348:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858475776:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143122.933511:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858475776:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 164us (1046us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143122.933519:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5792 00002000:00100000:1.0:1746143122.933525:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1728512->1732607) req@ffff880092997100 x1830962858475776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143122.933532:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092997100 with x1830962858475776 ext(1728512->1732607) 00002000:00010000:1.0:1746143122.933536:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092997100 00010000:00010000:2.0:1746143122.936062:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050e00, rc 0) 00000100:00100000:2.0:1746143122.936135:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858475136:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12663us (13046us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143122.936143:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11956 00000100:00100000:2.0:1746143122.936204:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861183872:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143122.936226:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.936247:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858475008:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 15973us (17569us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.936261:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6313 00000100:00100000:2.0:1746143122.939183:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861184128:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143122.939212:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70c229 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f793 expref: 10 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.939230:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70c229 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f793 expref: 10 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.939242:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050c00, rc 0) 00000100:00100000:2.0:1746143122.939275:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858475264:12345-192.168.201.28@tcp:101:cat.0 Request processed in 14776us (16153us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143122.939287:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11957 00000100:00100000:0.0:1746143122.949215:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143122.949259:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.949299:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858476032 00000100:00100000:3.0:1746143122.949309:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858476032 00000100:00100000:0.0:1746143122.949312:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:3.0:1746143122.949354:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88008eb76300 x1830962858476032/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.949366:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb76300 with x1830962858476032 ext(5206016->5210111) 00002000:00010000:3.0:1746143122.949373:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb76300 00000100:00100000:3.0:1746143122.949625:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858476416 00000100:00100000:3.0:1746143122.949629:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858476416 00002000:00100000:3.0:1746143122.949645:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1953792->1957887) req@ffff88008eb77800 x1830962858476416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.949652:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77800 with x1830962858476416 ext(1953792->1957887) 00002000:00010000:3.0:1746143122.949656:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb77800 00000100:00100000:3.0:1746143122.949669:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5793 00000100:00100000:1.0:1746143122.949682:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5794 00000100:00100000:1.0:1746143122.949691:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858476416:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143122.949915:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858476288 00000100:00100000:2.0:1746143122.949919:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858476288 00000100:00100000:2.0:1746143122.949949:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8072 00000100:00100000:3.0:1746143122.949967:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858476032:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143122.950084:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858476416:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 394us (771us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143122.950088:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:30725:x1830962858476288:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143122.950091:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5794 00002000:00100000:1.0:1746143122.950096:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1953792->1957887) req@ffff88008eb77800 x1830962858476416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746143122.950104:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746143122.950104:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77800 with x1830962858476416 ext(1953792->1957887) 00002000:00010000:1.0:1746143122.950107:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb77800 00010000:00010000:2.0:1746143122.950122:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5800/0x25aee876ca70c230 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f79a expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143122.950162:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858476032:12345-192.168.201.28@tcp:3:cat.0 Request processed in 487us (958us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143122.950168:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5793 00002000:00100000:3.0:1746143122.950172:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88008eb76300 x1830962858476032/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/4536 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.950179:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb76300 with x1830962858476032 ext(5206016->5210111) 00002000:00010000:3.0:1746143122.950181:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb76300 00010000:00010000:2.0:1746143122.950270:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.950676:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.950689:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.950703:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.950709:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.950713:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.952620:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.952634:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 205 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.952641:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.952671:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 205 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.952683:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 205 pid: 17079 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143122.952694:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861184256:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.953662:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143122.955453:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858475520:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 22685us (26648us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143122.955464:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5791 00002000:00100000:3.0:1746143122.955475:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008eb75c00 x1830962858475520/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:273/0 lens 488/440 e 0 to 0 dl 1746143133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.955485:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb75c00 with x1830962858475520 ext(2097152->3145727) 00002000:00010000:3.0:1746143122.955490:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb75c00 00000100:00100000:2.0:1746143122.956972:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861184256:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143122.957000:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143122.963327:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.963609:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858476672 00000100:00100000:3.0:1746143122.963619:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858476672 00000100:00100000:3.0:1746143122.963929:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3396 00000100:00100000:3.0:1746143122.963943:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:15437:x1830962858476672:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143122.964750:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:15437:x1830962858476672:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 810us (1432us total) trans 8589942279 rc 0/0 00000100:00100000:3.0:1746143122.964758:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3396 00000100:00100000:0.0:1746143122.966799:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.968637:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858476800 00000100:00100000:2.0:1746143122.968649:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858476800 00000100:00100000:3.0:1746143122.968750:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11958 00000100:00100000:3.0:1746143122.968758:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30720:x1830962858476800:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143122.968778:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.968797:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7a1 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.968826:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 8 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.968833:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746143122.968873:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.969192:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858476928 00000100:00100000:2.0:1746143122.969196:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858476928 00010000:00010000:2.0:1746143122.969220:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 207 pid: 17079 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.969344:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143122.969349:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.969380:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 8 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.969391:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 8 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143122.969413:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861184384:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143122.969422:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6314 00000100:00100000:2.0:1746143122.969429:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1968:x1830962858476928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143122.969438:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143122.969443:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 207 pid: 17079 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.969451:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 207 pid: 17079 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.969470:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094234e00/0x25aee876ca70c1f1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f762 expref: 207 pid: 17079 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143122.969489:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00000100:00100000:3.0:1746143122.969490:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00010000:00010000:2.0:1746143122.969494:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.969502:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.969509:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143122.969531:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143122.969553:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:1968:x1830962858476928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 124us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.969558:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6314 00010000:00010000:3.0:1746143122.971023:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971066:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143122.971122:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143122.971127:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143122.971145:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971155:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971164:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971170:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971177:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971182:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cd5600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143122.971186:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971193:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971205:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143122.971208:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143122.971212:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971218:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5600/0x25aee876ca70c237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971230:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971235:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971240:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971244:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cd5200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143122.971247:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971252:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971259:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5dcfe00) 00010000:00010000:3.0:1746143122.971261:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143122.971263:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971268:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5200/0x25aee876ca70c23e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.971303:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5800/0x25aee876ca70c230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.971315:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.971327:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143122.971329:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143122.971332:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cd5000, rc 0) 00000100:00100000:3.0:1746143122.971378:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30725:x1830962858476288:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 21423us (22117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.971386:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8072 00000100:00100000:3.0:1746143122.980893:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861184384:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143122.980929:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.980950:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f369800, rc 0) 00000100:00100000:3.0:1746143122.980999:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30720:x1830962858476800:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12239us (14205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143122.981008:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11958 00000100:00100000:0.0:1746143122.984008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.985648:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858477056 00000100:00100000:3.0:1746143122.985660:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858477056 00002000:00100000:3.0:1746143122.985707:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3411968->4194303) req@ffff8800942c5880 x1830962858477056/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/0 e 0 to 0 dl 1746143133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143122.985718:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5880 with x1830962858477056 ext(3411968->4194303) 00010000:00010000:3.0:1746143122.985729:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 9 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143122.985745:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 9 pid: 4756 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143122.985756:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c5880 00000100:00100000:3.0:1746143122.985782:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1917 00000100:00100000:3.0:1746143122.985789:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858477056:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143122.986102:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.986137:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.986152:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.986166:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.986180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143122.986203:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143122.986275:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858477184 00000100:00100000:2.0:1746143122.986280:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858477184 00000100:00080000:1.0:1746143122.986366:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143122.986543:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858477696 00000100:00100000:2.0:1746143122.986543:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858477440 00000100:00100000:3.0:1746143122.986547:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858477696 00000100:00100000:2.0:1746143122.986547:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858477440 00000100:00100000:3.0:1746143122.986564:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858477312 00000100:00100000:3.0:1746143122.986566:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858477312 00000100:00100000:3.0:1746143122.986576:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858477568 00000100:00100000:3.0:1746143122.986578:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858477568 00000100:00100000:2.0:1746143122.986579:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858477824 00000100:00100000:2.0:1746143122.986582:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858477824 00000100:00100000:3.0:1746143122.986591:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11959 00000100:00100000:2.0:1746143122.986594:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11960 00000100:00100000:3.0:1746143122.986596:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858477184:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143122.986599:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858477696:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143122.986606:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.986606:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.986621:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f368600/0x25aee876ca70c25a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7a8 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.986621:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7c4 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143122.986639:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.986641:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.986649:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 9 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.986663:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 9 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143122.986667:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861184512:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143122.986673:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cd4200, rc 0) 00000100:00100000:2.0:1746143122.987364:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858477696:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 761us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143122.987371:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11960 00000100:00100000:0.0:1746143122.987376:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11961 00000100:00100000:0.0:1746143122.987383:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858477312:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143122.987388:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11962 00010000:00010000:0.0:1746143122.987390:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143122.987392:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858477440:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143122.987411:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143122.987420:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cd4800/0x25aee876ca70c261 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7b6 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.987425:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7af expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.987434:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143122.987436:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143122.987644:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143122.987650:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861184640:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143122.987655:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143122.987662:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a518a600, rc 0) 00000100:00100000:0.0:1746143122.987677:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858477312:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 296us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.987683:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11961 00000100:00100000:2.0:1746143122.987695:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143122.987696:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11963 00000100:00100000:0.0:1746143122.987701:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858477568:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143122.987706:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143122.987713:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7bd expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143122.987715:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11964 00000100:00100000:2.0:1746143122.987720:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858477824:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143122.987723:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143122.987725:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143122.987725:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143122.987729:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143122.987731:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70c276 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7cb expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143122.987738:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143122.987746:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a518ac00, rc 0) 00000100:00100000:2.0:1746143122.987753:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861184768:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143122.987759:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858477568:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 59us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143122.987764:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11963 00000100:00100000:2.0:1746143122.987771:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143122.987847:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00080000:1.0:1746143122.987879:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143122.996801:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143122.996873:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858478080 00000100:00100000:3.0:1746143122.997052:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858478080 00000100:00100000:3.0:1746143122.997655:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8073 00000100:00100000:3.0:1746143122.997665:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30729:x1830962858478080:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143122.997692:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143122.997714:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368400/0x25aee876ca70c27d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7d2 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.998070:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998084:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998096:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998112:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998119:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998125:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998244:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998251:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998257:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143122.998265:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143122.998598:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998605:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998617:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998624:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f369400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143122.998634:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998641:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998657:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143122.998660:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143122.998665:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998671:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369400/0x25aee876ca70c284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998691:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998697:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998702:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998707:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f368c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143122.998709:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998715:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998730:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800931f2700) 00010000:00010000:3.0:1746143122.998732:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143122.998735:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998739:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368c00/0x25aee876ca70c28b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143122.998988:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f368400/0x25aee876ca70c27d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 17 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.999001:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 16 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143122.999065:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143122.999067:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143122.999070:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f369600, rc 0) 00000100:00100000:3.0:1746143122.999779:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30729:x1830962858478080:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 2112us (2989us total) trans 8589942280 rc 0/0 00000100:00100000:3.0:1746143122.999788:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8073 00000100:00100000:3.0:1746143123.000067:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861184640:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143123.000095:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cd4800/0x25aee876ca70c261 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7b6 expref: 9 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143123.000097:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f35b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861184768:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143123.000106:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cd4800/0x25aee876ca70c261 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7b6 expref: 9 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.000116:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70c276 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7cb expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.000121:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cd4800, rc 0) 00010000:00010000:2.0:1746143123.000127:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70c276 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7cb expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.000140:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050c00, rc 0) 00000100:00100000:3.0:1746143123.000144:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858477440:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 12751us (14006us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143123.000152:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11962 00000100:00100000:2.0:1746143123.000162:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858477824:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 12440us (13957us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143123.000169:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11964 00000100:00100000:3.0:1746143123.001168:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861184512:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143123.001188:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f368600/0x25aee876ca70c25a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a8 expref: 8 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.001197:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f368600/0x25aee876ca70c25a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a8 expref: 8 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.001205:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f368600, rc 0) 00000100:00100000:3.0:1746143123.001229:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858477184:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 14633us (15129us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143123.001236:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11959 00000100:00100000:3.0:1746143123.007537:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858477056:12345-192.168.201.28@tcp:4:cat.0 Request processed in 21736us (23527us total) trans 17179872697 rc 0/0 00000100:00100000:3.0:1746143123.007553:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1917 00002000:00100000:3.0:1746143123.007567:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3411968->4194303) req@ffff8800942c5880 x1830962858477056/t17179872697(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:273/0 lens 488/448 e 0 to 0 dl 1746143133 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.007578:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5880 with x1830962858477056 ext(3411968->4194303) 00010000:00010000:3.0:1746143123.007589:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 11 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143123.007612:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 11 pid: 4756 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143123.007621:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c5880 00000100:00100000:2.0:1746143123.010378:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.010507:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858478336 00000100:00100000:0.0:1746143123.010516:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858478336 00000100:00100000:0.0:1746143123.010578:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8074 00000100:00100000:0.0:1746143123.010586:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30725:x1830962858478336:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143123.010606:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143123.010628:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a800/0x25aee876ca70c2a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7d9 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.010732:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143123.010745:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.010753:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.010759:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143123.010788:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.010799:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 15 pid: 17079 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143123.010810:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861184896:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143123.010897:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.010905:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 8 pid: 17079 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143123.010913:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861185024:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143123.010935:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0180 going to sleep for 11 seconds 00000100:00080000:1.0:1746143123.011054:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143123.018673:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.020188:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.020210:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.020599:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858478464 00000100:00100000:3.0:1746143123.020610:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858478464 00000100:00100000:0.0:1746143123.021126:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.021221:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11965 00000100:00100000:3.0:1746143123.021230:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30729:x1830962858478464:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143123.021249:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.021268:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7e0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.021301:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.021308:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143123.021310:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143123.021314:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 4/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 12 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.021342:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.021353:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 22 pid: 8169 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143123.021370:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861185152:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143123.021668:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00080000:3.0:1746143123.021687:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143123.022161:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858478720 00000100:00100000:1.0:1746143123.022167:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858478720 00010000:00010000:1.0:1746143123.022193:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 16 pid: 17079 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143123.022214:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858478592 00000100:00100000:1.0:1746143123.022217:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858478592 00010000:00010000:1.0:1746143123.022227:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 13 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143123.022241:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858478848 00000100:00100000:1.0:1746143123.022244:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858478848 00010000:00010000:1.0:1746143123.022253:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 9 pid: 17079 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143123.022267:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6315 00000100:00100000:1.0:1746143123.022272:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858478720:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143123.022282:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143123.022287:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 16 pid: 17079 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143123.022296:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 16 pid: 17079 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143123.022315:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143123.022319:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.022326:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.022332:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143123.022355:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858478720:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 82us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143123.022362:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6315 00000100:00100000:1.0:1746143123.022377:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6316 00000100:00100000:1.0:1746143123.022381:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858478592:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143123.022388:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143123.022426:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 13 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143123.022436:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 13 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143123.022449:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e81ca00/0x25aee876ca70c1a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3411968->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f71c expref: 13 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143123.022465:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143123.022467:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143123.022473:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.022481:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143123.022873:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6317 00000100:00100000:0.0:1746143123.022881:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858478848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143123.022889:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143123.022894:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 9 pid: 17079 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143123.022902:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 9 pid: 17079 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143123.022913:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143123.022917:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143123.022923:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143123.022929:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143123.022942:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143123.022960:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858478848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 81us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143123.022966:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6317 00010000:00010000:1.0:1746143123.023760:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f369600/0x25aee876ca70c292 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d2 expref: 15 pid: 17079 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143123.023776:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861184896:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143123.023788:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd5000/0x25aee876ca70c245 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f79a expref: 8 pid: 17079 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143123.023797:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861185024:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143123.023815:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.023822:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.023828:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:1.0:1746143123.023847:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143123.023995:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a800/0x25aee876ca70c2a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d9 expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.024008:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d9 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.024016:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143123.024018:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143123.024020:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a518be00, rc 0) 00000100:00100000:1.0:1746143123.024071:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30725:x1830962858478336:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 13485us (13702us total) trans 8589942281 rc 0/0 00000100:00100000:1.0:1746143123.024078:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8074 00010000:00010000:1.0:1746143123.024115:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143123.024126:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861185280:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143123.024163:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.025868:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861185152:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.025892:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 12 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.025905:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa4c00, rc 0) 00000100:00100000:3.0:1746143123.025938:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30729:x1830962858478464:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4709us (7276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.025946:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11965 00000100:00100000:0.0:1746143123.027568:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.028173:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.028261:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858479232 00000100:00100000:1.0:1746143123.028270:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858479232 00000100:00100000:3.0:1746143123.028641:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858478976 00000100:00100000:3.0:1746143123.028646:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858478976 00002000:00100000:3.0:1746143123.028683:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1728512->1957887) req@ffff8800942c7480 x1830962858478976/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.028694:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7480 with x1830962858478976 ext(1728512->1957887) 00010000:00010000:3.0:1746143123.028703:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 23 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143123.028718:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 23 pid: 8169 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143123.028726:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c7480 00000100:00100000:3.0:1746143123.028745:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1918 00000100:00100000:3.0:1746143123.028752:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858478976:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143123.030154:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861185280:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143123.030176:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143123.030211:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858478592:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7828us (9999us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143123.030221:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6316 00000100:00100000:1.0:1746143123.030952:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8075 00000100:00100000:1.0:1746143123.030965:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30725:x1830962858479232:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143123.030987:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143123.030991:0:17079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143123.031019:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518be00/0x25aee876ca70c2a7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7d9 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.031051:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143123.031056:0:17079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143123.031068:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f10200/0x25aee876ca70c2bc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7e7 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.031162:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031180:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031189:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031200:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031206:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031212:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031218:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f11c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143123.031222:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031228:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031239:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143123.031242:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143123.031245:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031250:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f11c00/0x25aee876ca70c2c3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.031272:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f10200/0x25aee876ca70c2bc lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e7 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.031279:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f10200/0x25aee876ca70c2bc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e7 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.031286:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f10200, rc 0) 00000100:00100000:1.0:1746143123.031317:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30725:x1830962858479232:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 356us (3758us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143123.031323:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8075 00000100:00100000:1.0:1746143123.038220:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.038285:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858479488 00000100:00100000:0.0:1746143123.038294:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858479488 00002000:00100000:0.0:1746143123.038332:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092996680 x1830962858479488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.038343:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092996680 with x1830962858479488 ext(2097152->3145727) 00002000:00010000:0.0:1746143123.038348:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092996680 00000100:00100000:0.0:1746143123.038369:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5795 00000100:00100000:0.0:1746143123.038376:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858479488:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143123.043603:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.044966:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.047108:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858479744 00000100:00100000:3.0:1746143123.047121:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858479744 00000100:00100000:3.0:1746143123.047179:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3397 00000100:00100000:3.0:1746143123.047187:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f35ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30725:x1830962858479744:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143123.047494:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f35ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30725:x1830962858479744:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 306us (3898us total) trans 8589942282 rc 0/0 00000100:00100000:3.0:1746143123.047501:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3397 00000100:00100000:2.0:1746143123.047674:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858478976:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 18920us (19500us total) trans 17179872698 rc 0/0 00000100:00100000:2.0:1746143123.047685:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1918 00002000:00100000:2.0:1746143123.047695:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1728512->1957887) req@ffff8800942c7480 x1830962858478976/t17179872698(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/448 e 0 to 0 dl 1746143134 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.047711:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7480 with x1830962858478976 ext(1728512->1957887) 00010000:00010000:2.0:1746143123.047721:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 27 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143123.047736:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 27 pid: 8169 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143123.047744:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c7480 00000100:00100000:3.0:1746143123.057288:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858480000 00000100:00100000:3.0:1746143123.057305:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858480000 00002000:00100000:3.0:1746143123.057355:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800942c7100 x1830962858480000/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.057367:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7100 with x1830962858480000 ext(3145728->4194303) 00002000:00010000:3.0:1746143123.057372:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c7100 00000100:00100000:3.0:1746143123.057408:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5796 00000100:00100000:3.0:1746143123.057416:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858480000:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143123.058335:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.058664:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.058756:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858480384 00000100:00100000:1.0:1746143123.058762:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858480384 00010000:00010000:1.0:1746143123.058788:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 28 pid: 8169 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143123.059025:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6318 00000100:00100000:1.0:1746143123.059046:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858480384:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143123.059057:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143123.059074:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 28 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143123.059086:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 28 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143123.059107:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b800/0x25aee876ca70c214 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->1957887) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f77e expref: 28 pid: 8169 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143123.059124:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143123.059126:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143123.059133:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 10 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.059141:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 10 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.059170:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 10 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143123.059180:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861185408:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143123.059245:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.059592:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858480256 00000100:00100000:2.0:1746143123.059596:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858480256 00002000:00100000:2.0:1746143123.059621:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094426680 x1830962858480256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.059629:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094426680 with x1830962858480256 ext(3145728->4194303) 00002000:00010000:2.0:1746143123.059633:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094426680 00000100:00100000:2.0:1746143123.059645:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5797 00000100:00100000:2.0:1746143123.059650:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858480256:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143123.063869:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858479488:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 25479us (25648us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143123.063882:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5795 00002000:00100000:0.0:1746143123.063895:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092996680 x1830962858479488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.063905:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092996680 with x1830962858479488 ext(2097152->3145727) 00002000:00010000:0.0:1746143123.063911:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092996680 00000100:00100000:1.0:1746143123.064024:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861185408:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143123.064059:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143123.064079:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858480384:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5048us (5415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143123.064087:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6318 00000100:00100000:0.0:1746143123.075143:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.075173:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858480640 00000100:00100000:0.0:1746143123.075182:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858480640 00002000:00100000:0.0:1746143123.075222:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1990656->1994751) req@ffff88009c1e9c00 x1830962858480640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.075233:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9c00 with x1830962858480640 ext(1990656->1994751) 00002000:00010000:0.0:1746143123.075239:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1e9c00 00000100:00100000:0.0:1746143123.075257:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5798 00000100:00100000:0.0:1746143123.075264:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858480640:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143123.075626:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858480640:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 361us (494us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143123.075633:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5798 00002000:00100000:0.0:1746143123.075639:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1990656->1994751) req@ffff88009c1e9c00 x1830962858480640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/4536 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.075646:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9c00 with x1830962858480640 ext(1990656->1994751) 00002000:00010000:0.0:1746143123.075649:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1e9c00 00000100:00100000:0.0:1746143123.099181:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.106500:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858480896 00000100:00100000:2.0:1746143123.106516:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858480896 00000100:00100000:2.0:1746143123.106581:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8076 00000100:00100000:2.0:1746143123.106590:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30733:x1830962858480896:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.106616:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.106640:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c2ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7ee expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.106762:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.106776:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.106992:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107007:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107013:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107018:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107139:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107148:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107153:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:2.0:1746143123.107164:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143123.107258:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107265:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107272:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107278:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009494b600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143123.107282:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107295:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107307:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143123.107310:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143123.107314:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107319:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b600/0x25aee876ca70c2d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107337:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107342:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107347:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107351:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009494b000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143123.107354:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107358:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107364:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5dcfe00) 00010000:00010000:2.0:1746143123.107367:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143123.107369:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107382:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c2d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.107437:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c2ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 18 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.107449:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 17 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.107456:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143123.107458:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143123.107460:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c6ee00, rc 0) 00000100:00100000:3.0:1746143123.107633:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858480000:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 50214us (62666us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143123.107645:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5796 00002000:00100000:3.0:1746143123.107657:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800942c7100 x1830962858480000/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.107667:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7100 with x1830962858480000 ext(3145728->4194303) 00002000:00010000:3.0:1746143123.107673:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c7100 00000100:00100000:3.0:1746143123.109099:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858480256:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 49439us (50757us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143123.109108:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5797 00002000:00100000:3.0:1746143123.109116:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094426680 x1830962858480256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.109125:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094426680 with x1830962858480256 ext(3145728->4194303) 00002000:00010000:3.0:1746143123.109130:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094426680 00000100:00100000:2.0:1746143123.109336:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30733:x1830962858480896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2745us (10164us total) trans 8589942283 rc 0/0 00000100:00100000:2.0:1746143123.109344:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8076 00000100:00100000:0.0:1746143123.119279:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.119595:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858481024 00000100:00100000:3.0:1746143123.119606:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858481024 00000100:00100000:3.0:1746143123.119673:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11966 00000100:00100000:3.0:1746143123.119683:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30729:x1830962858481024:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143123.119702:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.119722:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7f5 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.119752:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.119760:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 6 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.119767:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 13 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.119773:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.119775:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.119778:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 13 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.119813:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 13 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.119825:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 13 pid: 8448 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143123.119836:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861185536:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.119938:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 6 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.119947:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 6 pid: 10061 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143123.119955:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861185664:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.119982:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 13 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.119990:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 13 pid: 8448 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143123.119998:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861185792:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143123.120015:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fc00 going to sleep for 11 seconds 00000100:00080000:0.0:1746143123.120300:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143123.130150:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.131339:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858481280 00000100:00100000:3.0:1746143123.131350:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858481280 00000100:00100000:3.0:1746143123.131418:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3398 00000100:00100000:3.0:1746143123.131428:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30733:x1830962858481280:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:3.0:1746143123.131665:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30733:x1830962858481280:12345-192.168.201.28@tcp:35:cat.0 Request processed in 237us (1527us total) trans 8589942284 rc 0/0 00000100:00100000:3.0:1746143123.131673:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3398 00000100:00100000:0.0:1746143123.132615:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861185536:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143123.135182:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861185664:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143123.135195:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861185792:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143123.135233:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 13 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.135258:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f369400, rc 0) 00000100:00100000:0.0:1746143123.135298:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30729:x1830962858481024:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 15617us (16031us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143123.135306:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11966 00000100:00100000:0.0:1746143123.135366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.135464:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.135488:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.135514:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858481920 00000100:00100000:0.0:1746143123.135519:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858481920 00000100:00100000:0.0:1746143123.135546:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858482048 00000100:00100000:0.0:1746143123.135547:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858482048 00000100:00100000:0.0:1746143123.135557:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858482176 00000100:00100000:0.0:1746143123.135558:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858482176 00000100:00100000:0.0:1746143123.135572:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11967 00000100:00100000:0.0:1746143123.135578:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858481920:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143123.135593:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143123.135608:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70c2f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f803 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143123.135651:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861185920:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143123.135706:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.135723:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11968 00000100:00100000:0.0:1746143123.135728:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858482048:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143123.135741:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143123.135748:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a200/0x25aee876ca70c2fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f80a expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.135932:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143123.135942:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a200/0x25aee876ca70c2fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f80a expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.135950:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a200/0x25aee876ca70c2fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f80a expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.135965:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a200, rc 0) 00000100:00100000:0.0:1746143123.135980:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858482048:12345-192.168.201.28@tcp:101:cat.0 Request processed in 252us (516us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143123.135985:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11968 00000100:00100000:3.0:1746143123.136016:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11969 00000100:00100000:3.0:1746143123.136070:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858482176:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143123.136088:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.136104:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f811 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.136126:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.136128:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.136136:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.136149:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.136158:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc9800, rc 0) 00000100:00100000:3.0:1746143123.136212:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858482176:12345-192.168.201.28@tcp:101:cat.0 Request processed in 186us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.138880:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11969 00002000:00010000:0.0:1746143123.139191:0:754:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143121 -> 1746143122 00000100:00100000:0.0:1746143123.139216:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861185920:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143123.139242:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70c2f4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f803 expref: 14 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.139254:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70c2f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f803 expref: 14 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.139263:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a800, rc 0) 00000100:00100000:0.0:1746143123.139309:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858481920:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3730us (3942us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143123.139316:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11967 00000100:00100000:0.0:1746143123.141257:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.141310:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.141336:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.141412:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858481536 00000100:00100000:3.0:1746143123.141421:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858481536 00000100:00100000:0.0:1746143123.141425:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143123.141456:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 13 pid: 8448 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143123.141489:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858481792 00000100:00100000:3.0:1746143123.141491:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858481792 00010000:00010000:3.0:1746143123.141499:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 14 pid: 8448 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143123.141511:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858481664 00000100:00100000:3.0:1746143123.141513:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6319 00000100:00100000:3.0:1746143123.141519:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858481536:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143123.141524:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858481664 00010000:00010000:3.0:1746143123.141530:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.141546:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 13 pid: 8448 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143123.141555:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 7 pid: 10061 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143123.141557:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 13 pid: 8448 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143123.141575:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094234000/0x25aee876ca70c1d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f74d expref: 13 pid: 8448 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143123.141583:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6320 00010000:00010000:3.0:1746143123.141590:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143123.141594:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858481792:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143123.141605:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143123.141623:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 14 pid: 8448 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143123.141631:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858481536:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 112us (320us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143123.141633:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 14 pid: 8448 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143123.141638:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6319 00010000:00010000:2.0:1746143123.141654:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c1c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f73f expref: 14 pid: 8448 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143123.141673:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6321 00010000:00010000:2.0:1746143123.141675:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.141678:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858481664:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.141684:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.141691:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 7 pid: 10061 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143123.141700:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 7 pid: 10061 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143123.141703:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1968:x1830962858481792:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 114us (366us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143123.141709:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a518ac00/0x25aee876ca70c26f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7bd expref: 7 pid: 10061 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143123.141710:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6320 00010000:00010000:3.0:1746143123.141717:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.141719:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.141724:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 11 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.141732:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 11 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143123.141740:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858481408 00000100:00100000:2.0:1746143123.141747:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858481408 00010000:00010000:3.0:1746143123.141755:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 11 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.141765:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861186048:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143123.141765:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11970 00000100:00100000:2.0:1746143123.141774:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858481408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.141786:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.141803:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009494b000/0x25aee876ca70c309 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f7fc expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.141809:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.142017:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861186176:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143123.142083:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.144472:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.144567:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858482304 00000100:00100000:2.0:1746143123.144581:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858482304 00000100:00100000:2.0:1746143123.144637:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11971 00000100:00100000:2.0:1746143123.144651:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30733:x1830962858482304:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.144667:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.144690:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f818 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.144725:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.144733:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.144734:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.144744:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.145291:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.145304:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 12 pid: 4756 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143123.145316:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861186304:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143123.146130:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.149376:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861186048:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143123.149406:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.149460:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858481664:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7780us (8034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.149473:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6321 00002000:00010000:2.0:1746143123.149527:0:754:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143121 -> 1746143122 00000100:00100000:2.0:1746143123.149560:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f35bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861186176:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143123.149595:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009494b000/0x25aee876ca70c309 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7fc expref: 25 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.149613:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009494b000/0x25aee876ca70c309 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7fc expref: 25 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.149641:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009494b000, rc 0) 00000100:00100000:2.0:1746143123.149682:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858481408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7906us (8430us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143123.149696:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11970 00000100:00100000:2.0:1746143123.149740:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861186304:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.149757:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.149776:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4984200, rc 0) 00000100:00100000:2.0:1746143123.149801:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30733:x1830962858482304:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5150us (5335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.149807:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11971 00000100:00100000:0.0:1746143123.150951:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.151017:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.151137:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858482560 00000100:00100000:3.0:1746143123.151144:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858482560 00002000:00100000:3.0:1746143123.151174:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1159168->1163263) req@ffff8800919dc700 x1830962858482560/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.151184:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dc700 with x1830962858482560 ext(1159168->1163263) 00002000:00010000:3.0:1746143123.151189:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dc700 00000100:00100000:3.0:1746143123.151199:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858482688 00000100:00100000:3.0:1746143123.151201:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858482688 00002000:00100000:3.0:1746143123.151209:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (364544->565247) req@ffff8800919ddc00 x1830962858482688/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.151215:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919ddc00 with x1830962858482688 ext(364544->565247) 00010000:00010000:3.0:1746143123.151221:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 13 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143123.151233:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 13 pid: 4756 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143123.151238:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919ddc00 00000100:00100000:3.0:1746143123.151246:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1919 00000100:00100000:3.0:1746143123.151252:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858482688:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:2.0:1746143123.151269:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5799 00000100:00100000:2.0:1746143123.151279:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858482560:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143123.151666:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858482560:12345-192.168.201.28@tcp:3:cat.0 Request processed in 389us (718us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143123.151672:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5799 00002000:00100000:2.0:1746143123.151685:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1159168->1163263) req@ffff8800919dc700 x1830962858482560/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/4536 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.151694:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dc700 with x1830962858482560 ext(1159168->1163263) 00002000:00010000:2.0:1746143123.151698:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dc700 00000100:00100000:0.0:1746143123.159469:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.159529:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858482944 00000100:00100000:2.0:1746143123.159541:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858482944 00000100:00100000:2.0:1746143123.159601:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3399 00000100:00100000:2.0:1746143123.159610:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30729:x1830962858482944:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143123.160103:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30729:x1830962858482944:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 493us (640us total) trans 8589942285 rc 0/0 00000100:00100000:2.0:1746143123.160110:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3399 00000100:00100000:0.0:1746143123.170814:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858482688:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 19551us (19785us total) trans 21474839955 rc 0/0 00000100:00100000:0.0:1746143123.170826:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1919 00002000:00100000:0.0:1746143123.170840:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (364544->565247) req@ffff8800919ddc00 x1830962858482688/t21474839955(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/448 e 0 to 0 dl 1746143134 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.170849:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919ddc00 with x1830962858482688 ext(364544->565247) 00010000:00010000:0.0:1746143123.170859:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 15 pid: 4756 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143123.170898:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 15 pid: 4756 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746143123.170904:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919ddc00 00000100:00100000:1.0:1746143123.172237:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.172352:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858483200 00000100:00100000:0.0:1746143123.172360:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858483200 00002000:00100000:0.0:1746143123.172401:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880092994700 x1830962858483200/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.172410:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092994700 with x1830962858483200 ext(4194304->5210111) 00002000:00010000:0.0:1746143123.172415:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092994700 00000100:00100000:0.0:1746143123.173130:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5800 00000100:00100000:0.0:1746143123.173139:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1970:x1830962858483200:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143123.190754:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.190821:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.190913:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858483328 00000100:00100000:3.0:1746143123.190923:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858483328 00010000:00010000:3.0:1746143123.190955:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 17 pid: 4756 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.190989:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6322 00000100:00100000:3.0:1746143123.190997:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858483328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.191010:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.191053:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 17 pid: 4756 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.191066:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 17 pid: 4756 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.191088:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d8c00/0x25aee876ca70c188 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 364544->565247) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f70e expref: 17 pid: 4756 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.191112:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.191114:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.191120:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.191128:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.191157:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.191168:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861186432:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143123.191230:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.191318:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858483584 00000100:00100000:2.0:1746143123.191322:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858483584 00000100:00100000:2.0:1746143123.191347:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8077 00000100:00100000:2.0:1746143123.191352:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:30736:x1830962858483584:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143123.191368:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.191381:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f81f expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.191479:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191489:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191499:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191510:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191515:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191520:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191599:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191611:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191617:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:2.0:1746143123.191624:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143123.191689:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191695:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191699:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191704:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a48e0400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143123.191707:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191713:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191720:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143123.191723:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143123.191725:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191730:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c31e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191742:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191751:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191755:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191759:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129c6e000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143123.191761:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191765:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191771:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5dcf300) 00010000:00010000:2.0:1746143123.191773:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143123.191775:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191780:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e000/0x25aee876ca70c325 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143123.191811:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 209 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.191820:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 208 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.191826:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143123.191827:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143123.191829:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c6f800, rc 0) 00000100:00100000:2.0:1746143123.191854:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:30736:x1830962858483584:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 502us (1033us total) trans 8589942286 rc 0/0 00000100:00100000:2.0:1746143123.191862:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8077 00000100:00100000:3.0:1746143123.197117:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861186432:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143123.197137:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.197190:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858483328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6193us (6443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.197199:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6322 00000100:00100000:1.0:1746143123.198017:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1970:x1830962858483200:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24873us (25775us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143123.198029:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5800 00002000:00100000:1.0:1746143123.198064:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880092994700 x1830962858483200/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143123.198074:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092994700 with x1830962858483200 ext(4194304->5210111) 00002000:00010000:1.0:1746143123.198080:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092994700 00000100:00100000:0.0:1746143123.208915:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.208966:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.209003:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.209096:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858483840 00000100:00100000:3.0:1746143123.209112:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858483840 00000100:00100000:3.0:1746143123.209159:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858483712 00000100:00100000:3.0:1746143123.209161:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858483712 00000100:00100000:3.0:1746143123.209174:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858483968 00000100:00100000:3.0:1746143123.209175:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858483968 00000100:00100000:3.0:1746143123.209191:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11972 00000100:00100000:3.0:1746143123.209199:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858483840:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143123.209215:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.209229:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9a00/0x25aee876ca70c33a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f82d expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143123.209253:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11973 00000100:00100000:1.0:1746143123.209265:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1971:x1830962858483712:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143123.209276:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861186560:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143123.209282:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143123.209298:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f826 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.209318:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143123.209320:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143123.209328:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.209344:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.209354:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba21800, rc 0) 00000100:00100000:3.0:1746143123.209364:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.209384:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11974 00000100:00100000:3.0:1746143123.209403:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858483968:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143123.209404:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858483712:12345-192.168.201.28@tcp:101:cat.0 Request processed in 129us (423us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143123.209411:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143123.209415:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11973 00010000:00010000:3.0:1746143123.209419:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c348 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f834 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.209441:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861186688:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143123.216489:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.217182:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.217227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.217292:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.217354:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858484224 00000100:00100000:3.0:1746143123.217362:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858484224 00002000:00100000:3.0:1746143123.217413:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880130766300 x1830962858484224/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.217422:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766300 with x1830962858484224 ext(0->1048575) 00002000:00010000:3.0:1746143123.217427:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130766300 00000100:00100000:3.0:1746143123.217442:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858484480 00000100:00100000:3.0:1746143123.217444:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858484480 00002000:00100000:3.0:1746143123.217457:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1990655) req@ffff880130764700 x1830962858484480/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.217463:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764700 with x1830962858484480 ext(1048576->1990655) 00002000:00010000:3.0:1746143123.217466:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130764700 00000100:00100000:3.0:1746143123.217473:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858484736 00000100:00100000:3.0:1746143123.217475:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858484736 00002000:00100000:3.0:1746143123.217485:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1163264->2097151) req@ffff880130766d80 x1830962858484736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.217490:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766d80 with x1830962858484736 ext(1163264->2097151) 00002000:00010000:3.0:1746143123.217493:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130766d80 00000100:00100000:3.0:1746143123.217503:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5801 00000100:00100000:3.0:1746143123.217509:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858484224:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143123.218480:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5802 00000100:00100000:1.0:1746143123.218489:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858484480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143123.218778:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5803 00000100:00100000:3.0:1746143123.218785:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858484736:12345-192.168.201.28@tcp:3:cat.0 00002000:00010000:3.0:1746143123.232091:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143121 -> 1746143122 00002000:00010000:3.0:1746143123.232098:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143121 -> 1746143122 00002000:00010000:3.0:1746143123.232100:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143121 -> 1746143122 00000100:00100000:3.0:1746143123.232119:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861186688:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143123.232150:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c348 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f834 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.232164:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c348 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f834 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.232179:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc8c00, rc 0) 00000100:00100000:3.0:1746143123.232222:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1971:x1830962858483968:12345-192.168.201.28@tcp:101:cat.0 Request processed in 22831us (23216us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143123.232231:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11974 00002000:00010000:2.0:1746143123.234286:0:754:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143121 -> 1746143122 00002000:00010000:2.0:1746143123.234292:0:754:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143121 -> 1746143122 00000100:00100000:2.0:1746143123.234307:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861186560:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143123.234330:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9a00/0x25aee876ca70c33a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f82d expref: 25 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.234528:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9a00/0x25aee876ca70c33a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f82d expref: 25 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.234548:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc9a00, rc 0) 00000100:00100000:2.0:1746143123.234591:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858483840:12345-192.168.201.28@tcp:101:cat.0 Request processed in 25392us (25687us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143123.234599:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11972 00000100:00100000:3.0:1746143123.236316:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858484224:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18802us (19132us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143123.236325:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5801 00002000:00100000:3.0:1746143123.236334:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880130766300 x1830962858484224/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.236343:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766300 with x1830962858484224 ext(0->1048575) 00002000:00010000:3.0:1746143123.236348:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130766300 00000100:00100000:1.0:1746143123.240314:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.240372:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.240461:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858484992 00000100:00100000:3.0:1746143123.240470:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858484992 00000100:00100000:3.0:1746143123.240507:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858484864 00000100:00100000:3.0:1746143123.240509:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858484864 00000100:00100000:0.0:1746143123.245051:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11975 00000100:00100000:0.0:1746143123.245071:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1970:x1830962858484992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143123.245090:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143123.245109:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa4400/0x25aee876ca70c34f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f842 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143123.245162:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861186816:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143123.245252:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.245590:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11976 00000100:00100000:3.0:1746143123.245601:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858484864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143123.245611:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.245619:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9600/0x25aee876ca70c356 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f83b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.245644:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861186944:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143123.247049:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.247316:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858484480:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28825us (30084us total) trans 0 rc 942080/942080 00000100:00100000:2.0:1746143123.247326:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5802 00002000:00100000:2.0:1746143123.247335:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1990655) req@ffff880130764700 x1830962858484480/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.247345:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764700 with x1830962858484480 ext(1048576->1990655) 00002000:00010000:2.0:1746143123.247349:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130764700 00000100:00100000:3.0:1746143123.253531:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861186944:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143123.253531:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861186816:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143123.253560:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9600/0x25aee876ca70c356 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f83b expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.253560:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa4400/0x25aee876ca70c34f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f842 expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.253573:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9600/0x25aee876ca70c356 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f83b expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.253573:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa4400/0x25aee876ca70c34f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f842 expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.253587:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc9600, rc 0) 00010000:00010000:1.0:1746143123.253587:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa4400, rc 0) 00000100:00100000:1.0:1746143123.253629:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1970:x1830962858484992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8560us (13318us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143123.253638:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11975 00000100:00100000:3.0:1746143123.254476:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858484864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8876us (14102us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143123.254482:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11976 00000100:00100000:2.0:1746143123.254677:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858484736:12345-192.168.201.28@tcp:3:cat.0 Request processed in 35892us (37384us total) trans 0 rc 933888/933888 00000100:00100000:2.0:1746143123.254686:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5803 00002000:00100000:2.0:1746143123.254695:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1163264->2097151) req@ffff880130766d80 x1830962858484736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.254704:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766d80 with x1830962858484736 ext(1163264->2097151) 00002000:00010000:2.0:1746143123.254708:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130766d80 00000100:00100000:0.0:1746143123.279138:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.282169:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.282200:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.282224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.282230:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858485248 00000100:00100000:3.0:1746143123.282240:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858485248 00002000:00100000:3.0:1746143123.282282:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880130765c00 x1830962858485248/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.282291:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130765c00 with x1830962858485248 ext(2097152->3145727) 00002000:00010000:3.0:1746143123.282296:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130765c00 00000100:00100000:3.0:1746143123.282311:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858485760 00000100:00100000:3.0:1746143123.282314:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858485760 00002000:00100000:3.0:1746143123.282324:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092996a00 x1830962858485760/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.282330:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092996a00 with x1830962858485760 ext(2097152->3145727) 00002000:00010000:3.0:1746143123.282334:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092996a00 00000100:00100000:3.0:1746143123.282342:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858485632 00000100:00100000:3.0:1746143123.282345:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858485632 00000100:00100000:0.0:1746143123.282347:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858486016 00000100:00100000:0.0:1746143123.282350:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858486016 00002000:00100000:3.0:1746143123.282354:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009f4fed80 x1830962858485632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.282360:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fed80 with x1830962858485632 ext(3145728->4194303) 00002000:00010000:3.0:1746143123.282363:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fed80 00002000:00100000:0.0:1746143123.282364:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009f4fd880 x1830962858486016/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.282370:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd880 with x1830962858486016 ext(3145728->4194303) 00002000:00010000:0.0:1746143123.282372:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fd880 00000100:00100000:3.0:1746143123.282373:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5804 00000100:00100000:3.0:1746143123.282380:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858485248:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143123.282387:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5805 00000100:00100000:0.0:1746143123.282401:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858485760:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143123.282501:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5806 00000100:00100000:3.0:1746143123.282506:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858485632:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143123.282622:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5807 00000100:00100000:2.0:1746143123.282629:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858486016:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143123.302324:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858486016:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19685us (20088us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143123.302335:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5807 00002000:00100000:2.0:1746143123.302348:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009f4fd880 x1830962858486016/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.302357:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd880 with x1830962858486016 ext(3145728->4194303) 00002000:00010000:2.0:1746143123.302362:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fd880 00000100:00100000:2.0:1746143123.311206:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858485248:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28817us (32066us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143123.311217:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5804 00002000:00100000:2.0:1746143123.311228:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880130765c00 x1830962858485248/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.311236:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130765c00 with x1830962858485248 ext(2097152->3145727) 00002000:00010000:2.0:1746143123.311241:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130765c00 00000100:00100000:0.0:1746143123.312373:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.312665:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858486272 00000100:00100000:2.0:1746143123.312673:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858486272 00000100:00100000:2.0:1746143123.312723:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8078 00000100:00100000:2.0:1746143123.312730:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30739:x1830962858486272:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143123.312749:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.312765:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70c35d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f849 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.313359:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.313373:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 20 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.313381:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 207 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.313388:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.313427:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 207 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.313439:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 207 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.313452:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861187072:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.313759:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 20 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.313773:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 20 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.313786:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861187200:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143123.314023:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.325920:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858485632:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43403us (43708us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143123.325931:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5806 00002000:00100000:3.0:1746143123.325941:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009f4fed80 x1830962858485632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.325950:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fed80 with x1830962858485632 ext(3145728->4194303) 00002000:00010000:3.0:1746143123.325956:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fed80 00000100:00100000:0.0:1746143123.326831:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.327302:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861187072:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143123.327311:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861187200:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.327334:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143123.327805:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.328650:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858485760:12345-192.168.201.28@tcp:3:cat.0 Request processed in 46257us (46485us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143123.328657:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5805 00002000:00100000:0.0:1746143123.328665:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092996a00 x1830962858485760/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.328671:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092996a00 with x1830962858485760 ext(2097152->3145727) 00002000:00010000:0.0:1746143123.328675:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092996a00 00000100:00100000:3.0:1746143123.329965:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858486400 00000100:00100000:3.0:1746143123.329974:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858486400 00010000:00010000:3.0:1746143123.330002:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 208 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.330029:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858486528 00000100:00100000:3.0:1746143123.330049:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858486528 00010000:00010000:3.0:1746143123.330061:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 21 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.330079:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6323 00000100:00100000:3.0:1746143123.330085:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:1968:x1830962858486400:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.330098:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.330104:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 208 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.330114:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 208 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.330133:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c32c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f81f expref: 208 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143123.330218:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6324 00000100:00100000:1.0:1746143123.330225:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858486528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143123.330232:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143123.330237:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 21 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.330250:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 21 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.330260:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c2df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7ee expref: 21 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.330285:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143123.330290:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.330299:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.330305:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.330408:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143123.330412:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143123.330436:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858486528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 212us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143123.330441:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6324 00010000:00010000:3.0:1746143123.330479:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.330494:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1968:x1830962858486400:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 409us (3666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.330499:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6323 00010000:00010000:2.0:1746143123.330548:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.330554:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143123.330571:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143123.330677:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70c35d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.330693:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 20 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.330700:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143123.330702:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143123.330703:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a48e6000, rc 0) 00000100:00100000:2.0:1746143123.330725:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30739:x1830962858486272:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 17997us (18354us total) trans 8589942287 rc 0/0 00000100:00100000:2.0:1746143123.330731:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8078 00000100:00100000:0.0:1746143123.341333:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.344110:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858486784 00000100:00100000:2.0:1746143123.344123:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858486784 00002000:00100000:2.0:1746143123.344171:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff880130767800 x1830962858486784/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.344182:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767800 with x1830962858486784 ext(4194304->5206015) 00002000:00010000:2.0:1746143123.344187:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130767800 00000100:00100000:2.0:1746143123.344948:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5808 00000100:00100000:2.0:1746143123.344956:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858486784:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143123.370869:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858486784:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25904us (29533us total) trans 0 rc 1011712/1011712 00000100:00100000:2.0:1746143123.370882:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5808 00002000:00100000:2.0:1746143123.370895:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5206015) req@ffff880130767800 x1830962858486784/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.370905:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767800 with x1830962858486784 ext(4194304->5206015) 00002000:00010000:2.0:1746143123.370911:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130767800 00000100:00100000:0.0:1746143123.377907:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.378755:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858486912 00000100:00100000:3.0:1746143123.378764:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858486912 00000100:00100000:3.0:1746143123.378834:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11977 00000100:00100000:3.0:1746143123.380013:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30739:x1830962858486912:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143123.380050:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.380065:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f850 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.380094:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.380103:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 5 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.380110:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 23 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.380116:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.380118:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.380121:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1273856->1720319] (req 1273856->1720319) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.380150:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 23 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.380166:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 23 pid: 8448 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143123.380178:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187328:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.381102:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 5 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.381112:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 5 pid: 10061 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143123.381120:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187456:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.381627:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.381636:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 13 pid: 4756 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.381646:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187584:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143123.381673:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.382250:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187328:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143123.400641:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.400959:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187456:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143123.400971:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187584:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.401001:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1273856->1720319] (req 1273856->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.401019:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc8200, rc 0) 00000100:00100000:3.0:1746143123.401085:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30739:x1830962858486912:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 22242us (23183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.401098:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11977 00000100:00100000:2.0:1746143123.401182:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858487168 00000100:00100000:2.0:1746143123.401187:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858487168 00010000:00010000:2.0:1746143123.401208:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 6 pid: 10061 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746143123.401226:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6325 00000100:00100000:2.0:1746143123.401229:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858487168:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143123.401239:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143123.401253:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 6 pid: 10061 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746143123.401264:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 6 pid: 10061 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746143123.401281:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a518a600/0x25aee876ca70c268 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7af expref: 6 pid: 10061 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746143123.401301:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143123.401315:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858487168:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 86us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.401319:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6325 00000100:00100000:0.0:1746143123.403274:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.405258:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858487296 00000100:00100000:2.0:1746143123.405268:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858487296 00010000:00010000:2.0:1746143123.405298:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 13 pid: 4756 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.405338:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6326 00000100:00100000:2.0:1746143123.405346:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858487296:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143123.405356:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143123.405373:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 13 pid: 4756 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.405383:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 13 pid: 4756 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.405416:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d8e00/0x25aee876ca70c157 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6f9 expref: 13 pid: 4756 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.405436:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143123.405488:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858487296:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 142us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.405496:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6326 00000100:00100000:0.0:1746143123.407964:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.408196:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858487040 00000100:00100000:3.0:1746143123.408203:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858487040 00010000:00010000:3.0:1746143123.408227:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 24 pid: 8448 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143123.408249:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6327 00000100:00100000:3.0:1746143123.408255:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858487040:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.408266:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.408281:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 24 pid: 8448 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746143123.408294:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 24 pid: 8448 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746143123.408311:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ca9200/0x25aee876ca70c1ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f723 expref: 24 pid: 8448 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746143123.408326:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.408328:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.408334:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.408343:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.408373:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.408386:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861187712:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143123.410678:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.416017:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861187712:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143123.416061:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.416099:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858487040:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7843us (8138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.416110:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6327 00000100:00100000:0.0:1746143123.436099:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.436198:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858487552 00000100:00100000:2.0:1746143123.436208:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858487552 00002000:00100000:2.0:1746143123.436251:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1273856->1277951) req@ffff880130764a80 x1830962858487552/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.436261:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764a80 with x1830962858487552 ext(1273856->1277951) 00002000:00010000:2.0:1746143123.436267:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130764a80 00000100:00100000:2.0:1746143123.436300:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5809 00000100:00100000:2.0:1746143123.436314:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858487552:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143123.436516:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858487552:12345-192.168.201.28@tcp:3:cat.0 Request processed in 207us (425us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143123.436524:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5809 00002000:00100000:2.0:1746143123.436531:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1273856->1277951) req@ffff880130764a80 x1830962858487552/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/4536 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.436539:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764a80 with x1830962858487552 ext(1273856->1277951) 00002000:00010000:2.0:1746143123.436542:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130764a80 00000100:00100000:0.0:1746143123.446349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.446671:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858487808 00000100:00100000:3.0:1746143123.446679:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858487808 00002000:00100000:3.0:1746143123.446716:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1716224->1720319) req@ffff880130766a00 x1830962858487808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.446726:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766a00 with x1830962858487808 ext(1716224->1720319) 00002000:00010000:3.0:1746143123.446730:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130766a00 00000100:00100000:3.0:1746143123.446760:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5810 00000100:00100000:3.0:1746143123.446768:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858487808:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143123.446908:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858487808:12345-192.168.201.28@tcp:3:cat.0 Request processed in 141us (567us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143123.446914:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5810 00002000:00100000:3.0:1746143123.446919:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1716224->1720319) req@ffff880130766a00 x1830962858487808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/4536 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.446927:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766a00 with x1830962858487808 ext(1716224->1720319) 00002000:00010000:3.0:1746143123.446929:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130766a00 00010000:00010000:1.0:1746143123.499244:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143123.526828:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.527210:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858488064 00000100:00100000:2.0:1746143123.527218:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858488064 00000100:00100000:2.0:1746143123.527271:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8079 00000100:00100000:2.0:1746143123.527279:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:30744:x1830962858488064:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.527304:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.527320:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4873800/0x25aee876ca70c379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f857 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.527420:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.527432:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.527441:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.527624:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.527630:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.527635:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.527721:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.527728:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.527734:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143123.527971:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143123.528077:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528087:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528092:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528098:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a518a600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143123.528101:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528107:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528117:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143123.528119:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143123.528122:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528127:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a518a600/0x25aee876ca70c380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528143:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528148:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528153:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528157:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094234000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143123.528159:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528168:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528175:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5dcf600) 00010000:00010000:2.0:1746143123.528177:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143123.528179:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528184:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094234000/0x25aee876ca70c387 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.528223:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4873800/0x25aee876ca70c379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 210 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.528235:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 209 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.528241:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143123.528243:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143123.528246:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a48e7800, rc 0) 00000100:00100000:2.0:1746143123.528305:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:30744:x1830962858488064:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1026us (1482us total) trans 8589942288 rc 0/0 00000100:00100000:2.0:1746143123.528312:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8079 00000100:00100000:0.0:1746143123.537365:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.537540:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858488320 00000100:00100000:2.0:1746143123.537549:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858488320 00000100:00100000:2.0:1746143123.537599:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3400 00000100:00100000:2.0:1746143123.537607:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:30744:x1830962858488320:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:2.0:1746143123.537803:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:30744:x1830962858488320:12345-192.168.201.28@tcp:35:cat.0 Request processed in 196us (445us total) trans 8589942289 rc 0/0 00000100:00100000:2.0:1746143123.537810:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3400 00000100:00100000:0.0:1746143123.568198:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.568369:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858488448 00000100:00100000:3.0:1746143123.568380:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858488448 00000100:00100000:3.0:1746143123.568451:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11978 00000100:00100000:3.0:1746143123.568461:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30736:x1830962858488448:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143123.568482:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.568504:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f85e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.568537:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.568546:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.568553:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.568555:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.568559:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2158592->3141631] (req 2158592->3141631) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.568591:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.568604:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 11 pid: 4758 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143123.568616:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187840:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.568926:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.568936:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 24 pid: 8448 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.568944:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187968:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143123.568967:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.571336:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.571968:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858488704 00000100:00100000:3.0:1746143123.571977:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858488704 00000100:00100000:3.0:1746143123.572064:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8080 00000100:00100000:3.0:1746143123.572072:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30747:x1830962858488704:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143123.572099:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.572117:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9a00/0x25aee876ca70c3a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f865 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.572232:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572246:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572257:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572271:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572277:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572282:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572401:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572410:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572417:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143123.572426:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143123.572518:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572525:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572531:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572537:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5dc9e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143123.572541:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572548:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572560:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143123.572563:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143123.572567:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572572:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9e00/0x25aee876ca70c3aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572595:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572599:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572604:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572608:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5dc9c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143123.572611:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572615:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572621:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4414c00) 00010000:00010000:3.0:1746143123.572623:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143123.572625:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572630:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9c00/0x25aee876ca70c3b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.572665:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9a00/0x25aee876ca70c3a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 23 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.572676:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 22 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.572682:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143123.572684:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143123.572687:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc8000, rc 0) 00000100:00100000:3.0:1746143123.572735:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:30747:x1830962858488704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 663us (1407us total) trans 8589942290 rc 0/0 00000100:00100000:3.0:1746143123.572742:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8080 00000100:00100000:0.0:1746143123.575599:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.576807:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858488832 00000100:00100000:1.0:1746143123.576818:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858488832 00000100:00100000:0.0:1746143123.576843:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.577983:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.577989:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858488960 00000100:00100000:1.0:1746143123.577993:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858488960 00000100:00100000:1.0:1746143123.578009:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858489088 00000100:00100000:1.0:1746143123.578011:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858489088 00000100:00100000:1.0:1746143123.578027:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11979 00000100:00100000:1.0:1746143123.578051:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858488832:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143123.578070:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143123.578089:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135c65000/0x25aee876ca70c3c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f86c expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143123.578094:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11980 00000100:00100000:2.0:1746143123.578104:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858488960:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.578111:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.578119:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a48e6a00/0x25aee876ca70c3cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f873 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143123.578145:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861188096:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143123.578146:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861188224:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143123.578672:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.578691:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11981 00000100:00100000:2.0:1746143123.578697:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858489088:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.578705:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.578715:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4872200/0x25aee876ca70c3d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f87a expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143123.578738:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861188352:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143123.578759:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143123.580003:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfde40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.580246:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.581404:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858489216 00000100:00100000:3.0:1746143123.581412:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858489216 00000100:00100000:0.0:1746143123.581431:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.581451:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8081 00000100:00100000:0.0:1746143123.581455:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.581458:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30749:x1830962858489216:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143123.581479:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.581496:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8600/0x25aee876ca70c3db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f881 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143123.581496:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.581528:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858489344 00000100:00100000:0.0:1746143123.581532:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858489344 00010000:00010000:0.0:1746143123.581552:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 29 pid: 8448 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.581556:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.581569:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143123.581570:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858489728 00000100:00100000:0.0:1746143123.581572:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858489728 00010000:00010000:3.0:1746143123.581580:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.581582:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 12 pid: 4758 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746143123.581592:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143123.581595:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6328 00010000:00010000:3.0:1746143123.581597:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00000100:00100000:0.0:1746143123.581599:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858489344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.581602:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.581609:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143123.581626:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 29 pid: 8448 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143123.581636:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 29 pid: 8448 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143123.581654:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143123.581690:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858489344:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143123.581696:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6328 00000100:00100000:0.0:1746143123.581709:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6329 00000100:00100000:0.0:1746143123.581713:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858489728:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.581715:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.581720:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.581725:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.581725:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 12 pid: 4758 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746143123.581732:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.581739:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 12 pid: 4758 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143123.581749:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143123.581751:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.581754:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.581756:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.581762:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.581764:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 21 pid: 17079 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.581943:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861188480:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143123.581949:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143123.581957:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861188608:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143123.581984:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143123.581997:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858489600 00000100:00100000:1.0:1746143123.582002:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858489600 00000100:00100000:3.0:1746143123.582010:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143123.582046:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3401 00000100:00100000:1.0:1746143123.582052:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:30747:x1830962858489600:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:1.0:1746143123.582191:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:30747:x1830962858489600:12345-192.168.201.28@tcp:35:cat.0 Request processed in 139us (735us total) trans 8589942291 rc 0/0 00000100:00100000:1.0:1746143123.582197:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3401 00000100:00100000:0.0:1746143123.583002:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861188224:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143123.583028:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a48e6a00/0x25aee876ca70c3cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f873 expref: 28 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.583059:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a48e6a00/0x25aee876ca70c3cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f873 expref: 28 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.583071:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a48e6a00, rc 0) 00000100:00100000:0.0:1746143123.583092:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858488960:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4991us (6253us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143123.583102:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11980 00000100:00100000:0.0:1746143123.583141:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861188352:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143123.583156:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4872200/0x25aee876ca70c3d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f87a expref: 16 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.583165:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4872200/0x25aee876ca70c3d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f87a expref: 16 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.583173:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4872200, rc 0) 00000100:00100000:0.0:1746143123.583189:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858489088:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4492us (5207us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143123.583194:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11981 00010000:00010000:2.0:1746143123.583200:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9800/0x25aee876ca70c302 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f811 expref: 12 pid: 4758 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746143123.583221:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187840:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.583231:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f369800/0x25aee876ca70c24c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7a1 expref: 26 pid: 8448 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.583244:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861187968:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.583261:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.583268:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc8c00, rc 0) 00002000:00010000:1.0:1746143123.583281:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143121 -> 1746143122 00002000:00010000:1.0:1746143123.583284:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143121 -> 1746143122 00000100:00100000:2.0:1746143123.583286:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30736:x1830962858488448:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14828us (15101us total) trans 0 rc 0/0 00002000:00010000:1.0:1746143123.583286:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143121 -> 1746143122 00000100:00100000:2.0:1746143123.583291:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11978 00000100:00100000:1.0:1746143123.583295:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861188096:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143123.583307:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135c65000/0x25aee876ca70c3c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f86c expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.583316:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135c65000/0x25aee876ca70c3c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f86c expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.583323:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c65000, rc 0) 00000100:00100000:1.0:1746143123.583337:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858488832:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5288us (7747us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143123.583346:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11979 00000100:00100000:2.0:1746143123.585716:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861188608:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143123.585737:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143123.585770:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858489728:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4054us (4272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.585779:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6329 00000100:00100000:0.0:1746143123.586126:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.586147:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.586167:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858489856 00000100:00100000:0.0:1746143123.586172:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858489856 00000100:00100000:0.0:1746143123.586197:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11982 00000100:00100000:0.0:1746143123.586203:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858489856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143123.586216:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143123.586228:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135e9aa00/0x25aee876ca70c3f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f888 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143123.586268:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861188736:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143123.586304:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.586364:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861188480:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.586381:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:2.0:1746143123.587018:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858490112 00000100:00100000:2.0:1746143123.587023:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858490112 00000100:00100000:2.0:1746143123.587073:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3402 00000100:00100000:2.0:1746143123.587078:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:23947:x1830962858490112:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143123.587256:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:23947:x1830962858490112:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 177us (1106us total) trans 8589942292 rc 0/0 00000100:00100000:2.0:1746143123.587263:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3402 00000100:00100000:0.0:1746143123.588194:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.588351:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858490368 00000100:00100000:3.0:1746143123.588356:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858490368 00002000:00100000:3.0:1746143123.588396:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2158592->2162687) req@ffff880092a71180 x1830962858490368/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.588405:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71180 with x1830962858490368 ext(2158592->2162687) 00002000:00010000:3.0:1746143123.588411:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a71180 00000100:00100000:3.0:1746143123.588434:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5811 00000100:00100000:3.0:1746143123.588441:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858490368:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143123.588751:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858490368:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 311us (560us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143123.588757:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5811 00002000:00100000:3.0:1746143123.588761:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2158592->2162687) req@ffff880092a71180 x1830962858490368/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/4536 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.588767:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71180 with x1830962858490368 ext(2158592->2162687) 00002000:00010000:3.0:1746143123.588770:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a71180 00000100:00100000:2.0:1746143123.595219:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:0.0:1746143123.595330:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143121 -> 1746143122 00002000:00010000:0.0:1746143123.595336:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143121 -> 1746143122 00002000:00010000:0.0:1746143123.595338:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143121 -> 1746143122 00000100:00100000:0.0:1746143123.595360:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861188736:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143123.595410:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135e9aa00/0x25aee876ca70c3f7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f888 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.595425:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135e9aa00/0x25aee876ca70c3f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f888 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.595451:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135e9aa00, rc 0) 00000100:00100000:0.0:1746143123.595508:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858489856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9303us (9381us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143123.595517:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11982 00000100:00100000:3.0:1746143123.595729:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858490496 00000100:00100000:3.0:1746143123.595736:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858490496 00010000:00010000:3.0:1746143123.595764:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 24 pid: 17079 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.595788:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6330 00000100:00100000:3.0:1746143123.595793:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858490496:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.595805:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.595811:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 24 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.595820:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 24 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.595837:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e6000/0x25aee876ca70c364 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f849 expref: 24 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.595861:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143123.595867:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.595877:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.595884:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.595901:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.595918:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858490496:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 125us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.595924:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6330 00010000:00010000:3.0:1746143123.595943:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.595948:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143123.595989:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143123.595993:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143123.596007:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596015:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596024:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596048:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596055:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596063:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cdb200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143123.596067:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596073:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596081:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143123.596084:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143123.596087:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596091:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c3e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596099:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596103:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596107:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596111:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129c6ee00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143123.596113:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596116:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596121:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4414500) 00010000:00010000:3.0:1746143123.596123:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143123.596126:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596129:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.596203:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8600/0x25aee876ca70c3db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.596214:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.596220:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143123.596221:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143123.596223:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c6f800, rc 0) 00000100:00100000:3.0:1746143123.596248:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30749:x1830962858489216:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 14792us (16006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.596255:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8081 00000100:00100000:0.0:1746143123.601915:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.602011:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858490880 00000100:00100000:3.0:1746143123.602021:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858490880 00000100:00100000:3.0:1746143123.602097:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8082 00000100:00100000:3.0:1746143123.602106:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:30751:x1830962858490880:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143123.602134:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.602155:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f88f expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.602279:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602294:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602306:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602318:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602324:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602328:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602451:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602654:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602660:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143123.602670:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143123.602759:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602765:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602771:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602777:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a48e0400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143123.602781:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602788:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602798:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143123.602801:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143123.602805:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602810:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e0400/0x25aee876ca70c405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602824:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602828:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602833:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602835:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009494b000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143123.602837:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602841:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602846:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531b00) 00010000:00010000:3.0:1746143123.602848:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143123.602850:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602854:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009494b000/0x25aee876ca70c40c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143123.602886:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70c3fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 26 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.602897:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 25 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.602903:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143123.602905:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143123.602908:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009494a400, rc 0) 00000100:00100000:3.0:1746143123.602967:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30751:x1830962858490880:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 862us (1063us total) trans 8589942293 rc 0/0 00000100:00100000:3.0:1746143123.602973:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8082 00000100:00100000:0.0:1746143123.603941:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.603964:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.604013:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858491008 00000100:00100000:2.0:1746143123.604019:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858491008 00002000:00100000:2.0:1746143123.604064:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092a70e00 x1830962858491008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.604073:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70e00 with x1830962858491008 ext(0->1048575) 00002000:00010000:2.0:1746143123.604077:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a70e00 00000100:00100000:2.0:1746143123.604090:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858491264 00000100:00100000:2.0:1746143123.604092:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858491264 00002000:00100000:2.0:1746143123.604104:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3137536->3141631) req@ffff880092a72d80 x1830962858491264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.604110:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72d80 with x1830962858491264 ext(3137536->3141631) 00002000:00010000:2.0:1746143123.604113:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a72d80 00000100:00100000:2.0:1746143123.604130:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5812 00000100:00100000:2.0:1746143123.604135:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858491008:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143123.604942:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5813 00000100:00100000:0.0:1746143123.604950:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858491264:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143123.605099:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858491264:12345-192.168.201.28@tcp:3:cat.0 Request processed in 150us (1133us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143123.605106:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5813 00002000:00100000:0.0:1746143123.605111:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3137536->3141631) req@ffff880092a72d80 x1830962858491264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/4536 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.605119:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72d80 with x1830962858491264 ext(3137536->3141631) 00002000:00010000:0.0:1746143123.605123:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a72d80 00000100:00100000:0.0:1746143123.608007:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.608162:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858491520 00000100:00100000:3.0:1746143123.608171:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858491520 00000100:00100000:3.0:1746143123.608223:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3403 00000100:00100000:3.0:1746143123.608229:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f35fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:30736:x1830962858491520:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143123.608447:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f35fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:30736:x1830962858491520:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 217us (449us total) trans 8589942294 rc 0/0 00000100:00100000:3.0:1746143123.608454:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3403 00000100:00100000:0.0:1746143123.620774:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.620906:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858491648 00000100:00100000:2.0:1746143123.620915:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858491648 00000100:00100000:2.0:1746143123.620959:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11983 00000100:00100000:2.0:1746143123.620967:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858491648:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143123.620985:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.621003:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f896 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.621028:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143123.621058:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143123.621067:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.621083:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.621100:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cf9a00, rc 0) 00000100:00100000:2.0:1746143123.623394:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858491648:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 2407us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.623405:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11983 00000100:00100000:0.0:1746143123.624208:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.625065:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.625103:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858491904 00000100:00100000:1.0:1746143123.625112:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858491904 00000100:00100000:1.0:1746143123.625152:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858492160 00000100:00100000:1.0:1746143123.625155:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858492160 00000100:00100000:1.0:1746143123.625176:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11984 00000100:00100000:1.0:1746143123.625182:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858491904:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143123.625203:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143123.625220:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70c428 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8a4 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143123.625271:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861188864:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143123.625369:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11985 00000100:00100000:0.0:1746143123.625375:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858492160:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143123.625382:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143123.625419:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135e9b200/0x25aee876ca70c42f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8b2 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143123.625445:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861188992:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143123.625586:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.625654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.625716:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.625736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.626375:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858491008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22236us (22432us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143123.626402:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5812 00002000:00100000:2.0:1746143123.626413:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092a70e00 x1830962858491008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.626422:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70e00 with x1830962858491008 ext(0->1048575) 00002000:00010000:2.0:1746143123.626428:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a70e00 00000100:00100000:2.0:1746143123.626445:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858492416 00000100:00100000:2.0:1746143123.626448:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858492416 00002000:00100000:2.0:1746143123.626470:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094511180 x1830962858492416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 504/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.626477:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511180 with x1830962858492416 ext(1048576->2097151) 00002000:00010000:2.0:1746143123.626480:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094511180 00000100:00100000:2.0:1746143123.626494:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5814 00000100:00100000:2.0:1746143123.626499:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858492416:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143123.627108:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858491776 00000100:00100000:3.0:1746143123.627113:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858491776 00000100:00100000:3.0:1746143123.627133:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858492032 00000100:00100000:3.0:1746143123.627135:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858492032 00000100:00100000:3.0:1746143123.627155:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11986 00000100:00100000:3.0:1746143123.627160:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858491776:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143123.627167:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.627179:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70c436 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f89d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.627214:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861189120:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143123.627251:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.627268:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11987 00000100:00100000:3.0:1746143123.627272:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858492032:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143123.627279:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.627289:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd19200/0x25aee876ca70c43d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8ab expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.627315:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861189248:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143123.627333:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.627649:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.636520:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861188864:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143123.636560:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70c428 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8a4 expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.636575:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70c428 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8a4 expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.636599:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8200, rc 0) 00000100:00100000:2.0:1746143123.636645:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858491904:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 11462us (12438us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143123.636655:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11984 00000100:00100000:1.0:1746143123.637925:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861189248:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143123.637951:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd19200/0x25aee876ca70c43d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ab expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.637963:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd19200/0x25aee876ca70c43d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ab expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.637976:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd19200, rc 0) 00000100:00100000:1.0:1746143123.637999:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858492032:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 10725us (12282us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143123.638006:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11987 00000100:00100000:3.0:1746143123.639213:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861189120:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143123.639236:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70c436 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f89d expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.639246:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70c436 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f89d expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.639260:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a48e0400, rc 0) 00000100:00100000:3.0:1746143123.639287:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858491776:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 12126us (13632us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143123.639293:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11986 00000100:00100000:0.0:1746143123.639724:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861188992:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143123.639740:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135e9b200/0x25aee876ca70c42f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b2 expref: 6 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.639748:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135e9b200/0x25aee876ca70c42f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b2 expref: 6 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.640244:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135e9b200, rc 0) 00000100:00100000:0.0:1746143123.640405:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858492160:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 15028us (15339us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143123.640410:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11985 00000100:00100000:2.0:1746143123.643274:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858492416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16765us (17527us total) trans 0 rc 602112/602112 00000100:00100000:2.0:1746143123.643287:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5814 00002000:00100000:2.0:1746143123.643299:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094511180 x1830962858492416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 504/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 602112/602112 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.643309:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511180 with x1830962858492416 ext(1048576->2097151) 00002000:00010000:2.0:1746143123.643315:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094511180 00000100:00100000:0.0:1746143123.646773:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.648120:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858492544 00000100:00100000:2.0:1746143123.648130:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858492544 00000100:00100000:2.0:1746143123.648185:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11988 00000100:00100000:2.0:1746143123.648194:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30744:x1830962858492544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.648213:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.648232:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8b9 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.648264:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.648273:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.648275:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.648278:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.648308:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.648321:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 10 pid: 8450 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.648333:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861189376:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143123.648430:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.663077:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.663505:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861189376:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143123.663524:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143123.663540:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.663564:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cf8000, rc 0) 00000100:00100000:3.0:1746143123.663614:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30744:x1830962858492544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 15422us (16853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.663623:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11988 00000100:00100000:2.0:1746143123.663793:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858492800 00000100:00100000:2.0:1746143123.663800:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858492800 00000100:00100000:2.0:1746143123.663847:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8083 00000100:00100000:2.0:1746143123.663853:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30749:x1830962858492800:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143123.663871:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.663888:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8c00/0x25aee876ca70c44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8c0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.663980:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.663994:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.664008:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 24 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.664014:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.664061:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 24 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.664073:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 24 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.664083:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861189504:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.664165:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.664174:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 10 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.664182:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861189632:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143123.664203:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.664220:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858492928 00000100:00100000:2.0:1746143123.664223:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858492928 00002000:00100000:2.0:1746143123.664250:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1273856->1720319) req@ffff880092a72680 x1830962858492928/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.664260:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72680 with x1830962858492928 ext(1273856->1720319) 00010000:00010000:2.0:1746143123.664267:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 11 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.664277:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 11 pid: 8450 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143123.664282:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a72680 00000100:00100000:2.0:1746143123.664296:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1920 00000100:00100000:2.0:1746143123.664301:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858492928:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143123.668763:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.668854:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858493056 00000100:00100000:3.0:1746143123.668862:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858493056 00000100:00100000:3.0:1746143123.668901:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11989 00000100:00100000:3.0:1746143123.668907:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30747:x1830962858493056:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143123.668923:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.668940:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8c7 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.668969:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.668976:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143123.668977:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143123.668981:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 14 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.669006:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.669016:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 23 pid: 8450 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.669027:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861189760:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143123.669131:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.693100:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.693246:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858493184 00000100:00100000:2.0:1746143123.693256:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858493184 00000100:00100000:2.0:1746143123.693312:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11990 00000100:00100000:2.0:1746143123.693320:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30751:x1830962858493184:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143123.693340:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.693358:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8ce expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.693398:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.693404:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 23 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.693410:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143123.693413:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.693444:0:4758:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 23 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.693460:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.693470:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc9200, rc 0) 00000100:00100000:2.0:1746143123.693512:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30751:x1830962858493184:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 192us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.693517:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11990 00000100:00100000:3.0:1746143123.694712:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861189504:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143123.695252:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.695756:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858493312 00000100:00100000:1.0:1746143123.695763:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858493312 00010000:00010000:1.0:1746143123.695791:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 25 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143123.695892:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6331 00000100:00100000:1.0:1746143123.695899:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858493312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143123.695912:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143123.695918:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 25 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.695932:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 25 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.695954:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009494a400/0x25aee876ca70c413 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f88f expref: 25 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.696165:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143123.696171:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.696180:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.696185:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143123.696219:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858493312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 320us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143123.696226:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6331 00000100:00100000:0.0:1746143123.700063:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.700111:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.700135:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858493568 00000100:00100000:0.0:1746143123.700142:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858493568 00002000:00100000:0.0:1746143123.700181:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2158592->3141631) req@ffff880092a78e00 x1830962858493568/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.700191:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78e00 with x1830962858493568 ext(2158592->3141631) 00010000:00010000:0.0:1746143123.700200:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 24 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143123.700213:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 24 pid: 8450 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746143123.700219:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a78e00 00000100:00100000:1.0:1746143123.700285:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858493440 00000100:00100000:1.0:1746143123.700289:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858493440 00010000:00010000:1.0:1746143123.700309:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 11 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.700604:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861189760:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.700628:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.700642:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd18000, rc 0) 00000100:00100000:2.0:1746143123.700680:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30747:x1830962858493056:12345-192.168.201.28@tcp:101:cat.0 Request processed in 31772us (31927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.700689:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11989 00000100:00100000:3.0:1746143123.701065:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861189632:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143123.701088:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143123.706596:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6332 00000100:00100000:1.0:1746143123.706614:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858493440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143123.706633:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143123.706644:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 11 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.706663:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 11 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.706686:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f800/0x25aee876ca70c3f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f881 expref: 11 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.706702:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143123.706707:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.706716:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.706723:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.706746:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143123.706796:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858493440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 188us (6765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143123.706803:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6332 00010000:00010000:2.0:1746143123.707046:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.707054:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143123.707075:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143123.707224:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf8c00/0x25aee876ca70c44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.707244:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.707250:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143123.707253:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143123.707255:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cf9c00, rc 0) 00000100:00100000:2.0:1746143123.707278:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30749:x1830962858492800:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 43425us (44248us total) trans 8589942295 rc 0/0 00000100:00100000:2.0:1746143123.707284:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8083 00000100:00100000:3.0:1746143123.707424:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1921 00000100:00100000:3.0:1746143123.707435:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858493568:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143123.712683:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858492928:12345-192.168.201.28@tcp:4:cat.0 Request processed in 48370us (49149us total) trans 17179872699 rc 0/0 00000100:00100000:2.0:1746143123.712695:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1920 00002000:00100000:2.0:1746143123.712709:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1273856->1720319) req@ffff880092a72680 x1830962858492928/t17179872699(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/448 e 0 to 0 dl 1746143134 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.712719:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72680 with x1830962858492928 ext(1273856->1720319) 00010000:00010000:2.0:1746143123.712730:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 15 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.712744:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 15 pid: 8450 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143123.712750:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a72680 00000100:00100000:0.0:1746143123.725377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.725541:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858493696 00000100:00100000:2.0:1746143123.725551:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858493696 00000100:00100000:2.0:1746143123.725629:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8084 00000100:00100000:2.0:1746143123.725637:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30749:x1830962858493696:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143123.725663:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.725682:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70c46e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8d5 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.725768:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.725783:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.725790:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143123.725821:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.725832:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 11 pid: 17079 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.725843:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861190016:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143123.725948:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.733952:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.733991:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858493824 00000100:00100000:1.0:1746143123.734001:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858493824 00010000:00010000:1.0:1746143123.734066:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 12 pid: 17079 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.734171:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861190016:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.734194:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143123.734862:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6333 00000100:00100000:1.0:1746143123.734871:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858493824:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143123.734886:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143123.734893:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 12 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.734903:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 12 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.734925:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf9c00/0x25aee876ca70c452 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c0 expref: 12 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.735027:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143123.735050:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.735061:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.735068:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143123.735801:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143123.735854:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858493824:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 983us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143123.735862:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6333 00010000:00010000:3.0:1746143123.736167:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.736176:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143123.736226:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143123.736230:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143123.736246:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.736278:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b000/0x25aee876ca70c46e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.736396:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.736403:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143123.736407:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143123.736410:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cdb200, rc 0) 00000100:00100000:3.0:1746143123.736694:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30749:x1830962858493696:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 11056us (11327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.736701:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8084 00000100:00100000:0.0:1746143123.742961:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.743008:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858493952 00000100:00100000:0.0:1746143123.743017:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858493952 00010000:00010000:0.0:1746143123.743070:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 15 pid: 8450 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.744495:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6334 00000100:00100000:3.0:1746143123.744508:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858493952:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.744524:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.744553:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 15 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.744566:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 15 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.744589:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8200/0x25aee876ca70c372 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1273856->1720319) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f850 expref: 15 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.744604:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.744606:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.744620:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 25 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.744628:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 25 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.744664:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 25 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.744685:0:4759:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.744697:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861190144:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143123.744778:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.751419:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.751448:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858494080 00000100:00100000:2.0:1746143123.751457:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858494080 00000100:00100000:2.0:1746143123.751505:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11991 00000100:00100000:2.0:1746143123.751513:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858494080:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143123.751531:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.751551:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4b7d600/0x25aee876ca70c47c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8dc expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.751576:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143123.751588:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b7d600/0x25aee876ca70c47c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8dc expref: 6 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.751599:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b7d600/0x25aee876ca70c47c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8dc expref: 6 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.751613:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b7d600, rc 0) 00000100:00100000:2.0:1746143123.751659:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858494080:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 147us (254us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143123.751666:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11991 00000100:00100000:2.0:1746143123.751697:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.751709:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858494336 00000100:00100000:2.0:1746143123.751712:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858494336 00000100:00100000:2.0:1746143123.751727:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11992 00000100:00100000:2.0:1746143123.751733:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858494336:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143123.751741:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.751751:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4b7ca00/0x25aee876ca70c483 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8ea expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143123.751791:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861190272:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143123.751841:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.751888:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.751932:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.751949:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858494208 00000100:00100000:2.0:1746143123.751952:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858494208 00000100:00100000:2.0:1746143123.751974:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11993 00000100:00100000:2.0:1746143123.751979:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858494208:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143123.751985:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.751994:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70c48a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8e3 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143123.752018:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861190400:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143123.752071:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.752088:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858494720 00000100:00100000:2.0:1746143123.752091:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858494720 00002000:00100000:2.0:1746143123.752116:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094510700 x1830962858494720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.752126:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510700 with x1830962858494720 ext(1048576->2097151) 00010000:00010000:2.0:1746143123.752133:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 26 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.752143:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 26 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143123.752150:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094510700 00000100:00100000:2.0:1746143123.752163:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1922 00000100:00100000:2.0:1746143123.752168:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858494720:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143123.756913:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861190144:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143123.756938:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.756992:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858493952:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 12486us (14041us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.757004:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6334 00000100:00100000:3.0:1746143123.762758:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858493568:12345-192.168.201.28@tcp:4:cat.0 Request processed in 55312us (62633us total) trans 17179872700 rc 0/0 00000100:00100000:3.0:1746143123.762771:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1921 00002000:00100000:3.0:1746143123.762784:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2158592->3141631) req@ffff880092a78e00 x1830962858493568/t17179872700(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/448 e 0 to 0 dl 1746143134 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.762796:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78e00 with x1830962858493568 ext(2158592->3141631) 00010000:00010000:3.0:1746143123.762808:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 28 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.762823:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 28 pid: 8450 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143123.762831:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a78e00 00000100:00100000:1.0:1746143123.781358:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.781672:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.781789:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861190272:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143123.781825:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4b7ca00/0x25aee876ca70c483 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ea expref: 8 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.781840:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4b7ca00/0x25aee876ca70c483 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ea expref: 8 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.781856:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b7ca00, rc 0) 00000100:00100000:3.0:1746143123.781896:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858494336:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 30162us (30197us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143123.781907:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11992 00000100:00100000:3.0:1746143123.781937:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858494464 00000100:00100000:3.0:1746143123.781943:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858494464 00000100:00100000:3.0:1746143123.781972:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11994 00000100:00100000:3.0:1746143123.781978:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858494464:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143123.781994:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.782008:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135c9be00/0x25aee876ca70c491 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8f1 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.782073:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861190528:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143123.782122:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.782140:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858494848 00000100:00100000:3.0:1746143123.782143:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858494848 00010000:00010000:3.0:1746143123.782161:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 28 pid: 8450 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.782182:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6335 00000100:00100000:3.0:1746143123.782188:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858494848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.782196:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.782210:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 28 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.782221:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 28 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.782240:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.782243:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.782250:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 13 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.782259:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 13 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.782280:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 13 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.782289:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861190656:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143123.782309:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.782976:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861190400:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143123.783005:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70c48a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8e3 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.783016:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70c48a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8e3 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.783025:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c29a00, rc 0) 00000100:00100000:2.0:1746143123.783064:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858494208:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 31084us (31174us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143123.783070:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11993 00000100:00100000:2.0:1746143123.788247:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858494720:12345-192.168.201.28@tcp:3:cat.0 Request processed in 36065us (36301us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143123.788263:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1922 00002000:00100000:2.0:1746143123.788277:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094510700 x1830962858494720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.788288:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510700 with x1830962858494720 ext(1048576->2097151) 00010000:00010000:2.0:1746143123.788300:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 27 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.788317:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 27 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143123.788325:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094510700 00010000:00010000:3.0:1746143123.788855:0:26949:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.201.28@tcp) returned -22 from glimpse AST (req@ffff8800a5ccb480 x1830962861190528) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 26 pid: 8450 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.788906:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc8c00/0x25aee876ca70c39c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2158592->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f85e expref: 26 pid: 8450 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.788923:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861190528:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143123.788957:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135c9be00/0x25aee876ca70c491 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8f1 expref: 6 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.788967:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135c9be00/0x25aee876ca70c491 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8f1 expref: 6 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143123.788973:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c9be00, rc 0) 00000100:00100000:3.0:1746143123.789002:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858494464:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7024us (7656us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143123.789008:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11994 00000100:00100000:3.0:1746143123.789794:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861190656:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143123.789808:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.789834:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858494848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7645us (8161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.789843:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6335 00000100:00100000:0.0:1746143123.797412:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.797702:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858495104 00000100:00100000:3.0:1746143123.797712:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858495104 00000100:00100000:3.0:1746143123.797758:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8085 00000100:00100000:3.0:1746143123.797766:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30749:x1830962858495104:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143123.797787:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143123.797806:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577000/0x25aee876ca70c498 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8f8 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.797909:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.797924:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.797936:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.797948:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.797955:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.797961:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.797967:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5577600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143123.797972:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.797979:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.797991:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143123.797993:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143123.797997:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.798003:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577600/0x25aee876ca70c49f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143123.798055:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577000/0x25aee876ca70c498 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8f8 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.798065:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5577000/0x25aee876ca70c498 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8f8 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.798073:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5577000, rc 0) 00000100:00100000:3.0:1746143123.798130:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30749:x1830962858495104:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 363us (732us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143123.798136:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8085 00000100:00100000:0.0:1746143123.800104:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.800145:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.800199:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858495360 00000100:00100000:3.0:1746143123.800205:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858495360 00002000:00100000:3.0:1746143123.800234:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092a78a80 x1830962858495360/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.800244:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78a80 with x1830962858495360 ext(2097152->3145727) 00002000:00010000:3.0:1746143123.800249:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a78a80 00000100:00100000:3.0:1746143123.800269:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858495616 00000100:00100000:3.0:1746143123.800271:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858495616 00002000:00100000:3.0:1746143123.800281:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a79f80 x1830962858495616/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.800287:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79f80 with x1830962858495616 ext(3145728->4194303) 00002000:00010000:3.0:1746143123.800289:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a79f80 00000100:00100000:3.0:1746143123.800299:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5815 00000100:00100000:3.0:1746143123.800304:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858495360:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143123.801914:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5816 00000100:00100000:2.0:1746143123.801926:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858495616:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143123.811202:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.813973:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858495872 00000100:00100000:1.0:1746143123.813991:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858495872 00000100:00100000:1.0:1746143123.814073:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3404 00000100:00100000:1.0:1746143123.814082:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30749:x1830962858495872:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:1.0:1746143123.814336:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30749:x1830962858495872:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 255us (3145us total) trans 8589942296 rc 0/0 00000100:00100000:1.0:1746143123.814345:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3404 00000100:00100000:0.0:1746143123.814963:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.815049:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.815138:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858496128 00000100:00100000:2.0:1746143123.815143:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858496128 00000100:00100000:2.0:1746143123.815171:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11995 00000100:00100000:2.0:1746143123.815177:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30744:x1830962858496128:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.815189:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.815207:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f8ff expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.815235:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.815243:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.815245:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.815248:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 26 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.815276:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.815288:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 17 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.815300:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861190784:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143123.815348:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b630fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.816406:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858496000 00000100:00100000:3.0:1746143123.816413:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858496000 00010000:00010000:3.0:1746143123.816439:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 27 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.816462:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6336 00000100:00100000:3.0:1746143123.816466:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858496000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.816480:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.816504:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 27 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.816514:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 27 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.816532:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70c444 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8b9 expref: 27 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.817762:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.817766:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.817777:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.817787:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.818049:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.818063:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861190912:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143123.818131:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143123.821742:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858495360:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 21426us (21631us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143123.821755:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5815 00002000:00100000:3.0:1746143123.821767:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092a78a80 x1830962858495360/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.821777:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78a80 with x1830962858495360 ext(2097152->3145727) 00002000:00010000:3.0:1746143123.821783:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a78a80 00000100:00100000:0.0:1746143123.823634:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.823674:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.823850:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858496256 00000100:00100000:1.0:1746143123.823860:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858496256 00002000:00100000:1.0:1746143123.823899:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1990656->2097151) req@ffff880092a7b800 x1830962858496256/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143123.823908:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a7b800 with x1830962858496256 ext(1990656->2097151) 00010000:00010000:1.0:1746143123.823918:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 16 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.823933:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 16 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:1.0:1746143123.823942:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a7b800 00000100:00100000:1.0:1746143123.823959:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858496512 00000100:00100000:1.0:1746143123.823961:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858496512 00002000:00100000:1.0:1746143123.823972:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1765376->1769471) req@ffff880092a78380 x1830962858496512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143123.823978:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78380 with x1830962858496512 ext(1765376->1769471) 00002000:00010000:1.0:1746143123.823982:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a78380 00000100:00100000:1.0:1746143123.823994:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1923 00000100:00100000:1.0:1746143123.824000:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858496256:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:2.0:1746143123.824501:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5817 00000100:00100000:2.0:1746143123.824510:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858496512:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143123.824651:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858496512:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 142us (975us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143123.824661:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5817 00002000:00100000:2.0:1746143123.824666:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1765376->1769471) req@ffff880092a78380 x1830962858496512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/4536 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.824673:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78380 with x1830962858496512 ext(1765376->1769471) 00002000:00010000:2.0:1746143123.824676:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a78380 00000100:00100000:2.0:1746143123.824712:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861190784:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.824736:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 26 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.824752:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132009200, rc 0) 00000100:00100000:2.0:1746143123.824771:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30744:x1830962858496128:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9595us (9742us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.824778:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11995 00000100:00100000:3.0:1746143123.824931:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861190912:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143123.824943:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.824961:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858496000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8495us (10000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.824968:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6336 00000100:00100000:3.0:1746143123.827206:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858495616:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 25275us (27051us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143123.827217:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5816 00002000:00100000:3.0:1746143123.827226:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a79f80 x1830962858495616/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.827235:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79f80 with x1830962858495616 ext(3145728->4194303) 00002000:00010000:3.0:1746143123.827240:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a79f80 00000100:00100000:1.0:1746143123.828326:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858496256:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 4320us (4695us total) trans 17179872701 rc 0/0 00000100:00100000:1.0:1746143123.828335:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1923 00002000:00100000:1.0:1746143123.828343:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1990656->2097151) req@ffff880092a7b800 x1830962858496256/t17179872701(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/448 e 0 to 0 dl 1746143134 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143123.828352:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a7b800 with x1830962858496256 ext(1990656->2097151) 00010000:00010000:1.0:1746143123.828361:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 16 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.828376:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 16 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:1.0:1746143123.828398:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a7b800 00000100:00100000:0.0:1746143123.837662:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.838264:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.838742:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858496640 00000100:00100000:2.0:1746143123.838752:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858496640 00000100:00100000:2.0:1746143123.838800:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11996 00000100:00100000:2.0:1746143123.838808:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30751:x1830962858496640:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143123.839047:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.839066:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f906 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.839097:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.839105:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.839118:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143123.839121:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->1277951] (req 1048576->1277951) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.839154:0:26949:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.839167:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->1277951] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.839177:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132008400, rc 0) 00000100:00100000:2.0:1746143123.839224:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30751:x1830962858496640:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 417us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.839231:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11996 00000100:00100000:3.0:1746143123.841846:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858496768 00000100:00100000:3.0:1746143123.841856:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858496768 00010000:00010000:3.0:1746143123.841885:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 17 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.841921:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6337 00000100:00100000:3.0:1746143123.841927:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858496768:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.841938:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.841958:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 17 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.841969:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 17 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.841989:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70c2ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7e0 expref: 17 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.842003:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.842005:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.842011:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.842019:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.842059:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.842069:0:4759:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 24 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.842086:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861191168:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143123.842148:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.843945:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.844216:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858496896 00000100:00100000:1.0:1746143123.844221:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858496896 00000100:00100000:1.0:1746143123.844254:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11997 00000100:00100000:1.0:1746143123.844260:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858496896:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143123.844276:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143123.844289:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009acd1e00/0x25aee876ca70c4b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f90d expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143123.844306:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143123.844315:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009acd1e00/0x25aee876ca70c4b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f90d expref: 18 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.844325:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009acd1e00/0x25aee876ca70c4b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f90d expref: 18 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143123.844340:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd1e00, rc 0) 00000100:00100000:1.0:1746143123.844372:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858496896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 112us (433us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143123.844391:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11997 00000100:00100000:3.0:1746143123.849969:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861191168:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143123.849991:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143123.850059:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858496768:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8130us (11795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143123.850071:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6337 00000100:00100000:0.0:1746143123.857525:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.857595:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.857688:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858497280 00000100:00100000:2.0:1746143123.857698:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858497280 00000100:00100000:2.0:1746143123.857743:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11998 00000100:00100000:2.0:1746143123.857751:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858497280:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.857770:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.857789:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132009c00/0x25aee876ca70c4bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f914 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.857815:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143123.857826:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132009c00/0x25aee876ca70c4bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f914 expref: 17 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.857844:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132009c00/0x25aee876ca70c4bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f914 expref: 17 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143123.857871:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132009c00, rc 0) 00000100:00100000:2.0:1746143123.857917:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858497280:12345-192.168.201.28@tcp:101:cat.0 Request processed in 166us (321us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143123.857923:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11998 00000100:00100000:1.0:1746143123.858060:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858497152 00000100:00100000:1.0:1746143123.858065:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858497152 00002000:00100000:1.0:1746143123.858092:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880092a7a300 x1830962858497152/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143123.858101:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a7a300 with x1830962858497152 ext(1048576->2097151) 00010000:00010000:1.0:1746143123.858108:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143123.858119:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:1.0:1746143123.858125:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a7a300 00000100:00100000:1.0:1746143123.858316:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1924 00000100:00100000:1.0:1746143123.858321:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858497152:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143123.868512:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.868585:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.875101:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858497408 00000100:00100000:0.0:1746143123.875117:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858497408 00000100:00100000:0.0:1746143123.875175:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 11999 00000100:00100000:0.0:1746143123.875184:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858497408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143123.875203:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143123.875223:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7400/0x25aee876ca70c4c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f91b expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.875249:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143123.875261:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7400/0x25aee876ca70c4c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f91b expref: 17 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.875272:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7400/0x25aee876ca70c4c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f91b expref: 17 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143123.875298:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c7400, rc 0) 00000100:00100000:0.0:1746143123.875355:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858497408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 172us (6854us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143123.875362:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 11999 00000100:00100000:0.0:1746143123.875576:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858497664 00000100:00100000:0.0:1746143123.875580:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858497664 00000100:00100000:0.0:1746143123.875604:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8086 00000100:00100000:0.0:1746143123.875609:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:30755:x1830962858497664:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143123.875624:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143123.875635:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6600/0x25aee876ca70c4c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f922 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.875745:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875757:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875767:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875779:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875784:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875789:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875887:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875894:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875900:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:0.0:1746143123.875909:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143123.875987:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875993:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.875999:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876005:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a0c7e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143123.876009:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876015:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876025:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143123.876028:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143123.876066:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876071:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7e00/0x25aee876ca70c4d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876079:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876084:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876093:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876097:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a0c6200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143123.876099:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876103:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876108:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f413900) 00010000:00010000:0.0:1746143123.876110:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143123.876111:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876115:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6200/0x25aee876ca70c4d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143123.876143:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6600/0x25aee876ca70c4c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 214 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.876152:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 213 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143123.876157:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143123.876159:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143123.876161:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c6c00, rc 0) 00000100:00100000:0.0:1746143123.876182:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:30755:x1830962858497664:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 574us (7597us total) trans 8589942297 rc 0/0 00000100:00100000:0.0:1746143123.876187:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8086 00000100:00100000:0.0:1746143123.877584:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858497152:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19256us (20065us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143123.877595:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1924 00002000:00100000:0.0:1746143123.877610:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880092a7a300 x1830962858497152/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143123.877619:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a7a300 with x1830962858497152 ext(1048576->2097151) 00010000:00010000:0.0:1746143123.877629:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143123.877643:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746143123.877649:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a7a300 00000100:00100000:0.0:1746143123.900574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.900680:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858497792 00000100:00100000:2.0:1746143123.900690:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858497792 00000100:00100000:2.0:1746143123.900734:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12000 00000100:00100000:2.0:1746143123.900742:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:30744:x1830962858497792:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.900760:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.900779:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f929 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.900808:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 12 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.900815:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.900817:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143123.900820:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.900847:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 12 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.900862:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 12 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.900874:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861191296:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143123.900964:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143123.902827:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.903249:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858497920 00000100:00100000:3.0:1746143123.903257:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858497920 00010000:00010000:3.0:1746143123.903290:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143123.903328:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6338 00000100:00100000:3.0:1746143123.903335:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858497920:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143123.903349:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143123.903566:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.903577:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.903599:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132009200/0x25aee876ca70c4a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ff expref: 25 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.903625:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.903627:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143123.903633:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.903641:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143123.903671:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143123.903682:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861191424:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143123.903742:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.903912:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861191296:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143123.903933:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.903944:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132009e00, rc 0) 00000100:00100000:2.0:1746143123.903967:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30744:x1830962858497792:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3225us (3403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.903974:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12000 00000100:00100000:0.0:1746143123.904749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.905072:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858498048 00000100:00100000:2.0:1746143123.905078:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858498048 00002000:00100000:2.0:1746143123.905110:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->1163263) req@ffff88008fe7b800 x1830962858498048/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143123.905119:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b800 with x1830962858498048 ext(1048576->1163263) 00010000:00010000:2.0:1746143123.905126:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 13 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.905137:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 13 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143123.905149:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe7b800 00000100:00100000:2.0:1746143123.905175:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1925 00000100:00100000:2.0:1746143123.905181:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858498048:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143123.907136:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861191424:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143123.907156:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143123.907204:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858497920:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3868us (4381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.907214:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6338 00000100:00100000:3.0:1746143123.908195:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858498048:12345-192.168.201.28@tcp:4:cat.0 Request processed in 3012us (3446us total) trans 21474839956 rc 0/0 00000100:00100000:3.0:1746143123.908203:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1925 00002000:00100000:3.0:1746143123.908211:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->1163263) req@ffff88008fe7b800 x1830962858498048/t21474839956(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/448 e 0 to 0 dl 1746143134 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.908220:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b800 with x1830962858498048 ext(1048576->1163263) 00010000:00010000:3.0:1746143123.908229:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 15 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143123.908242:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 15 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143123.908254:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe7b800 00000100:00100000:0.0:1746143123.910500:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.910576:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858498176 00000100:00100000:2.0:1746143123.910584:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858498176 00010000:00010000:2.0:1746143123.910613:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 15 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143123.910646:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6339 00000100:00100000:2.0:1746143123.910651:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858498176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143123.910663:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143123.910681:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 15 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.910690:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 15 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.910711:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f369400/0x25aee876ca70c2ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7f5 expref: 15 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143123.910741:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143123.910743:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143123.910750:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.910757:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.910785:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143123.910795:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861191552:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143123.910858:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143123.914158:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861191552:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143123.914177:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143123.914209:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858498176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3557us (3716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.914220:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6339 00000100:00100000:0.0:1746143123.915230:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.915297:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858498560 00000100:00100000:3.0:1746143123.915303:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858498560 00002000:00100000:3.0:1746143123.915339:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008fe78000 x1830962858498560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.915348:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78000 with x1830962858498560 ext(1048576->2097151) 00002000:00010000:3.0:1746143123.915353:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe78000 00000100:00100000:3.0:1746143123.915366:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5818 00000100:00100000:3.0:1746143123.915375:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858498560:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143123.917616:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143123.917955:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858498688 00000100:00100000:1.0:1746143123.917963:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858498688 00002000:00100000:1.0:1746143123.917999:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1273856->1277951) req@ffff88008fe7a680 x1830962858498688/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143123.918009:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7a680 with x1830962858498688 ext(1273856->1277951) 00002000:00010000:1.0:1746143123.918015:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7a680 00000100:00100000:1.0:1746143123.918045:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5819 00000100:00100000:1.0:1746143123.918064:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858498688:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143123.918207:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858498688:12345-192.168.201.28@tcp:3:cat.0 Request processed in 142us (603us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143123.918213:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5819 00002000:00100000:1.0:1746143123.918218:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1273856->1277951) req@ffff88008fe7a680 x1830962858498688/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:274/0 lens 488/4536 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143123.918225:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7a680 with x1830962858498688 ext(1273856->1277951) 00002000:00010000:1.0:1746143123.918228:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7a680 00000100:00100000:0.0:1746143123.927009:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.927969:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858498944 00000100:00100000:3.0:1746143123.927980:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858498944 00000100:00100000:3.0:1746143123.928508:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3405 00000100:00100000:3.0:1746143123.928522:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30751:x1830962858498944:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143123.936551:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30751:x1830962858498944:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 8021us (9542us total) trans 8589942298 rc 0/0 00000100:00100000:3.0:1746143123.936564:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3405 00000100:00100000:3.0:1746143123.964102:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858498560:12345-192.168.201.28@tcp:3:cat.0 Request processed in 48717us (48860us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143123.964114:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5818 00002000:00100000:3.0:1746143123.964127:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008fe78000 x1830962858498560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.964138:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78000 with x1830962858498560 ext(1048576->2097151) 00002000:00010000:3.0:1746143123.964144:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe78000 00000100:00100000:0.0:1746143123.972686:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143123.972786:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858499072 00000100:00100000:2.0:1746143123.972797:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858499072 00000100:00100000:2.0:1746143123.972843:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12001 00000100:00100000:2.0:1746143123.972852:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30744:x1830962858499072:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143123.972871:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143123.972888:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f930 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.972923:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143123.972925:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143123.972932:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 25 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.972948:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 25 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143123.972959:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132009800, rc 0) 00000100:00100000:2.0:1746143123.973019:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30744:x1830962858499072:12345-192.168.201.28@tcp:101:cat.0 Request processed in 168us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143123.973026:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12001 00000100:00100000:0.0:1746143123.980127:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143123.980187:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143123.980267:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858499328 00000100:00100000:3.0:1746143123.980277:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858499328 00000100:00100000:1.0:1746143123.980299:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858499456 00000100:00100000:1.0:1746143123.980304:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858499456 00002000:00100000:3.0:1746143123.980323:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008fe7a300 x1830962858499328/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143123.980326:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008fe7ad80 x1830962858499456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/0 e 0 to 0 dl 1746143134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143123.980334:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7a300 with x1830962858499328 ext(2097152->3145727) 00002000:00100000:1.0:1746143123.980334:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7ad80 with x1830962858499456 ext(3145728->4194303) 00002000:00010000:3.0:1746143123.980340:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7a300 00002000:00010000:1.0:1746143123.980340:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7ad80 00000100:00100000:3.0:1746143123.980359:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5820 00000100:00100000:3.0:1746143123.980366:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858499328:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143123.981088:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5821 00000100:00100000:1.0:1746143123.981095:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858499456:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143124.015610:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858499328:12345-192.168.201.28@tcp:3:cat.0 Request processed in 35229us (35478us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143124.015625:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5820 00002000:00100000:3.0:1746143124.015639:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008fe7a300 x1830962858499328/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.015648:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7a300 with x1830962858499328 ext(2097152->3145727) 00002000:00010000:3.0:1746143124.015655:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7a300 00000100:00100000:0.0:1746143124.047313:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.047412:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858499712 00000100:00100000:3.0:1746143124.047422:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858499712 00000100:00100000:3.0:1746143124.047480:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8087 00000100:00100000:3.0:1746143124.047488:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30758:x1830962858499712:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.047519:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.047538:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408200/0x25aee876ca70c4fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f937 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.047601:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047618:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047628:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047643:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047649:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047656:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047770:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70c50f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047781:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70c50f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047787:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70c50f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143124.047820:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143124.047825:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143124.047855:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70c50f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047864:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70c50f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047871:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047880:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047886:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047891:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d409400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143124.047895:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047901:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047911:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143124.047914:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143124.047919:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047923:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047950:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047955:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047960:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047963:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d409e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143124.047965:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047974:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047980:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531300) 00010000:00010000:3.0:1746143124.047981:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143124.047983:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.047987:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70c508 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.048012:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408200/0x25aee876ca70c4fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f937 expref: 13 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.048022:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70c50f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f937 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.048059:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.048061:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143124.048064:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d408600, rc 0) 00000100:00100000:3.0:1746143124.048132:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30758:x1830962858499712:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 644us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.048139:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8087 00000100:00100000:1.0:1746143124.057292:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858499456:12345-192.168.201.28@tcp:3:cat.0 Request processed in 76183us (77091us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143124.057305:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5821 00002000:00100000:1.0:1746143124.057318:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008fe7ad80 x1830962858499456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:274/0 lens 488/440 e 0 to 0 dl 1746143134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.057328:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7ad80 with x1830962858499456 ext(3145728->4194303) 00002000:00010000:1.0:1746143124.057335:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7ad80 00000100:00100000:0.0:1746143124.057453:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.057488:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.057515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.057576:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858499968 00000100:00100000:2.0:1746143124.057585:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858499968 00000100:00100000:0.0:1746143124.057593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.057621:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858500224 00000100:00100000:0.0:1746143124.057624:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858500224 00000100:00100000:2.0:1746143124.057632:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858499840 00000100:00100000:2.0:1746143124.057634:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858499840 00000100:00100000:0.0:1746143124.057640:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858500096 00000100:00100000:0.0:1746143124.057642:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858500096 00000100:00100000:2.0:1746143124.057650:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12002 00000100:00100000:2.0:1746143124.057655:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858499968:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:0.0:1746143124.057659:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12003 00000100:00100000:0.0:1746143124.057663:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858500224:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143124.057670:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143124.057670:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.057686:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe82c00/0x25aee876ca70c516 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f945 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.057686:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f953 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.057706:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.057708:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.057717:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143124.057731:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143124.057734:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861191680:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143124.057741:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c28c00, rc 0) 00000100:00100000:0.0:1746143124.057965:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858500224:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 300us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.057969:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12003 00000100:00100000:0.0:1746143124.057982:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12004 00000100:00100000:0.0:1746143124.057987:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858499840:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:2.0:1746143124.057992:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00010000:00010000:0.0:1746143124.057992:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143124.057998:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c28e00/0x25aee876ca70c524 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f93e expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.058012:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12005 00000100:00100000:2.0:1746143124.058017:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858500096:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:0.0:1746143124.058024:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861191808:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.058025:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.058049:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f94c expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.058062:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.058063:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.058068:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143124.058069:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143124.058080:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.058088:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe83c00, rc 0) 00000100:00100000:2.0:1746143124.058103:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858500096:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 86us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.058109:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12005 00000100:00080000:1.0:1746143124.058228:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143124.058232:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143124.072356:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.072432:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858500352 00000100:00100000:2.0:1746143124.072442:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858500352 00000100:00100000:2.0:1746143124.072508:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 608 00000100:00100000:2.0:1746143124.072517:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858500352:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.072531:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.072558:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70c50f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f937 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.072579:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.072584:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.072626:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858500352:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 110us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.072634:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 608 00000100:00100000:3.0:1746143124.072975:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861191680:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.073002:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe82c00/0x25aee876ca70c516 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f945 expref: 9 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.073014:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe82c00/0x25aee876ca70c516 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f945 expref: 9 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.073054:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82c00, rc 0) 00000100:00100000:3.0:1746143124.073079:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858499968:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 15423us (15627us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.073086:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12002 00000100:00100000:2.0:1746143124.073415:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861191808:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.073432:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c28e00/0x25aee876ca70c524 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f93e expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.073440:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c28e00/0x25aee876ca70c524 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f93e expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.073447:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c28e00, rc 0) 00000100:00100000:2.0:1746143124.073466:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858499840:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 15479us (15950us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.073472:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12004 00000100:00100000:0.0:1746143124.079114:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.079168:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.079242:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858500480 00000100:00100000:2.0:1746143124.079251:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858500480 00000100:00100000:2.0:1746143124.079302:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858500608 00000100:00100000:2.0:1746143124.079304:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858500608 00000100:00100000:2.0:1746143124.079321:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12006 00000100:00100000:2.0:1746143124.079329:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858500480:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143124.079347:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12007 00010000:00010000:2.0:1746143124.079347:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143124.079356:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858500608:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143124.079362:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.079365:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe83000/0x25aee876ca70c532 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f95a expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.079367:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d408200/0x25aee876ca70c539 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f961 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143124.079426:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861192064:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.079426:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861191936:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143124.079610:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.079610:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc840 going to sleep for 11 seconds 00000100:00080000:1.0:1746143124.079713:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143124.082016:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.083440:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858500864 00000100:00100000:2.0:1746143124.083449:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858500864 00000100:00100000:2.0:1746143124.083507:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8088 00000100:00100000:2.0:1746143124.083516:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30758:x1830962858500864:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143124.083533:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.083550:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83200/0x25aee876ca70c540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f968 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.083649:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.083664:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.083672:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 212 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.083678:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.083709:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 212 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.083721:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 212 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143124.083732:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861192192:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143124.086109:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.086122:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 12 pid: 17079 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143124.086134:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861192320:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143124.086227:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.089931:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861192192:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143124.089942:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861192320:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143124.089966:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:3.0:1746143124.090101:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861192064:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.090127:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d408200/0x25aee876ca70c539 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f961 expref: 28 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.090140:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d408200/0x25aee876ca70c539 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f961 expref: 28 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.090158:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d408200, rc 0) 00000100:00100000:3.0:1746143124.090211:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858500608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10854us (11040us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.090220:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12007 00000100:00100000:2.0:1746143124.090308:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861191936:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.090323:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe83000/0x25aee876ca70c532 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f95a expref: 26 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.090332:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe83000/0x25aee876ca70c532 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f95a expref: 26 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.090545:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe83000, rc 0) 00000100:00100000:2.0:1746143124.090566:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858500480:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11237us (11463us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.090572:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12006 00000100:00100000:0.0:1746143124.092546:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.092573:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.092684:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858500992 00000100:00100000:2.0:1746143124.092690:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858500992 00010000:00010000:2.0:1746143124.092731:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 213 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143124.092749:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858501120 00000100:00100000:2.0:1746143124.092751:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858501120 00010000:00010000:2.0:1746143124.092761:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 13 pid: 17079 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143124.092806:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6340 00000100:00100000:2.0:1746143124.092813:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:1968:x1830962858500992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.092830:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.092835:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 213 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.092845:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 213 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.093059:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c6c00/0x25aee876ca70c4de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f922 expref: 213 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.093073:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.093078:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.093086:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.093092:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.093115:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:1968:x1830962858500992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 302us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.093121:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6340 00000100:00100000:2.0:1746143124.093131:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6341 00000100:00100000:2.0:1746143124.093136:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858501120:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.093142:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.093145:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 13 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.093154:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 13 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.093166:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cdb200/0x25aee876ca70c475 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8d5 expref: 13 pid: 17079 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.093174:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.093177:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.093185:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.093191:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.093206:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.093217:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858501120:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 81us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.093221:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6341 00010000:00010000:2.0:1746143124.093236:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.093242:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:2.0:1746143124.093259:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143124.093606:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83200/0x25aee876ca70c540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.093618:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.093630:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.093633:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143124.093635:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82c00, rc 0) 00000100:00100000:2.0:1746143124.093656:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30758:x1830962858500864:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 10142us (11645us total) trans 8589942299 rc 0/0 00000100:00100000:2.0:1746143124.093662:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8088 00000100:00080000:0.0:1746143124.093892:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143124.100254:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.104219:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858501248 00000100:00100000:2.0:1746143124.104233:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858501248 00000100:00100000:3.0:1746143124.104347:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12008 00000100:00100000:3.0:1746143124.104356:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30755:x1830962858501248:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143124.104384:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.104404:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f96f expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.104433:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.104441:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143124.104443:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143124.104447:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1134592->1990655] (req 1134592->1990655) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 26 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.104478:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.104488:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 15 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143124.104500:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861192448:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143124.104586:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.106546:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.106587:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.106659:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858501504 00000100:00100000:3.0:1746143124.106665:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858501504 00000100:00100000:3.0:1746143124.106694:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858501376 00000100:00100000:3.0:1746143124.106696:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858501376 00000100:00100000:3.0:1746143124.106710:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12009 00000100:00100000:3.0:1746143124.106716:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858501504:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143124.106735:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.106924:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe83000/0x25aee876ca70c55c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f97d expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143124.106971:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861192576:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143124.107065:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.107120:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12010 00000100:00100000:2.0:1746143124.107128:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858501376:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.107135:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.107144:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fcfc00/0x25aee876ca70c563 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f976 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.107166:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861192704:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.107193:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.108737:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.108768:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.108966:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861192576:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.108989:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe83000/0x25aee876ca70c55c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f97d expref: 30 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.109001:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe83000/0x25aee876ca70c55c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f97d expref: 30 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.109014:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe83000, rc 0) 00000100:00100000:3.0:1746143124.109062:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858501504:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2345us (2523us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.109068:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12009 00000100:00100000:3.0:1746143124.109095:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861192448:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.109107:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1134592->1990655] (req 1134592->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 28 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.109116:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409400, rc 0) 00000100:00100000:3.0:1746143124.109128:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:30755:x1830962858501248:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4774us (8887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.109133:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12008 00000100:00100000:2.0:1746143124.109194:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861192704:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.109208:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fcfc00/0x25aee876ca70c563 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f976 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.109215:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fcfc00/0x25aee876ca70c563 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f976 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.109233:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fcfc00, rc 0) 00000100:00100000:2.0:1746143124.109251:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858501376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2124us (2663us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.109257:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12010 00000100:00100000:2.0:1746143124.109276:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858501760 00000100:00100000:2.0:1746143124.109280:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858501760 00000100:00100000:2.0:1746143124.109310:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8089 00000100:00100000:2.0:1746143124.109315:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30758:x1830962858501760:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:1.0:1746143124.109357:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858501632 00000100:00100000:1.0:1746143124.109360:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858501632 00002000:00100000:1.0:1746143124.109396:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1277951) req@ffff88008fe78a80 x1830962858501632/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.109405:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78a80 with x1830962858501632 ext(1048576->1277951) 00010000:00010000:1.0:1746143124.109411:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 16 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143124.109422:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 16 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:1.0:1746143124.109428:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fe78a80 00000100:00100000:1.0:1746143124.109441:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1926 00000100:00100000:1.0:1746143124.109445:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858501632:12345-192.168.201.28@tcp:4:cat.0 00010000:00010000:2.0:1746143124.109727:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.109741:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c56a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f984 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.109812:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.109826:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.109831:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.109852:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.109861:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 13 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143124.109869:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861192832:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143124.109905:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143124.114227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.114338:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861192832:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.114361:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:2.0:1746143124.114466:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858501888 00000100:00100000:2.0:1746143124.114473:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858501888 00010000:00010000:2.0:1746143124.114505:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 14 pid: 1037 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143124.114527:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6342 00000100:00100000:2.0:1746143124.114534:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1970:x1830962858501888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.114546:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.114551:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 14 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.114561:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 14 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.114592:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70c547 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f968 expref: 14 pid: 1037 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.114610:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.114614:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.114628:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.114636:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.116162:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.116205:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858501888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1668us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.116214:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6342 00010000:00010000:3.0:1746143124.116289:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.116296:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143124.116334:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143124.116338:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143124.116352:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.116587:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c56a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143124.119346:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.119587:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858502016 00000100:00100000:2.0:1746143124.119595:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858502016 00000100:00100000:2.0:1746143124.119657:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12011 00000100:00100000:2.0:1746143124.119664:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858502016:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.119681:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.119699:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009358c000/0x25aee876ca70c578 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f98b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.119746:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861192960:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.119801:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.119910:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143124.120055:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.120081:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.120085:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143124.120088:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fcea00, rc 0) 00000100:00100000:3.0:1746143124.120129:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30758:x1830962858501760:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 10814us (11398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.120156:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8089 00000100:00100000:2.0:1746143124.121081:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858502144 00000100:00100000:2.0:1746143124.121086:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858502144 00000100:00100000:2.0:1746143124.121137:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12012 00000100:00100000:2.0:1746143124.121143:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858502144:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.121151:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.121176:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66c800/0x25aee876ca70c57f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f992 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.121203:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861193088:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.121251:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143124.123022:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861192960:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.123060:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009358c000/0x25aee876ca70c578 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f98b expref: 29 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.123077:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009358c000/0x25aee876ca70c578 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f98b expref: 29 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.123086:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009358c000, rc 0) 00000100:00100000:3.0:1746143124.123110:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858502016:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3447us (3774us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.123116:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12011 00000100:00100000:1.0:1746143124.123359:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858501632:12345-192.168.201.28@tcp:4:cat.0 Request processed in 13911us (14588us total) trans 17179872702 rc 0/0 00000100:00100000:1.0:1746143124.123367:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1926 00002000:00100000:1.0:1746143124.123388:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1277951) req@ffff88008fe78a80 x1830962858501632/t17179872702(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/448 e 0 to 0 dl 1746143135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.123397:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78a80 with x1830962858501632 ext(1048576->1277951) 00010000:00010000:1.0:1746143124.123405:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 18 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143124.123423:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 18 pid: 26949 timeout: 1005 lvb_type: 0 00002000:00010000:1.0:1746143124.123430:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fe78a80 00000100:00100000:0.0:1746143124.126586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.127724:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858502272 00000100:00100000:3.0:1746143124.127734:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858502272 00000100:00100000:3.0:1746143124.127786:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12013 00000100:00100000:3.0:1746143124.127793:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858502272:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.127811:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.127827:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe82400/0x25aee876ca70c586 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f999 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143124.127888:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861193216:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143124.127974:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.128224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.128245:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858502400 00000100:00100000:2.0:1746143124.128249:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858502400 00010000:00010000:2.0:1746143124.128270:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 18 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143124.128289:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6343 00000100:00100000:2.0:1746143124.128295:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858502400:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.128305:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.128328:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 18 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.128339:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 18 pid: 26949 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143124.128360:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.128580:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.128588:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 27 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.128597:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 27 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.129154:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132008400/0x25aee876ca70c4ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f906 expref: 18 pid: 26949 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143124.129167:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861193088:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.129188:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66c800/0x25aee876ca70c57f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f992 expref: 27 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.129203:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66c800/0x25aee876ca70c57f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f992 expref: 27 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.129211:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66c800, rc 0) 00010000:00010000:2.0:1746143124.130053:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 26 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.130065:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861193344:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143124.130303:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858502144:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9158us (10392us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.130310:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12012 00000100:00100000:2.0:1746143124.130823:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.131355:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.132227:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861193216:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.132250:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe82400/0x25aee876ca70c586 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f999 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.132262:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe82400/0x25aee876ca70c586 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f999 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.132277:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82400, rc 0) 00000100:00100000:2.0:1746143124.132305:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858502272:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4512us (5728us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.132312:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12013 00000100:00100000:2.0:1746143124.132329:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858502528 00000100:00100000:2.0:1746143124.132333:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858502528 00000100:00100000:2.0:1746143124.132357:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12014 00000100:00100000:2.0:1746143124.132363:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858502528:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143124.132386:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.132397:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66d000/0x25aee876ca70c58d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9a0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.132432:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861193472:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.133608:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.134117:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861193344:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143124.134128:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.134152:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858502400:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5855us (5927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.134161:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6343 00000100:00100000:0.0:1746143124.134897:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.134993:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858502784 00000100:00100000:1.0:1746143124.134998:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858502784 00002000:00100000:1.0:1746143124.135026:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1134592->1138687) req@ffff88009b59a300 x1830962858502784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.135057:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59a300 with x1830962858502784 ext(1134592->1138687) 00002000:00010000:1.0:1746143124.135062:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59a300 00000100:00100000:1.0:1746143124.135078:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5822 00000100:00100000:1.0:1746143124.135083:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858502784:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143124.135214:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858502784:12345-192.168.201.28@tcp:3:cat.0 Request processed in 131us (320us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143124.135219:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5822 00002000:00100000:1.0:1746143124.135222:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1134592->1138687) req@ffff88009b59a300 x1830962858502784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/4536 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.135227:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59a300 with x1830962858502784 ext(1134592->1138687) 00002000:00010000:1.0:1746143124.135229:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59a300 00002000:00010000:2.0:1746143124.135286:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143122 -> 1746143123 00002000:00010000:2.0:1746143124.135288:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143122 -> 1746143123 00002000:00010000:2.0:1746143124.135290:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143122 -> 1746143123 00000100:00100000:2.0:1746143124.135297:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861193472:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.135311:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66d000/0x25aee876ca70c58d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9a0 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.135320:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66d000/0x25aee876ca70c58d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9a0 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.135326:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66d000, rc 0) 00000100:00100000:2.0:1746143124.135351:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858502528:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 2989us (3998us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.135355:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12014 00000100:00100000:0.0:1746143124.136711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.136877:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858503040 00000100:00100000:3.0:1746143124.136883:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858503040 00000100:00100000:3.0:1746143124.136917:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8090 00000100:00100000:3.0:1746143124.136924:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30758:x1830962858503040:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.136939:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.136954:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70c594 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9a7 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.137082:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137096:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137108:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137120:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137126:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137133:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137584:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe82a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143124.137588:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137595:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137607:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.137610:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143124.137614:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137619:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82a00/0x25aee876ca70c59b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.137949:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70c594 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9a7 expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.137957:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70c594 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9a7 expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.137966:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82200, rc 0) 00000100:00100000:3.0:1746143124.138237:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30758:x1830962858503040:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1311us (1529us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.138244:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8090 00000100:00100000:0.0:1746143124.143660:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.143719:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.144353:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858503296 00000100:00100000:3.0:1746143124.144362:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858503296 00000100:00100000:3.0:1746143124.144416:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3406 00000100:00100000:3.0:1746143124.144429:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30758:x1830962858503296:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:1.0:1746143124.144458:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858503552 00000100:00100000:1.0:1746143124.144462:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858503552 00002000:00100000:1.0:1746143124.144490:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1986560->1990655) req@ffff88009b59b480 x1830962858503552/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.144504:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b480 with x1830962858503552 ext(1986560->1990655) 00002000:00010000:1.0:1746143124.144510:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59b480 00000100:00100000:1.0:1746143124.144533:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5823 00000100:00100000:1.0:1746143124.144537:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858503552:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143124.144865:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858503552:12345-192.168.201.28@tcp:3:cat.0 Request processed in 143us (962us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143124.144872:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5823 00002000:00100000:1.0:1746143124.144878:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1986560->1990655) req@ffff88009b59b480 x1830962858503552/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/4536 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.144885:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b480 with x1830962858503552 ext(1986560->1990655) 00002000:00010000:1.0:1746143124.144888:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59b480 00000100:00100000:3.0:1746143124.145677:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30758:x1830962858503296:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 1247us (2027us total) trans 8589942300 rc 0/0 00000100:00100000:3.0:1746143124.145685:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3406 00000100:00100000:1.0:1746143124.145812:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.145885:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.145946:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858503680 00000100:00100000:3.0:1746143124.145950:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858503680 00000100:00100000:3.0:1746143124.145978:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858503808 00000100:00100000:3.0:1746143124.145981:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858503808 00000100:00100000:2.0:1746143124.145985:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12015 00000100:00100000:2.0:1746143124.145992:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858503680:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143124.145995:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12016 00000100:00100000:3.0:1746143124.145999:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858503808:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143124.146005:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.146005:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.146021:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9b5 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.146021:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9ae expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.146053:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.146055:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.146064:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 15 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.146077:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 15 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143124.146079:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861193600:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.146087:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82600, rc 0) 00000100:00100000:3.0:1746143124.146107:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858503808:12345-192.168.201.28@tcp:101:cat.0 Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.146113:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12016 00000100:00100000:2.0:1746143124.146131:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143124.157806:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.158288:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861193600:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.158324:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9ae expref: 18 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.158339:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9ae expref: 18 pid: 26949 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143124.159854:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858504064 00000100:00100000:3.0:1746143124.159864:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858504064 00000100:00100000:3.0:1746143124.160229:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3407 00010000:00010000:2.0:1746143124.160232:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66de00, rc 0) 00000100:00100000:3.0:1746143124.160239:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:30755:x1830962858504064:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143124.160294:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858503680:12345-192.168.201.28@tcp:101:cat.0 Request processed in 14301us (14481us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.160304:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12015 00000100:00100000:3.0:1746143124.161282:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:30755:x1830962858504064:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 1041us (3485us total) trans 8589942301 rc 0/0 00000100:00100000:3.0:1746143124.161289:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3407 00000100:00100000:0.0:1746143124.170270:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.170338:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858504320 00000100:00100000:1.0:1746143124.170349:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858504320 00002000:00100000:1.0:1746143124.170591:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1765375) req@ffff88009b59ad80 x1830962858504320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.170602:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59ad80 with x1830962858504320 ext(1048576->1765375) 00002000:00010000:1.0:1746143124.170608:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59ad80 00000100:00100000:1.0:1746143124.171246:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5824 00000100:00100000:1.0:1746143124.171255:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858504320:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143124.190582:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858504320:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19315us (20309us total) trans 0 rc 716800/716800 00000100:00100000:2.0:1746143124.190597:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5824 00002000:00100000:2.0:1746143124.190610:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1765375) req@ffff88009b59ad80 x1830962858504320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 716800/716800 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.190621:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59ad80 with x1830962858504320 ext(1048576->1765375) 00002000:00010000:2.0:1746143124.190627:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59ad80 00000100:00100000:0.0:1746143124.200333:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.200452:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858504448 00000100:00100000:2.0:1746143124.200463:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858504448 00000100:00100000:1.0:1746143124.202646:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12017 00000100:00100000:1.0:1746143124.202662:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30761:x1830962858504448:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143124.202683:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143124.202705:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9bc expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.202738:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 25 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.202746:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143124.202748:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143124.202751:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.202781:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 25 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.202793:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 25 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143124.202804:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861193728:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143124.202915:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.210914:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.211070:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861193728:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143124.211101:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.211120:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd1000, rc 0) 00000100:00100000:1.0:1746143124.211166:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30761:x1830962858504448:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8510us (10844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.211175:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12017 00000100:00100000:2.0:1746143124.211354:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858504576 00000100:00100000:2.0:1746143124.211362:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858504576 00002000:00100000:2.0:1746143124.211642:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1134592->1990655) req@ffff88009b599500 x1830962858504576/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.211651:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599500 with x1830962858504576 ext(1134592->1990655) 00010000:00010000:2.0:1746143124.211659:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 26 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.211672:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 26 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143124.211678:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b599500 00000100:00100000:2.0:1746143124.211713:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1927 00000100:00100000:2.0:1746143124.211720:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858504576:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143124.212620:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.214059:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858504832 00000100:00100000:3.0:1746143124.214066:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858504832 00000100:00100000:3.0:1746143124.214114:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8091 00000100:00100000:3.0:1746143124.214119:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30766:x1830962858504832:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143124.214137:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.214153:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70c5b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9c3 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.214238:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.214251:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.214258:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.214284:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 12 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.214294:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 12 pid: 1037 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.214310:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861193856:192.168.201.28@tcp:104: 00000100:00080000:2.0:1746143124.214959:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143124.216228:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.218696:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.218726:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858504960 00000100:00100000:2.0:1746143124.218734:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858504960 00010000:00010000:2.0:1746143124.218771:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 13 pid: 1037 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.219162:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861193856:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.219185:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143124.219251:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6344 00000100:00100000:2.0:1746143124.219260:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858504960:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.219273:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.219279:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 13 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.219288:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 13 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.219315:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcea00/0x25aee876ca70c571 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f984 expref: 13 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.219333:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.219337:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.219346:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.219353:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.219368:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143124.219493:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.219500:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143124.219520:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:2.0:1746143124.219625:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858504960:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 364us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.219634:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6344 00010000:00010000:3.0:1746143124.219675:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70c5b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 28 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.219691:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 27 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.219697:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.219700:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143124.219702:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fcf800, rc 0) 00000100:00100000:3.0:1746143124.219723:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:30766:x1830962858504832:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5603us (7104us total) trans 8589942302 rc 0/0 00000100:00100000:3.0:1746143124.219730:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8091 00000100:00100000:3.0:1746143124.241468:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858504576:12345-192.168.201.28@tcp:4:cat.0 Request processed in 29734us (30551us total) trans 17179872703 rc 0/0 00000100:00100000:3.0:1746143124.241487:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1927 00002000:00100000:3.0:1746143124.241504:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1134592->1990655) req@ffff88009b599500 x1830962858504576/t17179872703(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/448 e 0 to 0 dl 1746143135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.241514:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599500 with x1830962858504576 ext(1134592->1990655) 00010000:00010000:3.0:1746143124.241526:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 28 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.241542:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 28 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143124.241549:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b599500 00000100:00100000:0.0:1746143124.247211:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.248569:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858505088 00000100:00100000:2.0:1746143124.248580:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858505088 00010000:00010000:2.0:1746143124.248619:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 28 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.249462:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6345 00000100:00100000:2.0:1746143124.249472:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858505088:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.249487:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.249513:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 28 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.249525:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 28 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.249549:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d409400/0x25aee876ca70c555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1990655) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f96f expref: 28 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.249579:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.249582:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.249589:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.249597:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.249630:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.249644:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861193984:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143124.249732:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.253897:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861193984:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143124.253921:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.254060:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858505088:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4557us (6827us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.254072:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6345 00000100:00100000:0.0:1746143124.259685:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.260071:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858505344 00000100:00100000:3.0:1746143124.260081:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858505344 00002000:00100000:3.0:1746143124.260130:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009b598380 x1830962858505344/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.260140:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598380 with x1830962858505344 ext(1048576->2097151) 00002000:00010000:3.0:1746143124.260147:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598380 00000100:00100000:3.0:1746143124.260175:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5825 00000100:00100000:3.0:1746143124.260183:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858505344:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143124.264541:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.265990:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858505600 00000100:00100000:2.0:1746143124.266000:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858505600 00002000:00100000:2.0:1746143124.266063:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880092a72300 x1830962858505600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.266074:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72300 with x1830962858505600 ext(1048576->2097151) 00002000:00010000:2.0:1746143124.266080:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a72300 00000100:00100000:2.0:1746143124.266103:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5826 00000100:00100000:2.0:1746143124.266112:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858505600:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143124.281113:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858505344:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20920us (21431us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143124.281126:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5825 00002000:00100000:3.0:1746143124.281140:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009b598380 x1830962858505344/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.281155:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598380 with x1830962858505344 ext(1048576->2097151) 00002000:00010000:3.0:1746143124.281161:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598380 00000100:00100000:0.0:1746143124.281636:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.281676:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.281740:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858505728 00000100:00100000:2.0:1746143124.281748:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858505728 00000100:00100000:2.0:1746143124.281780:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858505856 00000100:00100000:2.0:1746143124.281782:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858505856 00000100:00100000:2.0:1746143124.282370:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12018 00000100:00100000:2.0:1746143124.282389:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858505728:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.282405:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.282423:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66d400/0x25aee876ca70c5cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9ca expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.282476:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861194112:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.282538:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143124.282684:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12019 00000100:00100000:3.0:1746143124.282691:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858505856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143124.282697:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.282704:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9d1 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.282715:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.282716:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.282724:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.282739:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.282748:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50ce400, rc 0) 00000100:00100000:3.0:1746143124.282943:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858505856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 253us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.282948:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12019 00002000:00010000:2.0:1746143124.294967:0:26949:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143122 -> 1746143123 00002000:00010000:2.0:1746143124.294979:0:26949:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143122 -> 1746143123 00002000:00010000:2.0:1746143124.294981:0:26949:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143122 -> 1746143123 00000100:00100000:2.0:1746143124.295010:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861194112:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.295082:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66d400/0x25aee876ca70c5cc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9ca expref: 29 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.295099:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66d400/0x25aee876ca70c5cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9ca expref: 29 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.295122:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66d400, rc 0) 00000100:00100000:2.0:1746143124.295173:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858505728:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12785us (13536us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.295181:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12018 00000100:00100000:3.0:1746143124.295785:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858505600:12345-192.168.201.28@tcp:3:cat.0 Request processed in 29674us (31253us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143124.295794:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5826 00002000:00100000:3.0:1746143124.295804:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880092a72300 x1830962858505600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.295819:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72300 with x1830962858505600 ext(1048576->2097151) 00002000:00010000:3.0:1746143124.295824:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a72300 00000100:00100000:0.0:1746143124.305352:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.305681:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858505984 00000100:00100000:2.0:1746143124.305690:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858505984 00000100:00100000:2.0:1746143124.305735:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12020 00000100:00100000:2.0:1746143124.305744:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:30769:x1830962858505984:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.305764:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.305783:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9d8 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.305819:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.305826:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143124.305828:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143124.305832:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 29 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.305863:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.305875:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 17 pid: 4758 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.305887:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861194240:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143124.306856:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.308226:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.311456:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858506240 00000100:00100000:3.0:1746143124.311468:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858506240 00000100:00100000:3.0:1746143124.311533:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8092 00000100:00100000:3.0:1746143124.311540:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:30771:x1830962858506240:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143124.311563:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.311581:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50cea00/0x25aee876ca70c5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9df expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.311683:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.311698:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.311710:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143124.311720:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143124.311845:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50cea00/0x25aee876ca70c5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 216 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.311868:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 215 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.311877:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.311879:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143124.311883:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409400, rc 0) 00000100:00100000:3.0:1746143124.311955:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:30771:x1830962858506240:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 413us (3732us total) trans 8589942303 rc 0/0 00000100:00100000:3.0:1746143124.311961:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8092 00000100:00100000:2.0:1746143124.312506:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861194240:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143124.312530:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 29 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.312543:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66de00, rc 0) 00000100:00100000:2.0:1746143124.312565:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30769:x1830962858505984:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6822us (7226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.312571:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12020 00000100:00100000:0.0:1746143124.327135:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.327215:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.327345:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858506368 00000100:00100000:3.0:1746143124.327357:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858506368 00002000:00100000:3.0:1746143124.327642:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1765376->2097151) req@ffff880093b5b100 x1830962858506368/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.327653:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5b100 with x1830962858506368 ext(1765376->2097151) 00010000:00010000:3.0:1746143124.327665:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 18 pid: 4758 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.327682:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 18 pid: 4758 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143124.327689:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093b5b100 00000100:00100000:3.0:1746143124.327719:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1928 00000100:00100000:3.0:1746143124.327728:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858506368:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143124.328342:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858506496 00000100:00100000:2.0:1746143124.328346:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858506496 00000100:00100000:2.0:1746143124.328388:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12021 00000100:00100000:2.0:1746143124.328394:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858506496:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.328402:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.328417:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66c400/0x25aee876ca70c5f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9e6 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.328655:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861194368:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.328722:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143124.340870:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858506368:12345-192.168.201.28@tcp:4:cat.0 Request processed in 13127us (13732us total) trans 17179872704 rc 0/0 00000100:00100000:3.0:1746143124.340897:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1928 00002000:00100000:3.0:1746143124.340913:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1765376->2097151) req@ffff880093b5b100 x1830962858506368/t17179872704(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/448 e 0 to 0 dl 1746143135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.340923:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5b100 with x1830962858506368 ext(1765376->2097151) 00010000:00010000:3.0:1746143124.340935:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 22 pid: 4758 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.340956:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 22 pid: 4758 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143124.340965:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093b5b100 00000100:00100000:2.0:1746143124.344159:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861194368:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.344196:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66c400/0x25aee876ca70c5f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9e6 expref: 21 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.344209:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66c400/0x25aee876ca70c5f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9e6 expref: 21 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.344227:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66c400, rc 0) 00000100:00100000:2.0:1746143124.344275:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858506496:12345-192.168.201.28@tcp:101:cat.0 Request processed in 15880us (17061us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.344284:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12021 00000100:00100000:0.0:1746143124.360346:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.360451:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.360834:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858506624 00000100:00100000:2.0:1746143124.360845:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858506624 00000100:00100000:2.0:1746143124.360922:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12022 00000100:00100000:2.0:1746143124.360933:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858506624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.360956:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.360976:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b66da00/0x25aee876ca70c5fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9ed expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.361067:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861194496:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.361146:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143124.361212:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858506752 00000100:00100000:3.0:1746143124.361218:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858506752 00010000:00010000:3.0:1746143124.361243:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 22 pid: 4758 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.361271:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6346 00000100:00100000:3.0:1746143124.361279:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858506752:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143124.361291:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143124.361317:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 22 pid: 4758 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.361329:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 22 pid: 4758 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.361361:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.361363:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.361384:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 28 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.361394:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 28 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.361616:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 28 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143124.361627:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861194624:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143124.361661:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.374857:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.374914:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.374993:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858507008 00000100:00100000:0.0:1746143124.375002:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858507008 00002000:00100000:0.0:1746143124.375098:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009a248380 x1830962858507008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143124.375109:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248380 with x1830962858507008 ext(1048576->2097151) 00002000:00010000:0.0:1746143124.375115:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a248380 00000100:00100000:0.0:1746143124.375147:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858507136 00000100:00100000:0.0:1746143124.375151:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858507136 00002000:00100000:0.0:1746143124.375170:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009a24b100 x1830962858507136/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143124.375184:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24b100 with x1830962858507136 ext(1048576->2097151) 00002000:00010000:0.0:1746143124.375188:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a24b100 00000100:00100000:0.0:1746143124.375209:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5827 00000100:00100000:0.0:1746143124.375218:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858507008:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:2.0:1746143124.377144:0:26949:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.201.28@tcp) returned -22 from glimpse AST (req@ffff880094512680 x1830962861194496) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 22 pid: 4758 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.377183:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dc9200/0x25aee876ca70c460 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8ce expref: 22 pid: 4758 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.377218:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861194496:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143124.377256:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b66da00/0x25aee876ca70c5fd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9ed expref: 21 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.377270:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66da00/0x25aee876ca70c5fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9ed expref: 21 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.377278:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66da00, rc 0) 00000100:00100000:2.0:1746143124.377391:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858506624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 16457us (17056us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.377401:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12022 00000100:00100000:2.0:1746143124.377607:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5828 00000100:00100000:2.0:1746143124.377618:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858507136:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143124.380497:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861194624:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143124.380522:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143124.380568:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858506752:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 19287us (20116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.380580:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6346 00000100:00100000:3.0:1746143124.394654:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.394780:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858507392 00000100:00100000:0.0:1746143124.394792:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858507392 00000100:00100000:0.0:1746143124.394867:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12023 00000100:00100000:0.0:1746143124.394878:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858507392:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143124.394902:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143124.394925:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9f4 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.394953:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.394955:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.394967:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 20 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143124.394984:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 20 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143124.394996:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82a00, rc 0) 00000100:00100000:0.0:1746143124.395104:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858507392:12345-192.168.201.28@tcp:101:cat.0 Request processed in 225us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.395112:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12023 00000100:00100000:2.0:1746143124.419103:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858507136:12345-192.168.201.28@tcp:3:cat.0 Request processed in 41473us (44176us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143124.419120:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5828 00002000:00100000:2.0:1746143124.419137:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009a24b100 x1830962858507136/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.419147:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24b100 with x1830962858507136 ext(1048576->2097151) 00002000:00010000:2.0:1746143124.419153:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a24b100 00000100:00100000:1.0:1746143124.426602:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858507008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 51368us (51742us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143124.426616:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5827 00002000:00100000:1.0:1746143124.426633:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009a248380 x1830962858507008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.426643:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248380 with x1830962858507008 ext(1048576->2097151) 00002000:00010000:1.0:1746143124.426650:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a248380 00010000:00010000:1.0:1746143124.504474:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143124.552821:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.555535:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858507520 00000100:00100000:1.0:1746143124.555550:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858507520 00000100:00100000:1.0:1746143124.555763:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12024 00000100:00100000:1.0:1746143124.555773:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30771:x1830962858507520:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143124.555794:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143124.555814:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164f9fb expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.555849:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.555857:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143124.555868:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143124.555871:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143124.555875:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1077248->1896447] (req 1077248->1896447) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.555906:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143124.555919:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746143124.555931:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861194752:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143124.558492:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.558511:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 19 pid: 21048 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143124.558526:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861194880:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143124.560067:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143124.570598:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861194752:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143124.570598:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.570610:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861194880:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143124.570643:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1077248->1896447] (req 1077248->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.570668:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6799c00, rc 0) 00000100:00100000:0.0:1746143124.570700:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.571082:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30771:x1830962858507520:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 15310us (18271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.571090:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12024 00000100:00100000:3.0:1746143124.571156:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858507648 00000100:00100000:3.0:1746143124.571164:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858507648 00010000:00010000:3.0:1746143124.571191:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143124.571215:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858507776 00000100:00100000:3.0:1746143124.571217:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858507776 00010000:00010000:3.0:1746143124.571227:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 20 pid: 21048 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.571243:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6347 00000100:00100000:3.0:1746143124.571249:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858507648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143124.571249:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6348 00000100:00100000:1.0:1746143124.571254:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858507776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143124.571261:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143124.571261:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143124.571282:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746143124.571282:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 20 pid: 21048 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.571292:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746143124.571433:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 20 pid: 21048 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.571455:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce400/0x25aee876ca70c5d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d1 expref: 30 pid: 8449 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746143124.571459:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009acd1000/0x25aee876ca70c5b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9bc expref: 20 pid: 21048 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.571481:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143124.571483:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143124.571489:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 29 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.571499:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 29 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.571514:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143124.571527:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 29 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143124.571540:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861195008:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143124.571684:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858507648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 434us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.571691:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6347 00000100:00100000:1.0:1746143124.571766:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.589905:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.589980:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858508032 00000100:00100000:2.0:1746143124.589991:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858508032 00002000:00100000:2.0:1746143124.590064:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1077248->1081343) req@ffff88009a248700 x1830962858508032/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.590074:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248700 with x1830962858508032 ext(1077248->1081343) 00002000:00010000:2.0:1746143124.590080:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a248700 00000100:00100000:2.0:1746143124.590114:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5829 00000100:00100000:2.0:1746143124.590122:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858508032:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143124.590169:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861195008:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143124.590187:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143124.590232:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858507776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 18977us (19531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.590241:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6348 00000100:00100000:2.0:1746143124.590294:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858508032:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 172us (399us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143124.590300:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5829 00002000:00100000:2.0:1746143124.590306:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1077248->1081343) req@ffff88009a248700 x1830962858508032/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/4536 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.590314:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248700 with x1830962858508032 ext(1077248->1081343) 00002000:00010000:2.0:1746143124.590317:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a248700 00000100:00100000:0.0:1746143124.612676:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.614077:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858508288 00000100:00100000:2.0:1746143124.614088:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858508288 00002000:00100000:2.0:1746143124.614134:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1892352->1896447) req@ffff88009fb57b80 x1830962858508288/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.614150:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb57b80 with x1830962858508288 ext(1892352->1896447) 00002000:00010000:2.0:1746143124.614156:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb57b80 00000100:00100000:2.0:1746143124.614176:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5830 00000100:00100000:2.0:1746143124.614183:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858508288:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143124.614365:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858508288:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 182us (1701us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143124.614382:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5830 00002000:00100000:2.0:1746143124.614389:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1892352->1896447) req@ffff88009fb57b80 x1830962858508288/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/4536 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.614396:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb57b80 with x1830962858508288 ext(1892352->1896447) 00002000:00010000:2.0:1746143124.614398:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb57b80 00000100:00100000:0.0:1746143124.625784:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.625949:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858508544 00000100:00100000:2.0:1746143124.625958:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858508544 00002000:00100000:2.0:1746143124.626010:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009fb55180 x1830962858508544/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 504/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.626020:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb55180 with x1830962858508544 ext(1048576->2097151) 00002000:00010000:2.0:1746143124.626026:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb55180 00000100:00100000:2.0:1746143124.626081:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5831 00000100:00100000:2.0:1746143124.626090:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858508544:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143124.632163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.633248:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858508672 00000100:00100000:2.0:1746143124.633258:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858508672 00000100:00100000:2.0:1746143124.633322:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12025 00000100:00100000:2.0:1746143124.633331:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30766:x1830962858508672:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143124.633353:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.633385:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa02 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.633418:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.633427:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 16 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.633653:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.633660:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.633662:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.633665:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1081344->2097151] (req 1081344->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 16 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.633700:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.633712:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 7 pid: 4758 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143124.633724:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861195136:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143124.633819:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 16 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143124.633833:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 16 pid: 8449 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143124.633841:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861195264:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143124.633871:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.633879:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 15 pid: 26949 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.639677:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861195392:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143124.640076:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.641810:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.641849:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.641884:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858508928 00000100:00100000:0.0:1746143124.641892:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858508928 00010000:00010000:0.0:1746143124.641925:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 17 pid: 8449 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143124.641949:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858508800 00000100:00100000:0.0:1746143124.641951:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858508800 00010000:00010000:0.0:1746143124.641960:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 8 pid: 4758 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143124.641974:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6349 00000100:00100000:0.0:1746143124.641980:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858508928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143124.641991:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143124.642016:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 17 pid: 8449 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143124.642027:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 17 pid: 8449 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143124.642071:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143124.642099:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858508928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 119us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.642106:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6349 00000100:00100000:0.0:1746143124.642119:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6350 00000100:00100000:0.0:1746143124.642124:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858508800:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143124.642130:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143124.642136:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 8 pid: 4758 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143124.642145:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 8 pid: 4758 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143124.642156:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143124.642166:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858508800:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 42us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.642171:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6350 00000100:00100000:2.0:1746143124.642416:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858508544:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16326us (16643us total) trans 0 rc 229376/229376 00000100:00100000:2.0:1746143124.642425:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5831 00002000:00100000:2.0:1746143124.642434:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009fb55180 x1830962858508544/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 504/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 229376/229376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.642444:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb55180 with x1830962858508544 ext(1048576->2097151) 00002000:00010000:2.0:1746143124.642447:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb55180 00010000:00010000:3.0:1746143124.642764:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe83c00/0x25aee876ca70c52b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f94c expref: 7 pid: 4758 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143124.642783:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861195136:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.644081:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe82600/0x25aee876ca70c5a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9b5 expref: 16 pid: 8449 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143124.644093:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861195264:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143124.647213:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861195392:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.647253:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1081344->2097151] (req 1081344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 15 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.647272:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ca9200, rc 0) 00000100:00100000:3.0:1746143124.647313:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30766:x1830962858508672:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 13982us (15162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.647323:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12025 00000100:00100000:0.0:1746143124.658738:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.658783:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.658825:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.658917:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858509312 00000100:00100000:1.0:1746143124.658928:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858509312 00010000:00010000:1.0:1746143124.658978:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 16 pid: 26949 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143124.659006:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6351 00000100:00100000:1.0:1746143124.659014:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858509312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143124.659066:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143124.659091:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 16 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.659103:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 16 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.659126:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132009e00/0x25aee876ca70c4ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f929 expref: 16 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.659151:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143124.659153:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143124.659160:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.659169:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.659205:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143124.659218:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861195520:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143124.659297:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd6c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746143124.659439:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143124.659503:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858509056 00000100:00100000:2.0:1746143124.659507:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858509056 00000100:00100000:2.0:1746143124.659530:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858509184 00000100:00100000:2.0:1746143124.659531:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858509184 00000100:00100000:2.0:1746143124.659546:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12026 00000100:00100000:2.0:1746143124.659552:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30776:x1830962858509056:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.659565:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.659576:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa09 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.659592:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.659598:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143124.659599:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143124.659602:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.659620:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.659631:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 14 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.659639:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861195648:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143124.659666:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.659688:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12027 00000100:00100000:2.0:1746143124.659695:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858509184:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143124.659703:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.659714:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53a8800/0x25aee876ca70c620 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa10 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.659748:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861195776:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143124.659770:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.663215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.663483:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858509440 00000100:00100000:3.0:1746143124.663493:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858509440 00000100:00100000:3.0:1746143124.665118:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12028 00000100:00100000:3.0:1746143124.665131:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858509440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143124.665151:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.665170:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50cea00/0x25aee876ca70c627 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa17 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143124.665225:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861195904:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143124.666364:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.667783:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.667868:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861195776:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.667904:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53a8800/0x25aee876ca70c620 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa10 expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.667919:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53a8800/0x25aee876ca70c620 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa10 expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143124.667972:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861195648:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143124.667991:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.668004:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81de00, rc 0) 00000100:00100000:2.0:1746143124.668064:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:30776:x1830962858509056:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8510us (9334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.668074:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12026 00000100:00100000:0.0:1746143124.668354:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858509696 00000100:00100000:0.0:1746143124.668360:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858509696 00002000:00100000:0.0:1746143124.668409:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (1081344->1085439) req@ffff88009310c380 x1830962858509696/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143124.668419:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310c380 with x1830962858509696 ext(1081344->1085439) 00010000:00010000:0.0:1746143124.668426:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.668439:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746143124.668445:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310c380 00000100:00100000:0.0:1746143124.668468:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1929 00000100:00100000:0.0:1746143124.668475:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858509696:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143124.668625:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858509696:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 151us (847us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143124.668632:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1929 00002000:00100000:0.0:1746143124.668637:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1081344->1085439) req@ffff88009310c380 x1830962858509696/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/4536 e 0 to 0 dl 1746143135 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143124.668644:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310c380 with x1830962858509696 ext(1081344->1085439) 00010000:00010000:0.0:1746143124.668648:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.668658:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746143124.668663:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310c380 00010000:00010000:3.0:1746143124.669117:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53a8800, rc 0) 00000100:00100000:3.0:1746143124.669141:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858509184:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9446us (10315us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.669147:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12027 00000100:00100000:1.0:1746143124.669486:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861195520:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143124.669500:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143124.669526:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858509312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10513us (10742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.669534:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6351 00002000:00010000:3.0:1746143124.670229:0:4756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143122 -> 1746143123 00002000:00010000:3.0:1746143124.670233:0:4756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143122 -> 1746143123 00002000:00010000:3.0:1746143124.670235:0:4756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143122 -> 1746143123 00000100:00100000:3.0:1746143124.670248:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861195904:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.670267:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50cea00/0x25aee876ca70c627 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa17 expref: 16 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.670277:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50cea00/0x25aee876ca70c627 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa17 expref: 16 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.670287:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50cea00, rc 0) 00000100:00100000:3.0:1746143124.670313:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858509440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5188us (7109us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.670319:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12028 00000100:00100000:0.0:1746143124.680230:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.680409:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858509824 00000100:00100000:2.0:1746143124.680419:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858509824 00000100:00100000:2.0:1746143124.680477:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8093 00000100:00100000:2.0:1746143124.680485:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30781:x1830962858509824:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143124.680512:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.680536:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4000/0x25aee876ca70c62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa1e expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.680598:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.680610:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.680622:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.680638:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.680643:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.680649:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.680765:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.680776:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 26 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.680783:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 214 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.680789:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.680818:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 214 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.680829:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 214 pid: 17079 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.680839:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861196032:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143124.680940:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 26 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.680953:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 26 pid: 17079 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.680961:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861196160:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143124.680981:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.681884:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.681957:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.682025:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858510208 00000100:00100000:1.0:1746143124.682057:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858510208 00002000:00100000:1.0:1746143124.682094:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (1081344->2097151) req@ffff88008f576300 x1830962858510208/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.682105:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576300 with x1830962858510208 ext(1081344->2097151) 00010000:00010000:1.0:1746143124.682114:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 15 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.682124:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 15 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746143124.682130:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f576300 00000100:00100000:1.0:1746143124.682151:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1930 00000100:00100000:1.0:1746143124.682157:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858510208:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143124.687223:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858510080 00000100:00100000:3.0:1746143124.687301:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858510080 00000100:00100000:3.0:1746143124.687384:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12029 00000100:00100000:3.0:1746143124.687393:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30766:x1830962858510080:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143124.687409:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.687425:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa25 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.687452:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 15 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.687460:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.687466:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.687472:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.687474:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.687476:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->2117631] (req 2097152->2117631) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.687506:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.687516:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 18 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.687527:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861196288:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.687626:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.687634:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 6 pid: 754 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143124.687643:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861196416:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.687669:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 15 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.687683:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 15 pid: 8169 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.687698:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861196544:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143124.687718:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.687736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.687913:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858510464 00000100:00100000:1.0:1746143124.687920:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858510464 00002000:00100000:1.0:1746143124.687961:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094510e00 x1830962858510464/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.687972:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510e00 with x1830962858510464 ext(1048576->2097151) 00002000:00010000:1.0:1746143124.687977:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094510e00 00000100:00100000:1.0:1746143124.687997:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5832 00000100:00100000:1.0:1746143124.688004:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858510464:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143124.693102:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861196032:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143124.693310:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.693357:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.693445:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858510848 00000100:00100000:1.0:1746143124.693452:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858510848 00010000:00010000:1.0:1746143124.693489:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 27 pid: 17079 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.693537:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858510720 00000100:00100000:2.0:1746143124.693541:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858510720 00000100:00100000:2.0:1746143124.693577:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3408 00000100:00100000:2.0:1746143124.693584:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:30386:x1830962858510720:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143124.693617:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6352 00000100:00100000:1.0:1746143124.693622:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858510848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143124.693632:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143124.693637:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 27 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.693648:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 27 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.693668:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143124.693673:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143124.693682:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143124.693687:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143124.693697:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143124.693855:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70c5be lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9c3 expref: 27 pid: 17079 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143124.693941:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858510848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 317us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.693948:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6352 00000100:00100000:2.0:1746143124.694005:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:30386:x1830962858510720:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 421us (697us total) trans 8589942304 rc 0/0 00000100:00100000:2.0:1746143124.694011:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3408 00000100:00100000:3.0:1746143124.694076:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861196160:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.694098:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:1.0:1746143124.705670:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.705700:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858510976 00000100:00100000:1.0:1746143124.705709:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858510976 00010000:00010000:1.0:1746143124.705746:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 7 pid: 754 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746143124.705780:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6353 00000100:00100000:1.0:1746143124.705788:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858510976:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143124.705801:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143124.705825:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 7 pid: 754 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746143124.705842:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 7 pid: 754 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746143124.705868:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143124.705904:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858510976:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 117us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.705910:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6353 00000100:00100000:3.0:1746143124.705964:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861196288:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.705978:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cd4200/0x25aee876ca70c253 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f7c4 expref: 6 pid: 754 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143124.705996:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861196416:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143124.706005:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861196544:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.706096:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->2117631] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.706107:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53a9600, rc 0) 00000100:00100000:3.0:1746143124.706138:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30766:x1830962858510080:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 18747us (24256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.706145:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12029 00000100:00100000:1.0:1746143124.706331:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858510464:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18327us (18599us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143124.706339:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5832 00002000:00100000:1.0:1746143124.706348:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094510e00 x1830962858510464/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.706356:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510e00 with x1830962858510464 ext(1048576->2097151) 00002000:00010000:1.0:1746143124.706361:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094510e00 00000100:00100000:1.0:1746143124.706437:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.706451:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858511104 00000100:00100000:1.0:1746143124.706454:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858511104 00010000:00010000:1.0:1746143124.706471:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 216 pid: 17079 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143124.708103:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6354 00000100:00100000:1.0:1746143124.708114:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:1969:x1830962858511104:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143124.708125:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143124.708132:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 216 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.708144:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 216 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.708162:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409400/0x25aee876ca70c5e8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9df expref: 216 pid: 17079 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143124.708786:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.708800:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858511232 00000100:00100000:0.0:1746143124.708804:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858511232 00010000:00010000:0.0:1746143124.708823:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 18 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143124.708839:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6355 00000100:00100000:0.0:1746143124.708844:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858511232:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143124.708851:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143124.708869:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 18 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.708877:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 18 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.708891:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70c21b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f785 expref: 18 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.708906:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143124.708931:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858511232:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 87us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.708937:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6355 00010000:00010000:1.0:1746143124.708995:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143124.709001:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143124.709012:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143124.709019:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143124.709059:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143124.709078:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:1.0:1746143124.709078:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:1969:x1830962858511104:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 966us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.709084:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6354 00010000:00010000:3.0:1746143124.709086:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143124.709128:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143124.709132:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143124.709149:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709158:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709168:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709174:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709180:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709185:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fc5c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143124.709189:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709194:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709203:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143124.709205:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143124.709208:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709217:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5c00/0x25aee876ca70c635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709227:0:1037:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709231:0:1037:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709236:0:1037:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709240:0:1037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e81d800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143124.709242:0:1037:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709246:0:1037:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709250:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5dcf300) 00010000:00010000:3.0:1746143124.709252:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143124.709254:0:1037:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709257:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70c63c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.709291:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4000/0x25aee876ca70c62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.709303:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 13 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.709313:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.709315:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143124.709317:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81c800, rc 0) 00000100:00100000:3.0:1746143124.709345:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30781:x1830962858509824:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 28861us (29129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.709351:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8093 00000100:00100000:0.0:1746143124.711009:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.711090:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858511360 00000100:00100000:2.0:1746143124.711097:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858511360 00010000:00010000:2.0:1746143124.711121:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 16 pid: 8169 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.711149:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6356 00000100:00100000:2.0:1746143124.711156:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858511360:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.711166:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.711183:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 16 pid: 8169 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.711192:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 16 pid: 8169 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.711210:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a518b400/0x25aee876ca70c1ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f769 expref: 16 pid: 8169 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.711226:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.711228:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.711234:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 16 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.711242:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 16 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.711271:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 16 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.711283:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861196672:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143124.711344:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.713162:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.713199:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.713219:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858511488 00000100:00100000:0.0:1746143124.713224:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858511488 00000100:00100000:3.0:1746143124.714215:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858511744 00000100:00100000:3.0:1746143124.714221:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858511744 00000100:00100000:0.0:1746143124.714237:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12030 00000100:00100000:0.0:1746143124.714400:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858511488:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:3.0:1746143124.714411:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12031 00000100:00100000:3.0:1746143124.714417:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858511744:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.714434:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.714450:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ca9c00/0x25aee876ca70c651 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa3a expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143124.714494:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861196800:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143124.714552:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143124.714563:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa2c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143124.714566:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00010000:00010000:0.0:1746143124.714575:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.714577:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.714585:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143124.714599:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143124.714608:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b375800, rc 0) 00000100:00100000:0.0:1746143124.714628:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858511488:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 232us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.714634:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12030 00000100:00100000:0.0:1746143124.714718:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.714733:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858511616 00000100:00100000:0.0:1746143124.714736:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858511616 00000100:00100000:0.0:1746143124.714760:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12032 00000100:00100000:0.0:1746143124.714765:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858511616:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143124.714771:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143124.714778:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b374200/0x25aee876ca70c65f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa33 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143124.714805:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861196928:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143124.714826:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.714869:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.714959:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.715027:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858511872 00000100:00100000:1.0:1746143124.715045:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858511872 00000100:00100000:1.0:1746143124.715067:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12033 00000100:00100000:1.0:1746143124.715073:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858511872:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143124.715080:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143124.715087:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdef400/0x25aee876ca70c666 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa41 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143124.715116:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861197056:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143124.715152:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143124.715170:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858512128 00000100:00100000:1.0:1746143124.715174:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858512128 00002000:00100000:1.0:1746143124.715199:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2113536->2117631) req@ffff880091948000 x1830962858512128/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143124.715361:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861196672:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143124.715615:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.715638:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858511360:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4483us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.715648:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6356 00002000:00100000:1.0:1746143124.715759:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948000 with x1830962858512128 ext(2113536->2117631) 00002000:00010000:1.0:1746143124.715763:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948000 00000100:00100000:1.0:1746143124.715779:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5833 00000100:00100000:1.0:1746143124.715786:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858512128:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143124.715929:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858512128:12345-192.168.201.28@tcp:3:cat.0 Request processed in 144us (970us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143124.715935:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5833 00002000:00100000:1.0:1746143124.715940:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2113536->2117631) req@ffff880091948000 x1830962858512128/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/4536 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.715948:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948000 with x1830962858512128 ext(2113536->2117631) 00002000:00010000:1.0:1746143124.715950:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948000 00000100:00100000:3.0:1746143124.723073:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861196800:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143124.723076:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143124.723112:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ca9c00/0x25aee876ca70c651 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa3a expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143124.723120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143124.723127:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ca9c00/0x25aee876ca70c651 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa3a expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.723139:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ca9c00, rc 0) 00000100:00100000:3.0:1746143124.723182:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858511744:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 8765us (9982us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.723193:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12031 00000100:00100000:3.0:1746143124.723218:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858512256 00000100:00100000:3.0:1746143124.723224:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858512256 00000100:00100000:3.0:1746143124.723247:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12034 00000100:00100000:3.0:1746143124.723253:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30780:x1830962858512256:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143124.723266:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.723280:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa48 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.723302:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 28 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.723309:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143124.723310:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143124.723314:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.723339:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 28 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.723350:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 28 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.723361:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861197184:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143124.723428:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00002000:00010000:1.0:1746143124.723932:0:21048:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143121 -> 1746143123 00002000:00010000:1.0:1746143124.723936:0:21048:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143121 -> 1746143123 00002000:00010000:1.0:1746143124.723939:0:21048:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143121 -> 1746143123 00000100:00100000:1.0:1746143124.723952:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861197056:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143124.723969:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fdef400/0x25aee876ca70c666 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa41 expref: 7 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143124.723983:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdef400/0x25aee876ca70c666 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa41 expref: 7 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143124.723994:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdef400, rc 0) 00000100:00100000:1.0:1746143124.724017:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858511872:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 8944us (9148us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143124.724022:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12033 00000100:00100000:1.0:1746143124.724081:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861196928:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143124.724096:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b374200/0x25aee876ca70c65f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa33 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143124.724103:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b374200/0x25aee876ca70c65f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa33 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143124.724110:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b374200, rc 0) 00000100:00100000:1.0:1746143124.724124:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858511616:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 9360us (9407us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143124.724129:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12032 00000100:00100000:2.0:1746143124.724220:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858512512 00000100:00100000:2.0:1746143124.724224:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858512512 00000100:00100000:2.0:1746143124.724248:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3409 00000100:00100000:2.0:1746143124.724253:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f35f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30766:x1830962858512512:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143124.724643:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f35f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:30766:x1830962858512512:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 389us (1521us total) trans 8589942305 rc 0/0 00000100:00100000:2.0:1746143124.724648:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3409 00000100:00100000:1.0:1746143124.726558:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858510208:12345-192.168.201.28@tcp:4:cat.0 Request processed in 44395us (44595us total) trans 21474839957 rc 0/0 00000100:00100000:1.0:1746143124.726568:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1930 00002000:00100000:1.0:1746143124.726578:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (1081344->2097151) req@ffff88008f576300 x1830962858510208/t21474839957(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/448 e 0 to 0 dl 1746143135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.726595:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576300 with x1830962858510208 ext(1081344->2097151) 00010000:00010000:1.0:1746143124.726603:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.726615:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746143124.726622:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f576300 00000100:00100000:3.0:1746143124.729842:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861197184:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.729877:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.729894:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ca8200, rc 0) 00000100:00100000:3.0:1746143124.729942:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30780:x1830962858512256:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6687us (6867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.729949:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12034 00000100:00100000:0.0:1746143124.730205:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.730265:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.731424:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858512640 00000100:00100000:1.0:1746143124.731433:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858512640 00002000:00100000:1.0:1746143124.731477:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1077248->1896447) req@ffff880091949880 x1830962858512640/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.731486:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949880 with x1830962858512640 ext(1077248->1896447) 00010000:00010000:1.0:1746143124.731493:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 29 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143124.731504:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 29 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746143124.731510:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091949880 00000100:00100000:1.0:1746143124.731529:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1931 00000100:00100000:1.0:1746143124.731537:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858512640:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143124.731937:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858512896 00000100:00100000:3.0:1746143124.731942:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858512896 00000100:00100000:3.0:1746143124.731971:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8094 00000100:00100000:3.0:1746143124.731976:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30781:x1830962858512896:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.731988:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.732003:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa4f expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.732132:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.732147:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.732154:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.732183:0:1037:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.732192:0:1037:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 14 pid: 1037 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.732207:0:1037:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861197312:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143124.732254:0:1037:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143124.737155:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.737957:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858513024 00000100:00100000:2.0:1746143124.737967:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858513024 00010000:00010000:2.0:1746143124.738011:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.738059:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6357 00000100:00100000:2.0:1746143124.738068:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858513024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.738084:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.738111:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.738123:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.738151:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ca9200/0x25aee876ca70c612 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa02 expref: 17 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.738189:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.738191:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.738200:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 14 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.738208:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 14 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.738243:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 14 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.738255:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861197440:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143124.738349:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143124.742027:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.742129:0:1037:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1037:1830962861197312:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143124.742130:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858513280 00000100:00100000:0.0:1746143124.742135:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858513280 00010000:00010000:3.0:1746143124.742154:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143124.742162:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 15 pid: 1037 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143124.742187:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6358 00000100:00100000:0.0:1746143124.742195:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1968:x1830962858513280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143124.742208:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143124.742214:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 15 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.742223:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 15 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.742242:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81c800/0x25aee876ca70c643 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa1e expref: 15 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.742258:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143124.742263:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143124.742276:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143124.742283:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:0.0:1746143124.742298:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143124.742333:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858513280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 139us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.742340:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6358 00010000:00010000:3.0:1746143124.742502:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.742509:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143124.742530:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143124.742674:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051bc00/0x25aee876ca70c674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 15 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.742697:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.742703:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.742705:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143124.742708:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53a8800, rc 0) 00000100:00100000:3.0:1746143124.742733:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30781:x1830962858512896:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 10757us (12530us total) trans 8589942306 rc 0/0 00000100:00100000:3.0:1746143124.742740:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8094 00000100:00100000:0.0:1746143124.757197:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.757415:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861197440:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143124.757438:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143124.757483:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858513024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 19415us (20337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.757493:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6357 00000100:00100000:2.0:1746143124.757785:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858513536 00000100:00100000:2.0:1746143124.757793:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858513536 00002000:00100000:2.0:1746143124.757829:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009194bb80 x1830962858513536/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.757839:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194bb80 with x1830962858513536 ext(1048576->2097151) 00002000:00010000:2.0:1746143124.757845:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194bb80 00000100:00100000:2.0:1746143124.757877:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5834 00000100:00100000:2.0:1746143124.757884:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858513536:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143124.758169:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858512640:12345-192.168.201.28@tcp:4:cat.0 Request processed in 26631us (27901us total) trans 17179872705 rc 0/0 00000100:00100000:0.0:1746143124.758180:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1931 00002000:00100000:0.0:1746143124.758186:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x304:0x0] (1077248->1896447) req@ffff880091949880 x1830962858512640/t17179872705(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/448 e 0 to 0 dl 1746143135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143124.758194:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949880 with x1830962858512640 ext(1077248->1896447) 00010000:00010000:0.0:1746143124.758203:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 31 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.758222:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 31 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746143124.758229:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091949880 00000100:00100000:0.0:1746143124.758530:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.761656:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858513664 00000100:00100000:3.0:1746143124.761667:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858513664 00000100:00100000:3.0:1746143124.761709:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8095 00000100:00100000:3.0:1746143124.761715:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30781:x1830962858513664:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.761737:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.761756:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b374200/0x25aee876ca70c689 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa56 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.761832:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.761845:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 15 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.761853:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.761882:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 15 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.761891:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 15 pid: 1037 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.761902:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861197568:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143124.761969:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143124.770182:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861197568:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.770219:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143124.770359:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.772770:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858513920 00000100:00100000:3.0:1746143124.772784:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858513920 00000100:00100000:3.0:1746143124.772840:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8096 00000100:00100000:3.0:1746143124.772848:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:30784:x1830962858513920:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:0.0:1746143124.772853:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143124.772875:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.772896:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9c00/0x25aee876ca70c697 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa5d expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.773121:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.773135:0:1037:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.773142:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.773159:0:1037:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210400000020 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.773168:0:1037:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:2.0:1746143124.774212:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858514048 00000100:00100000:2.0:1746143124.774218:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858514048 00010000:00010000:2.0:1746143124.774246:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 16 pid: 1037 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.774280:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6359 00000100:00100000:2.0:1746143124.774286:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:1968:x1830962858514048:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.774297:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.774302:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 16 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.774317:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 16 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.774334:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70c67b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa4f expref: 16 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.774354:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.774358:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210400000020 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.774378:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.774385:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.774392:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.774398:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.774424:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.774671:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1968:x1830962858514048:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 383us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.774679:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6359 00010000:00010000:3.0:1746143124.774711:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.774719:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143124.774746:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143124.774751:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143124.774767:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.774968:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b374200/0x25aee876ca70c689 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa56 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.775999:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa56 expref: 14 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.776009:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa56 expref: 14 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.776016:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009051a200, rc 0) 00000100:00100000:3.0:1746143124.776637:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30781:x1830962858513664:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 14920us (18106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.776645:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8095 00000100:00100000:0.0:1746143124.777075:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.777289:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858514176 00000100:00100000:2.0:1746143124.777295:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858514176 00010000:00010000:2.0:1746143124.777318:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 31 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.777345:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6360 00000100:00100000:2.0:1746143124.777352:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1970:x1830962858514176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.777362:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143124.777395:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 31 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.777406:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 31 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.777425:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799c00/0x25aee876ca70c60b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1896447) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9fb expref: 31 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.777438:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.777440:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.777864:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.777872:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.777905:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.777918:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861197696:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143124.777993:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b630fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143124.778567:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858513536:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20682us (21379us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143124.778577:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5834 00002000:00100000:3.0:1746143124.778586:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009194bb80 x1830962858513536/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.778596:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194bb80 with x1830962858513536 ext(1048576->2097151) 00002000:00010000:3.0:1746143124.778602:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194bb80 00000100:00100000:0.0:1746143124.779254:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.779322:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.779584:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.779611:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.779683:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858514304 00000100:00100000:2.0:1746143124.779689:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858514304 00000100:00100000:2.0:1746143124.779719:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858514560 00000100:00100000:2.0:1746143124.779721:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858514560 00000100:00100000:2.0:1746143124.779734:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858514432 00000100:00100000:2.0:1746143124.779736:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858514432 00000100:00100000:2.0:1746143124.779756:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12035 00000100:00100000:2.0:1746143124.779762:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858514304:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:1.0:1746143124.779771:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858514688 00000100:00100000:1.0:1746143124.779775:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858514688 00010000:00010000:2.0:1746143124.779778:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.779792:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa64 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.779792:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa56 expref: 14 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.779809:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143124.779811:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143124.779811:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6361 00000100:00100000:1.0:1746143124.779815:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1970:x1830962858514688:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143124.779817:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143124.779823:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143124.779826:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa56 expref: 14 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.779828:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143124.779836:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa56 expref: 14 pid: 17079 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143124.779837:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50cea00, rc 0) 00010000:00010000:1.0:1746143124.779850:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009051a200/0x25aee876ca70c690 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa56 expref: 14 pid: 17079 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143124.779859:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858514304:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 98us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.779864:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12035 00010000:00010000:1.0:1746143124.779866:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143124.779871:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000100:00100000:2.0:1746143124.779874:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12036 00000100:00100000:2.0:1746143124.779879:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858514560:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143124.779879:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:1.0:1746143124.779885:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1037 initiator: MDT0 00010000:00010000:2.0:1746143124.779886:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.779895:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50cee00/0x25aee876ca70c6ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa72 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143124.779929:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861197824:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143124.779942:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12037 00000100:00100000:3.0:1746143124.779948:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858514432:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.779955:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143124.779960:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00010000:00010000:3.0:1746143124.779963:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa6b expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.779974:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.779976:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143124.779980:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.779990:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.779998:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094efb400, rc 0) 00000100:00100000:3.0:1746143124.780015:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858514432:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 67us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.780020:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12037 00010000:00010000:1.0:1746143124.780188:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143124.780208:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858514688:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 391us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.780214:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6361 00010000:00010000:3.0:1746143124.780270:0:1037:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143124.780277:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143124.780297:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143124.780487:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9c00/0x25aee876ca70c697 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 218 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.780499:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 217 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.780505:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.780508:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143124.780511:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ca8800, rc 0) 00000100:00100000:3.0:1746143124.780532:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+217:30784:x1830962858513920:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7686us (10175us total) trans 8589942307 rc 0/0 00000100:00100000:3.0:1746143124.780539:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8096 00000100:00100000:3.0:1746143124.781583:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861197696:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143124.781604:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143124.781626:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858514176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4276us (4553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.781633:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6360 00000100:00100000:1.0:1746143124.791118:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.791246:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.791339:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858515072 00000100:00100000:0.0:1746143124.791349:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858515072 00000100:00100000:0.0:1746143124.791402:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12038 00000100:00100000:0.0:1746143124.791410:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:30776:x1830962858515072:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143124.791430:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143124.791448:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa79 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.791481:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 15 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.791489:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143124.791491:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143124.791494:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.791526:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 15 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.791538:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 15 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143124.791550:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861197952:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143124.791643:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143124.792125:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858514944 00000100:00100000:2.0:1746143124.792132:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858514944 00002000:00100000:2.0:1746143124.792176:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800906a6300 x1830962858514944/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.792186:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6300 with x1830962858514944 ext(1048576->2097151) 00002000:00010000:2.0:1746143124.792192:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a6300 00000100:00100000:2.0:1746143124.792228:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5835 00000100:00100000:2.0:1746143124.792237:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858514944:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143124.798737:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861197824:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143124.798778:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50cee00/0x25aee876ca70c6ac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa72 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.798793:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50cee00/0x25aee876ca70c6ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa72 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143124.798805:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50cee00, rc 0) 00000100:00100000:3.0:1746143124.798873:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858514560:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 18991us (19549us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143124.798882:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12036 00000100:00100000:0.0:1746143124.800847:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.800918:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858515200 00000100:00100000:3.0:1746143124.800926:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858515200 00002000:00100000:3.0:1746143124.800969:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2117631) req@ffff88009ae2c700 x1830962858515200/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.800980:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c700 with x1830962858515200 ext(2097152->2117631) 00010000:00010000:3.0:1746143124.800988:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 16 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.801003:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 16 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143124.801009:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ae2c700 00000100:00100000:3.0:1746143124.801025:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1932 00000100:00100000:3.0:1746143124.801056:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858515200:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143124.801299:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861197952:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143124.801336:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.801354:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d9a00, rc 0) 00000100:00100000:1.0:1746143124.801401:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30776:x1830962858515072:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9989us (10152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.801409:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12038 00000100:00100000:2.0:1746143124.818240:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.818321:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858515328 00000100:00100000:3.0:1746143124.818331:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858515328 00000100:00100000:3.0:1746143124.818387:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8097 00000100:00100000:3.0:1746143124.818394:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30781:x1830962858515328:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.818413:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.818432:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5a00/0x25aee876ca70c6c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa80 expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.818493:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5a00/0x25aee876ca70c6c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa80 expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.818506:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5a00/0x25aee876ca70c6c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa80 expref: 14 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.818521:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.818524:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143124.818527:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fc5a00, rc 0) 00000100:00100000:3.0:1746143124.818568:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30781:x1830962858515328:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 174us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.818578:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8097 00000100:00100000:2.0:1746143124.818585:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858514944:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26350us (27492us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143124.818592:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5835 00002000:00100000:2.0:1746143124.818602:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800906a6300 x1830962858514944/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.818612:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6300 with x1830962858514944 ext(1048576->2097151) 00002000:00010000:2.0:1746143124.818617:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a6300 00000100:00100000:3.0:1746143124.819648:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858515200:12345-192.168.201.28@tcp:4:cat.0 Request processed in 18613us (18804us total) trans 21474839958 rc 0/0 00000100:00100000:3.0:1746143124.819657:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1932 00002000:00100000:3.0:1746143124.819663:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2117631) req@ffff88009ae2c700 x1830962858515200/t21474839958(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/448 e 0 to 0 dl 1746143135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.819672:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c700 with x1830962858515200 ext(2097152->2117631) 00010000:00010000:3.0:1746143124.819680:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 18 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.819693:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 18 pid: 4756 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143124.819699:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ae2c700 00000100:00100000:0.0:1746143124.830883:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.831077:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858515584 00000100:00100000:3.0:1746143124.831086:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858515584 00000100:00100000:3.0:1746143124.831137:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8098 00000100:00100000:3.0:1746143124.831145:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30781:x1830962858515584:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143124.831166:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143124.831188:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9c00/0x25aee876ca70c6cf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa87 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.831287:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.831302:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 216 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.831309:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.831338:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 216 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143124.831349:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 216 pid: 1037 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.831360:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861198080:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143124.831631:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143124.831829:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.831877:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858515840 00000100:00100000:0.0:1746143124.831882:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858515840 00000100:00100000:0.0:1746143124.831911:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12039 00000100:00100000:0.0:1746143124.831916:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30780:x1830962858515840:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143124.831926:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143124.831938:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa8e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.831956:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.831957:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.831965:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.831990:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.831999:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f6c200, rc 0) 00000100:00100000:0.0:1746143124.832028:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30780:x1830962858515840:12345-192.168.201.28@tcp:101:cat.0 Request processed in 112us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.832055:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12039 00000100:00100000:0.0:1746143124.832781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.833019:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858515712 00000100:00100000:3.0:1746143124.833023:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858515712 00010000:00010000:3.0:1746143124.833057:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 19 pid: 4756 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143124.833104:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6362 00000100:00100000:0.0:1746143124.833111:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858515712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143124.833125:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143124.833148:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 19 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.833158:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 19 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.833174:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53a9600/0x25aee876ca70c64a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa25 expref: 19 pid: 4756 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143124.833196:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.833198:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.833203:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.833210:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.833234:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143124.833243:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861198208:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143124.833278:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143124.838204:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861198080:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143124.838228:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143124.839259:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.839504:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858515968 00000100:00100000:3.0:1746143124.839512:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858515968 00010000:00010000:3.0:1746143124.839544:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 217 pid: 1037 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143124.839584:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6363 00000100:00100000:3.0:1746143124.839591:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+217:1968:x1830962858515968:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143124.839609:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143124.839615:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 217 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.839625:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 217 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.839646:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca8800/0x25aee876ca70c69e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa5d expref: 217 pid: 1037 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143124.839665:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143124.839669:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.839679:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.839685:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143124.839715:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143124.839754:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:3.0:1746143124.839755:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:1968:x1830962858515968:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 164us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143124.839762:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6363 00010000:00010000:2.0:1746143124.839762:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.839780:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.839787:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.839793:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.839798:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ca9200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143124.839803:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.839809:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.839817:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.839820:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143124.839829:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.839834:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9200/0x25aee876ca70c6d6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.839879:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9c00/0x25aee876ca70c6cf lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa87 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.839885:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ca9c00/0x25aee876ca70c6cf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa87 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.839893:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ca9c00, rc 0) 00000100:00100000:2.0:1746143124.839917:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30781:x1830962858515584:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 8773us (9046us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143124.839929:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8098 00000100:00100000:0.0:1746143124.850464:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143124.850522:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.850617:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861198208:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143124.850648:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143124.850729:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858515712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 17617us (17946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143124.850740:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6362 00000100:00100000:0.0:1746143124.851430:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.851448:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858516224 00000100:00100000:3.0:1746143124.851456:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858516224 00000100:00100000:2.0:1746143124.851490:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858516480 00000100:00100000:2.0:1746143124.851493:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858516480 00002000:00100000:3.0:1746143124.851495:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009ad5a680 x1830962858516224/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.851505:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5a680 with x1830962858516224 ext(1048576->2097151) 00002000:00010000:3.0:1746143124.851510:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5a680 00002000:00100000:2.0:1746143124.851510:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009ad59f80 x1830962858516480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.851516:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59f80 with x1830962858516480 ext(2097152->3145727) 00002000:00010000:2.0:1746143124.851519:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad59f80 00000100:00100000:3.0:1746143124.851537:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5836 00000100:00100000:2.0:1746143124.851541:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5837 00000100:00100000:3.0:1746143124.851543:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858516224:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143124.851545:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858516480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143124.853139:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858516736 00000100:00100000:1.0:1746143124.853147:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858516736 00000100:00100000:1.0:1746143124.853184:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3410 00000100:00100000:1.0:1746143124.853192:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:30781:x1830962858516736:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:1.0:1746143124.853394:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:30781:x1830962858516736:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 202us (1963us total) trans 8589942308 rc 0/0 00000100:00100000:1.0:1746143124.853401:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3410 00000100:00100000:1.0:1746143124.862571:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.866694:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858516992 00000100:00100000:2.0:1746143124.866709:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858516992 00002000:00100000:2.0:1746143124.866765:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800906a6d80 x1830962858516992/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.866776:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6d80 with x1830962858516992 ext(3145728->4194303) 00002000:00010000:2.0:1746143124.866782:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a6d80 00000100:00100000:2.0:1746143124.866812:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5838 00000100:00100000:2.0:1746143124.866821:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858516992:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143124.874331:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858516224:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22773us (23867us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143124.874344:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5836 00002000:00100000:3.0:1746143124.874357:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009ad5a680 x1830962858516224/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.874548:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5a680 with x1830962858516224 ext(1048576->2097151) 00002000:00010000:3.0:1746143124.874555:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5a680 00000100:00100000:2.0:1746143124.889277:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.889313:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858517248 00000100:00100000:2.0:1746143124.889322:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858517248 00000100:00100000:2.0:1746143124.889390:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8099 00000100:00100000:2.0:1746143124.889401:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:30787:x1830962858517248:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143124.889429:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143124.889449:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec89a00/0x25aee876ca70c6e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa95 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.889553:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.889567:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143124.889578:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143124.889589:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143124.889725:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec89a00/0x25aee876ca70c6e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 30 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143124.891810:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858516480:12345-192.168.201.28@tcp:3:cat.0 Request processed in 40258us (41283us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143124.891819:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5837 00002000:00100000:3.0:1746143124.891828:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009ad59f80 x1830962858516480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.891836:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59f80 with x1830962858516480 ext(2097152->3145727) 00002000:00010000:3.0:1746143124.891841:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad59f80 00010000:00010000:2.0:1746143124.893380:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 29 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143124.893393:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143124.893396:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143124.893399:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094efbc00, rc 0) 00000100:00100000:2.0:1746143124.893439:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:30787:x1830962858517248:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4039us (4178us total) trans 8589942309 rc 0/0 00000100:00100000:2.0:1746143124.893446:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8099 00000100:00100000:0.0:1746143124.896800:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143124.896941:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858517376 00000100:00100000:1.0:1746143124.896950:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858517376 00000100:00100000:1.0:1746143124.896988:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12040 00000100:00100000:1.0:1746143124.896995:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30780:x1830962858517376:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143124.897011:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143124.897045:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fa9c expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.897077:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143124.897079:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143124.897087:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.897101:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143124.897110:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd0200, rc 0) 00000100:00100000:1.0:1746143124.897150:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30780:x1830962858517376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 156us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143124.897156:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12040 00000100:00100000:2.0:1746143124.897802:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858516992:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30980us (35239us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143124.897813:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5838 00002000:00100000:2.0:1746143124.897821:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800906a6d80 x1830962858516992/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.897829:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6d80 with x1830962858516992 ext(3145728->4194303) 00002000:00010000:2.0:1746143124.897833:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a6d80 00000100:00100000:2.0:1746143124.921200:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.921243:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.921346:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143124.921396:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858517760 00000100:00100000:2.0:1746143124.921406:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858517760 00002000:00100000:2.0:1746143124.921466:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094513480 x1830962858517760/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.921477:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513480 with x1830962858517760 ext(2097152->3145727) 00002000:00010000:2.0:1746143124.921483:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094513480 00000100:00100000:2.0:1746143124.921499:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858518016 00000100:00100000:2.0:1746143124.921501:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858518016 00002000:00100000:2.0:1746143124.921512:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094512680 x1830962858518016/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.921518:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512680 with x1830962858518016 ext(3145728->4194303) 00002000:00010000:2.0:1746143124.921520:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094512680 00000100:00100000:2.0:1746143124.921546:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5839 00000100:00100000:2.0:1746143124.921555:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858517760:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143124.921969:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5840 00000100:00100000:1.0:1746143124.921977:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858518016:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143124.925333:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858517504 00000100:00100000:0.0:1746143124.925571:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858517504 00000100:00100000:0.0:1746143124.925631:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12041 00000100:00100000:0.0:1746143124.925641:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858517504:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143124.925658:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143124.925679:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164faa3 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143124.925704:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.925706:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143124.925715:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 31 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143124.925731:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 31 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143124.925742:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f6c800, rc 0) 00000100:00100000:0.0:1746143124.925778:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1970:x1830962858517504:12345-192.168.201.28@tcp:101:cat.0 Request processed in 139us (4590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143124.925784:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12041 00000100:00100000:0.0:1746143124.940135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.940242:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858518272 00000100:00100000:3.0:1746143124.940249:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858518272 00002000:00100000:3.0:1746143124.940282:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009ad5bb80 x1830962858518272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.940289:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5bb80 with x1830962858518272 ext(4194304->5210111) 00002000:00010000:3.0:1746143124.940293:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5bb80 00000100:00100000:3.0:1746143124.940313:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5841 00000100:00100000:3.0:1746143124.940319:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858518272:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143124.952286:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858518016:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30301us (30931us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143124.952297:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5840 00002000:00100000:1.0:1746143124.952309:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094512680 x1830962858518016/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143124.952318:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512680 with x1830962858518016 ext(3145728->4194303) 00002000:00010000:1.0:1746143124.952324:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094512680 00000100:00100000:2.0:1746143124.953550:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858517760:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31992us (32302us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143124.953561:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5839 00002000:00100000:2.0:1746143124.953568:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094513480 x1830962858517760/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143124.953575:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513480 with x1830962858517760 ext(2097152->3145727) 00002000:00010000:2.0:1746143124.953579:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094513480 00000100:00100000:3.0:1746143124.974699:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858518272:12345-192.168.201.28@tcp:3:cat.0 Request processed in 34370us (34562us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143124.974710:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5841 00002000:00100000:3.0:1746143124.974721:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009ad5bb80 x1830962858518272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.974730:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5bb80 with x1830962858518272 ext(4194304->5210111) 00002000:00010000:3.0:1746143124.974736:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5bb80 00000100:00100000:0.0:1746143124.979781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143124.979896:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858518528 00000100:00100000:3.0:1746143124.979904:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858518528 00002000:00100000:3.0:1746143124.979946:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009ad5ad80 x1830962858518528/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/0 e 0 to 0 dl 1746143135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.979955:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ad80 with x1830962858518528 ext(4194304->5210111) 00002000:00010000:3.0:1746143124.979960:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ad80 00000100:00100000:3.0:1746143124.979990:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5842 00000100:00100000:3.0:1746143124.979998:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858518528:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143124.990523:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858518528:12345-192.168.201.28@tcp:3:cat.0 Request processed in 10515us (10738us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143124.990534:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5842 00002000:00100000:3.0:1746143124.990545:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009ad5ad80 x1830962858518528/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:275/0 lens 488/440 e 0 to 0 dl 1746143135 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143124.990554:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ad80 with x1830962858518528 ext(4194304->5210111) 00002000:00010000:3.0:1746143124.990559:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ad80 00000100:00100000:0.0:1746143125.028259:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.028389:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858518656 00000100:00100000:1.0:1746143125.028399:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858518656 00000100:00100000:1.0:1746143125.028448:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12042 00000100:00100000:1.0:1746143125.028456:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30784:x1830962858518656:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143125.028472:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.028487:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164faaa expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.028513:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.028522:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.028528:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143125.028530:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143125.028533:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.028561:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.028572:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 18 pid: 21048 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143125.028584:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861198336:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143125.028689:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.028698:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 17 pid: 8449 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143125.028708:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861198464:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.028726:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.036306:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.036434:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858518784 00000100:00100000:2.0:1746143125.036443:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858518784 00010000:00010000:2.0:1746143125.036488:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 19 pid: 21048 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143125.036733:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6364 00000100:00080000:0.0:1746143125.036737:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143125.036743:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858518784:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.036755:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.036775:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 19 pid: 21048 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143125.036781:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861198336:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143125.036786:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 19 pid: 21048 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143125.036792:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861198464:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143125.036805:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c6f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa9c expref: 19 pid: 21048 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143125.036816:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.036831:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9d4e00, rc 0) 00000100:00100000:1.0:1746143125.036879:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:30784:x1830962858518656:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8423us (8627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143125.036887:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12042 00010000:00010000:2.0:1746143125.037016:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.037139:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858518784:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 398us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.037149:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6364 00000100:00100000:0.0:1746143125.037961:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.037999:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858518912 00000100:00100000:2.0:1746143125.038003:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858518912 00010000:00010000:2.0:1746143125.038020:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 17 pid: 8449 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143125.038068:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6365 00000100:00100000:2.0:1746143125.038074:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1971:x1830962858518912:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.038081:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.038091:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 17 pid: 8449 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143125.038100:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 17 pid: 8449 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143125.038114:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c6c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa79 expref: 17 pid: 8449 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143125.038122:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.038124:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.038130:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 16 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.038137:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 16 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.038164:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 16 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.038177:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861198592:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.038233:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.044128:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861198592:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.044149:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.044207:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858518912:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6132us (6246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.044217:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6365 00000100:00100000:0.0:1746143125.047495:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.047599:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858519168 00000100:00100000:3.0:1746143125.047608:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858519168 00002000:00100000:3.0:1746143125.047653:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4112384->4116479) req@ffff880090f21f80 x1830962858519168/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.047663:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21f80 with x1830962858519168 ext(4112384->4116479) 00002000:00010000:3.0:1746143125.047669:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21f80 00000100:00100000:3.0:1746143125.048116:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5843 00000100:00100000:3.0:1746143125.048125:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858519168:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143125.049607:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858519168:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1477us (2114us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143125.049617:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5843 00002000:00100000:3.0:1746143125.049627:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4112384->4116479) req@ffff880090f21f80 x1830962858519168/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/4536 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.049636:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21f80 with x1830962858519168 ext(4112384->4116479) 00002000:00010000:3.0:1746143125.049641:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21f80 00000100:00100000:0.0:1746143125.057306:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.057639:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858519296 00000100:00100000:1.0:1746143125.057650:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858519296 00000100:00100000:1.0:1746143125.057698:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12043 00000100:00100000:1.0:1746143125.057705:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:30784:x1830962858519296:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143125.057919:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.057938:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fab1 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.057971:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 19 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.057979:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.057987:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 32 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.058104:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143125.058106:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143125.058110:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->3796991] (req 3145728->3796991) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.058141:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 32 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.058152:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 32 pid: 26949 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143125.058165:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861198720:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143125.058661:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.058671:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 7 pid: 4756 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746143125.058680:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861198848:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143125.058719:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 19 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.058730:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 19 pid: 26949 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143125.058738:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861198976:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.058756:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.065984:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.066079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.066527:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861198720:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.066541:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861198848:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.066550:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861198976:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143125.066584:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->3796991] (req 3145728->3796991) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.066603:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9d5400, rc 0) 00000100:00100000:1.0:1746143125.066651:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:30784:x1830962858519296:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8945us (9356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143125.066660:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12043 00000100:00100000:0.0:1746143125.067120:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858519552 00000100:00100000:0.0:1746143125.067126:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858519552 00010000:00010000:0.0:1746143125.067154:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 8 pid: 4756 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143125.067183:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858519424 00000100:00100000:0.0:1746143125.067185:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858519424 00010000:00010000:0.0:1746143125.067194:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 32 pid: 26949 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143125.067207:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6366 00000100:00100000:0.0:1746143125.067213:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858519552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143125.067227:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143125.067250:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 8 pid: 4756 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143125.067259:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 8 pid: 4756 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143125.067281:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c28c00/0x25aee876ca70c51d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f953 expref: 8 pid: 4756 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143125.067296:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143125.067312:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858519552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 100us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143125.067318:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6366 00000100:00100000:0.0:1746143125.067329:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6367 00000100:00100000:0.0:1746143125.067334:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858519424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143125.067340:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143125.067346:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 32 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143125.067354:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 32 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143125.067376:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132009800/0x25aee876ca70c4f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f930 expref: 32 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143125.067384:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143125.067396:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858519424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 62us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143125.067400:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6367 00000100:00100000:0.0:1746143125.069271:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.073103:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858519680 00000100:00100000:3.0:1746143125.073117:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858519680 00010000:00010000:3.0:1746143125.073367:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 20 pid: 26949 timeout: 1006 lvb_type: 0 00000100:00080000:2.0:1746143125.073420:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143125.074052:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6368 00000100:00100000:3.0:1746143125.074062:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858519680:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143125.074077:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143125.074100:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 20 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143125.074117:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 20 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143125.074140:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70c459 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f8c7 expref: 20 pid: 26949 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143125.074161:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.074163:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.074170:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.074179:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.074215:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143125.074227:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861199104:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143125.075114:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143125.079815:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861199104:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143125.079841:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143125.079908:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858519680:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5845us (10639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.079919:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6368 00000100:00100000:0.0:1746143125.086781:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.087142:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858519936 00000100:00100000:3.0:1746143125.087153:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858519936 00002000:00100000:3.0:1746143125.087200:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3792896->3796991) req@ffff880090f20e00 x1830962858519936/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.087211:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20e00 with x1830962858519936 ext(3792896->3796991) 00002000:00010000:3.0:1746143125.087217:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f20e00 00000100:00100000:3.0:1746143125.087251:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5844 00000100:00100000:3.0:1746143125.087259:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858519936:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143125.087683:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858519936:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 424us (913us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143125.087690:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5844 00002000:00100000:3.0:1746143125.087696:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3792896->3796991) req@ffff880090f20e00 x1830962858519936/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/4536 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.087703:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20e00 with x1830962858519936 ext(3792896->3796991) 00002000:00010000:3.0:1746143125.087706:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f20e00 00000100:00100000:0.0:1746143125.106853:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.107664:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858520192 00000100:00100000:1.0:1746143125.107675:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858520192 00000100:00100000:1.0:1746143125.107934:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3411 00000100:00100000:1.0:1746143125.107943:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:30784:x1830962858520192:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143125.108224:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+217:30784:x1830962858520192:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 281us (1380us total) trans 8589942310 rc 0/0 00000100:00100000:1.0:1746143125.108231:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3411 00000100:00100000:0.0:1746143125.147437:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.147536:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858520448 00000100:00100000:2.0:1746143125.147546:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858520448 00002000:00100000:2.0:1746143125.147589:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880090f21880 x1830962858520448/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.147599:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21880 with x1830962858520448 ext(1048576->2097151) 00002000:00010000:2.0:1746143125.147604:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f21880 00000100:00100000:2.0:1746143125.147634:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5845 00000100:00100000:2.0:1746143125.147641:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858520448:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143125.165784:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858520448:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18130us (18345us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143125.165798:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5845 00002000:00100000:2.0:1746143125.165810:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880090f21880 x1830962858520448/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.165820:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21880 with x1830962858520448 ext(1048576->2097151) 00002000:00010000:2.0:1746143125.165826:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f21880 00000100:00100000:1.0:1746143125.189481:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.189523:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.189940:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.190043:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858520704 00000100:00100000:2.0:1746143125.190053:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858520704 00000100:00100000:1.0:1746143125.190080:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143125.190104:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800906a4000 x1830962858520704/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.190115:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a4000 with x1830962858520704 ext(2097152->3145727) 00002000:00010000:2.0:1746143125.190122:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a4000 00000100:00100000:3.0:1746143125.190150:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858520960 00000100:00100000:3.0:1746143125.190154:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858520960 00002000:00100000:3.0:1746143125.190177:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4112383) req@ffff8800906a4a80 x1830962858520960/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.190184:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a4a80 with x1830962858520960 ext(3145728->4112383) 00002000:00010000:3.0:1746143125.190188:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a4a80 00000100:00100000:0.0:1746143125.190211:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858521216 00000100:00100000:0.0:1746143125.190215:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858521216 00002000:00100000:0.0:1746143125.190234:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800906a5500 x1830962858521216/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143125.190242:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5500 with x1830962858521216 ext(2097152->3145727) 00002000:00010000:0.0:1746143125.190244:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a5500 00000100:00100000:0.0:1746143125.190262:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858521472 00000100:00100000:0.0:1746143125.190265:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858521472 00002000:00100000:0.0:1746143125.190281:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3796992->4194303) req@ffff8800906a7480 x1830962858521472/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143125.190287:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a7480 with x1830962858521472 ext(3796992->4194303) 00002000:00010000:0.0:1746143125.190290:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a7480 00000100:00100000:0.0:1746143125.190304:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5846 00000100:00100000:0.0:1746143125.190311:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858520704:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143125.190339:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5847 00000100:00100000:2.0:1746143125.190345:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858520960:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143125.190427:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5848 00000100:00100000:2.0:1746143125.190591:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5849 00000100:00100000:2.0:1746143125.190597:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858521472:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143125.192750:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858521216:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143125.216711:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858521472:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26099us (26616us total) trans 0 rc 397312/397312 00000100:00100000:3.0:1746143125.216726:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5849 00002000:00100000:3.0:1746143125.216740:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3796992->4194303) req@ffff8800906a7480 x1830962858521472/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 397312/397312 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.216758:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a7480 with x1830962858521472 ext(3796992->4194303) 00002000:00010000:3.0:1746143125.216765:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a7480 00000100:00100000:2.0:1746143125.216826:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858521216:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26391us (26885us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143125.216835:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5848 00002000:00100000:2.0:1746143125.216841:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800906a5500 x1830962858521216/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.216849:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5500 with x1830962858521216 ext(2097152->3145727) 00002000:00010000:2.0:1746143125.216853:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a5500 00000100:00100000:2.0:1746143125.232441:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858520960:12345-192.168.201.28@tcp:3:cat.0 Request processed in 42082us (42904us total) trans 0 rc 966656/966656 00000100:00100000:2.0:1746143125.232663:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5847 00002000:00100000:2.0:1746143125.232678:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4112383) req@ffff8800906a4a80 x1830962858520960/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 966656/966656 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.232689:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a4a80 with x1830962858520960 ext(3145728->4112383) 00002000:00010000:2.0:1746143125.232697:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a4a80 00000100:00100000:0.0:1746143125.235708:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.235803:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.235832:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858521600 00000100:00100000:0.0:1746143125.235841:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858521600 00000100:00100000:0.0:1746143125.235894:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858521728 00000100:00100000:0.0:1746143125.235897:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858521728 00000100:00100000:0.0:1746143125.235914:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12044 00000100:00100000:0.0:1746143125.235921:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30787:x1830962858521600:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:3.0:1746143125.235941:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12045 00010000:00010000:0.0:1746143125.235942:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143125.235950:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858521728:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143125.235958:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143125.235962:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fab8 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.235967:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce400/0x25aee876ca70c71c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fabf expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.235992:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.236001:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143125.236014:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861199232:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143125.236016:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 6 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143125.236023:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143125.236025:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143125.236047:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1216512->2097151] (req 1216512->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.236072:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 6 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143125.236085:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 6 pid: 4756 timeout: 1007 lvb_type: 1 00000100:00100000:0.0:1746143125.236096:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861199360:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143125.236103:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fc00 going to sleep for 11 seconds 00010000:00010000:0.0:1746143125.236130:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.236139:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 21 pid: 8449 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143125.236148:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861199488:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143125.236188:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.236202:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 17 pid: 26949 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143125.236209:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861199616:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143125.236238:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143125.240511:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.240709:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861199360:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.240719:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861199488:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.240727:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861199616:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143125.240759:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1216512->2097151] (req 1216512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.240777:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c29a00, rc 0) 00002000:00010000:3.0:1746143125.240799:0:754:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143123 -> 1746143124 00000100:00100000:1.0:1746143125.240818:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:30787:x1830962858521600:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4897us (5119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.240821:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861199232:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143125.240826:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12044 00010000:00010000:3.0:1746143125.241058:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce400/0x25aee876ca70c71c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fabf expref: 20 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143125.241065:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858521856 00010000:00010000:3.0:1746143125.241071:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce400/0x25aee876ca70c71c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fabf expref: 20 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143125.241071:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858521856 00010000:00010000:3.0:1746143125.241087:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50ce400, rc 0) 00000100:00100000:1.0:1746143125.241099:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12046 00000100:00100000:1.0:1746143125.241105:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858521856:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143125.241109:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858521728:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5160us (5306us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143125.241116:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12045 00010000:00010000:1.0:1746143125.241119:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.241133:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009051bc00/0x25aee876ca70c723 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fac6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143125.241172:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861199744:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143125.241227:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.242130:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858520704:12345-192.168.201.28@tcp:3:cat.0 Request processed in 51818us (52658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143125.242138:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5846 00002000:00100000:0.0:1746143125.242146:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800906a4000 x1830962858520704/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143125.242155:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a4000 with x1830962858520704 ext(2097152->3145727) 00002000:00010000:0.0:1746143125.242160:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a4000 00000100:00100000:0.0:1746143125.244654:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.244678:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.244827:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858522112 00000100:00100000:0.0:1746143125.244833:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.244835:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858522112 00010000:00010000:2.0:1746143125.244873:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 19 pid: 8449 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.244907:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858521984 00000100:00100000:2.0:1746143125.244910:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858521984 00000100:00100000:1.0:1746143125.244914:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858522240 00000100:00100000:1.0:1746143125.244918:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858522240 00010000:00010000:2.0:1746143125.244921:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 7 pid: 4756 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143125.244969:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 16 pid: 26949 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.245089:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6369 00000100:00100000:2.0:1746143125.245097:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858522112:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.245110:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.245133:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 19 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.245143:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 19 pid: 8449 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143125.245149:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6370 00000100:00100000:0.0:1746143125.245157:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858521984:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143125.245165:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.245166:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c6dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa8e expref: 19 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143125.245176:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 7 pid: 4756 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143125.245185:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.245217:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858522112:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 121us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.245223:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6369 00000100:00100000:2.0:1746143125.245236:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6371 00000100:00100000:2.0:1746143125.245241:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858522240:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.245247:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.245253:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 16 pid: 26949 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.245261:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 16 pid: 26949 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.245273:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70c619 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa09 expref: 16 pid: 26949 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.245280:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.245293:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858522240:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.245298:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6371 00010000:00010000:0.0:1746143125.246131:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 7 pid: 4756 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143125.246148:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094efb400/0x25aee876ca70c6b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa6b expref: 7 pid: 4756 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143125.246161:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143125.246163:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143125.246169:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.246177:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.246223:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143125.246235:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861199872:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143125.246291:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0240 going to sleep for 11 seconds 00002000:00010000:1.0:1746143125.246340:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143122 -> 1746143123 00002000:00010000:1.0:1746143125.246343:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143122 -> 1746143124 00002000:00010000:1.0:1746143125.246345:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143122 -> 1746143123 00000100:00100000:1.0:1746143125.246369:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861199744:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143125.246396:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009051bc00/0x25aee876ca70c723 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fac6 expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.246408:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009051bc00/0x25aee876ca70c723 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fac6 expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.246430:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009051bc00, rc 0) 00000100:00100000:1.0:1746143125.246454:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858521856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5348us (5952us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143125.246460:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12046 00000100:00100000:2.0:1746143125.251628:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861199872:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.251659:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.251716:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858521984:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6559us (7035us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.251728:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6370 00000100:00100000:0.0:1746143125.252971:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.253027:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858522496 00000100:00100000:2.0:1746143125.253057:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858522496 00002000:00100000:2.0:1746143125.253100:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1216512->1220607) req@ffff8800a5b11180 x1830962858522496/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.253110:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b11180 with x1830962858522496 ext(1216512->1220607) 00002000:00010000:2.0:1746143125.253116:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b11180 00000100:00100000:0.0:1746143125.253119:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.253192:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5850 00000100:00100000:2.0:1746143125.253200:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858522496:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143125.254469:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858522496:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1266us (1498us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143125.254478:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5850 00002000:00100000:2.0:1746143125.254485:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1216512->1220607) req@ffff8800a5b11180 x1830962858522496/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/4536 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.254493:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b11180 with x1830962858522496 ext(1216512->1220607) 00002000:00010000:2.0:1746143125.254498:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b11180 00000100:00100000:1.0:1746143125.254788:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858522624 00000100:00100000:1.0:1746143125.254793:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858522624 00000100:00100000:1.0:1746143125.254820:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12047 00000100:00100000:1.0:1746143125.254825:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858522624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143125.254837:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.254855:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c72a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164facd expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143125.254917:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861200000:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143125.255130:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.256566:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.256614:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858522752 00000100:00100000:2.0:1746143125.256620:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858522752 00000100:00100000:2.0:1746143125.259004:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12048 00000100:00100000:2.0:1746143125.259023:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858522752:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.259058:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.259079:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fb5600/0x25aee876ca70c731 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fad4 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.259341:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861200128:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143125.264591:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861200000:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143125.264639:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c72a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164facd expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143125.264654:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3d9a00/0x25aee876ca70c72a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164facd expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143125.264683:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3d9a00, rc 0) 00000100:00100000:3.0:1746143125.265083:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.265119:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858522880 00000100:00100000:3.0:1746143125.265126:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858522880 00000100:00100000:3.0:1746143125.265158:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12049 00000100:00100000:3.0:1746143125.265165:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858522880:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143125.265178:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143125.265192:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec89800/0x25aee876ca70c738 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fadb expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143125.265235:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861200256:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143125.265278:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.266054:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858522624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11226us (12933us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143125.266060:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12047 00000100:00100000:2.0:1746143125.266494:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.270679:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.270745:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858523008 00000100:00100000:2.0:1746143125.270754:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858523008 00000100:00100000:2.0:1746143125.270799:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12050 00000100:00100000:2.0:1746143125.270807:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30787:x1830962858523008:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143125.270825:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.270844:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fae2 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.270878:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 16 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.270892:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143125.270894:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143125.270897:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->2256895] (req 2097152->2256895) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.270927:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 16 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.270939:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 16 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.270948:0:4756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143123 -> 1746143124 00000100:00100000:2.0:1746143125.270951:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861200384:192.168.201.28@tcp:104: 00002000:00010000:3.0:1746143125.270952:0:4756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143123 -> 1746143124 00002000:00010000:3.0:1746143125.270955:0:4756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143123 -> 1746143124 00000100:00100000:3.0:1746143125.270977:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861200256:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143125.271015:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec89800/0x25aee876ca70c738 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fadb expref: 16 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.271027:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec89800/0x25aee876ca70c738 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fadb expref: 16 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143125.271028:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76480 going to sleep for 11 seconds 00010000:00010000:3.0:1746143125.271064:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec89800, rc 0) 00000100:00100000:3.0:1746143125.271094:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858522880:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5928us (6012us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143125.271100:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12049 00000100:00100000:2.0:1746143125.271171:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861200128:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143125.271196:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fb5600/0x25aee876ca70c731 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fad4 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.271207:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fb5600/0x25aee876ca70c731 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fad4 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.271219:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fb5600, rc 0) 00000100:00100000:2.0:1746143125.271240:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858522752:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12225us (14678us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.271246:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12048 00000100:00100000:2.0:1746143125.277469:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861200384:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143125.277512:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->2256895] (req 2097152->2256895) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.277531:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f6c000, rc 0) 00000100:00100000:2.0:1746143125.277592:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30787:x1830962858523008:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6784us (6923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.277601:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12050 00000100:00100000:0.0:1746143125.282781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.283023:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858523136 00000100:00100000:0.0:1746143125.283024:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.283057:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858523136 00000100:00100000:0.0:1746143125.283099:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143125.283108:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (4112384->4194303) req@ffff8800a5b11f80 x1830962858523136/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.283119:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b11f80 with x1830962858523136 ext(4112384->4194303) 00010000:00010000:2.0:1746143125.283131:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 15 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.283145:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 15 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143125.283152:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5b11f80 00000100:00100000:2.0:1746143125.283170:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858523392 00000100:00100000:2.0:1746143125.283173:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858523392 00002000:00100000:2.0:1746143125.283185:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->1216511) req@ffff8800a5b12300 x1830962858523392/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.283197:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b12300 with x1830962858523392 ext(1048576->1216511) 00002000:00010000:2.0:1746143125.283201:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b12300 00000100:00100000:3.0:1746143125.283222:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1933 00000100:00100000:3.0:1746143125.283233:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858523136:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143125.283267:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5851 00000100:00100000:2.0:1746143125.283273:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858523392:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143125.283645:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858523520 00000100:00100000:2.0:1746143125.283649:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858523520 00000100:00100000:2.0:1746143125.283677:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12051 00000100:00100000:2.0:1746143125.283683:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:30795:x1830962858523520:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.283692:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.283706:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fae9 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.283726:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143125.283728:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143125.283732:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.283743:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.283759:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f6c200, rc 0) 00000100:00100000:2.0:1746143125.284793:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30795:x1830962858523520:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1104us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.284802:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12051 00000100:00100000:2.0:1746143125.288576:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858523392:12345-192.168.201.28@tcp:3:cat.0 Request processed in 5289us (5542us total) trans 0 rc 167936/167936 00000100:00100000:2.0:1746143125.288592:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5851 00002000:00100000:2.0:1746143125.288603:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->1216511) req@ffff8800a5b12300 x1830962858523392/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 167936/167936 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.288614:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b12300 with x1830962858523392 ext(1048576->1216511) 00002000:00010000:2.0:1746143125.288621:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b12300 00000100:00100000:3.0:1746143125.290223:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858523136:12345-192.168.201.28@tcp:4:cat.0 Request processed in 6987us (7473us total) trans 21474839959 rc 0/0 00000100:00100000:3.0:1746143125.290233:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1933 00002000:00100000:3.0:1746143125.290240:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4112384->4194303) req@ffff8800a5b11f80 x1830962858523136/t21474839959(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/448 e 0 to 0 dl 1746143136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.290250:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b11f80 with x1830962858523136 ext(4112384->4194303) 00010000:00010000:3.0:1746143125.290260:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 18 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.290278:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 18 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.290285:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5b11f80 00000100:00100000:0.0:1746143125.295325:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.295633:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858523648 00000100:00100000:2.0:1746143125.295643:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858523648 00010000:00010000:2.0:1746143125.295678:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 18 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.295707:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6372 00000100:00100000:2.0:1746143125.295714:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858523648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.295728:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143125.295747:0:4759:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143123 -> 1746143124 00010000:00010000:2.0:1746143125.295753:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 18 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.295765:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 18 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.295788:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9d4e00/0x25aee876ca70c707 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faaa expref: 18 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.295913:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.295915:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.295923:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.295931:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.295940:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.295941:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.295944:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.295951:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.295980:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.295990:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861200512:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.296550:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.296560:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861200640:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.296583:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.300835:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.300868:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.300962:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861200512:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.300973:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861200640:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.300999:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143125.301048:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.301051:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858523776 00000100:00100000:3.0:1746143125.301058:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858523776 00000100:00100000:2.0:1746143125.301069:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858523648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5354us (5753us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.301081:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6372 00000100:00100000:3.0:1746143125.301097:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858523904 00000100:00100000:3.0:1746143125.301100:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858523904 00000100:00100000:3.0:1746143125.301114:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12052 00000100:00100000:3.0:1746143125.301121:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858523776:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:2.0:1746143125.301122:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12053 00000100:00100000:2.0:1746143125.301129:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858523904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143125.301138:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.301139:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.301154:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f6c400/0x25aee876ca70c754 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164faf7 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.301155:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b66d400/0x25aee876ca70c74d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164faf0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.301185:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b66d400/0x25aee876ca70c74d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faf0 expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.301200:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b66d400/0x25aee876ca70c74d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faf0 expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143125.301205:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861200768:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143125.301223:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b66d400, rc 0) 00000100:00100000:3.0:1746143125.301354:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858523776:12345-192.168.201.28@tcp:101:cat.0 Request processed in 232us (528us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143125.301370:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12052 00000100:00100000:2.0:1746143125.301379:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143125.301393:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858524160 00000100:00100000:3.0:1746143125.301396:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858524160 00002000:00100000:3.0:1746143125.301421:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a5b13480 x1830962858524160/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.301430:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b13480 with x1830962858524160 ext(4194304->5210111) 00002000:00010000:3.0:1746143125.301435:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b13480 00000100:00100000:3.0:1746143125.301447:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5852 00000100:00100000:3.0:1746143125.301453:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858524160:12345-192.168.201.28@tcp:3:cat.0 00002000:00010000:2.0:1746143125.303848:0:21048:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143123 -> 1746143124 00002000:00010000:2.0:1746143125.303855:0:21048:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143123 -> 1746143124 00000100:00100000:2.0:1746143125.303874:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861200768:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143125.303899:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092f6c400/0x25aee876ca70c754 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faf7 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.303913:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f6c400/0x25aee876ca70c754 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faf7 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.303935:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f6c400, rc 0) 00000100:00100000:2.0:1746143125.303965:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858523904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2836us (3096us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.303972:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12053 00000100:00100000:0.0:1746143125.309283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.309795:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858524416 00000100:00100000:2.0:1746143125.309804:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858524416 00002000:00100000:2.0:1746143125.309852:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2252800->2256895) req@ffff8800a5b13800 x1830962858524416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.309863:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b13800 with x1830962858524416 ext(2252800->2256895) 00002000:00010000:2.0:1746143125.309869:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b13800 00000100:00100000:2.0:1746143125.310249:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5853 00000100:00100000:2.0:1746143125.310258:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858524416:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143125.311227:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858524416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 968us (1955us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143125.311234:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5853 00002000:00100000:2.0:1746143125.311241:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2252800->2256895) req@ffff8800a5b13800 x1830962858524416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/4536 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.311249:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b13800 with x1830962858524416 ext(2252800->2256895) 00002000:00010000:2.0:1746143125.311252:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b13800 00000100:00100000:3.0:1746143125.313670:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858524160:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12207us (12614us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143125.313682:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5852 00002000:00100000:3.0:1746143125.313690:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a5b13480 x1830962858524160/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.313699:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b13480 with x1830962858524160 ext(4194304->5210111) 00002000:00010000:3.0:1746143125.313705:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b13480 00000100:00100000:0.0:1746143125.324844:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.324899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.324958:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858524544 00000100:00100000:2.0:1746143125.324967:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858524544 00000100:00100000:2.0:1746143125.325009:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858524672 00000100:00100000:2.0:1746143125.325012:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858524672 00000100:00100000:2.0:1746143125.325064:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12054 00000100:00100000:2.0:1746143125.325072:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858524544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.325090:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.325108:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f6d800/0x25aee876ca70c75b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fafe expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.325166:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861200896:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143125.325248:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.325380:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12055 00000100:00100000:2.0:1746143125.325387:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858524672:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.325393:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.325400:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f6ce00/0x25aee876ca70c762 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb05 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.325419:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f6ce00/0x25aee876ca70c762 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb05 expref: 20 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.325427:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f6ce00/0x25aee876ca70c762 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb05 expref: 20 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.325443:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f6ce00, rc 0) 00000100:00100000:2.0:1746143125.325469:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858524672:12345-192.168.201.28@tcp:101:cat.0 Request processed in 83us (569us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.325475:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12055 00000100:00100000:2.0:1746143125.329782:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.331130:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858524928 00000100:00100000:3.0:1746143125.331141:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858524928 00002000:00100000:3.0:1746143125.331189:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2256896->3145727) req@ffff880094511c00 x1830962858524928/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.331199:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511c00 with x1830962858524928 ext(2256896->3145727) 00002000:00010000:3.0:1746143125.331204:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094511c00 00000100:00100000:3.0:1746143125.331238:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5854 00000100:00100000:3.0:1746143125.331246:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858524928:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143125.334251:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861200896:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143125.334290:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f6d800/0x25aee876ca70c75b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fafe expref: 18 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143125.334305:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f6d800/0x25aee876ca70c75b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fafe expref: 18 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143125.334329:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f6d800, rc 0) 00000100:00100000:0.0:1746143125.334385:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858524544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9313us (9552us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143125.334398:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12054 00000100:00100000:3.0:1746143125.343178:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858524928:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11919us (13394us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746143125.343193:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5854 00002000:00100000:3.0:1746143125.343205:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2256896->3145727) req@ffff880094511c00 x1830962858524928/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.343216:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511c00 with x1830962858524928 ext(2256896->3145727) 00002000:00010000:3.0:1746143125.343222:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094511c00 00000100:00100000:0.0:1746143125.347772:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.347824:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.347968:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858525056 00000100:00100000:1.0:1746143125.347968:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858525184 00000100:00100000:2.0:1746143125.347977:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858525056 00000100:00100000:1.0:1746143125.347977:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858525184 00000100:00100000:1.0:1746143125.348060:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12056 00000100:00100000:2.0:1746143125.348065:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12057 00000100:00100000:1.0:1746143125.348068:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858525184:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:2.0:1746143125.348071:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858525056:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.348587:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.348606:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f408000/0x25aee876ca70c769 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb0c expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.348662:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861201024:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143125.348749:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00010000:00010000:1.0:1746143125.348797:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.348806:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f8b400/0x25aee876ca70c770 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb13 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.348826:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f8b400/0x25aee876ca70c770 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb13 expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.348837:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f8b400/0x25aee876ca70c770 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb13 expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.348854:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f8b400, rc 0) 00000100:00100000:1.0:1746143125.348878:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858525184:12345-192.168.201.28@tcp:101:cat.0 Request processed in 811us (1053us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143125.348884:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12056 00000100:00100000:0.0:1746143125.349380:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.349692:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858525312 00000100:00100000:1.0:1746143125.349696:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858525312 00000100:00100000:1.0:1746143125.349716:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12058 00000100:00100000:1.0:1746143125.349720:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30798:x1830962858525312:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143125.349728:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.349741:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb1a expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.349760:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.349767:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143125.349768:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143125.349771:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.349791:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 30 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.349804:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 30 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143125.349812:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861201152:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.349852:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143125.354694:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861201152:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143125.354727:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.354745:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f8b600, rc 0) 00000100:00100000:1.0:1746143125.354787:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30798:x1830962858525312:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5065us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143125.354796:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12058 00000100:00100000:2.0:1746143125.354893:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861201024:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143125.354917:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f408000/0x25aee876ca70c769 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb0c expref: 18 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.354927:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f408000/0x25aee876ca70c769 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb0c expref: 18 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.354953:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408000, rc 0) 00000100:00100000:2.0:1746143125.354973:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858525056:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6902us (7212us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.354978:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12057 00000100:00100000:0.0:1746143125.357023:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.357152:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858525440 00000100:00100000:3.0:1746143125.357161:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858525440 00002000:00100000:3.0:1746143125.357206:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3796991) req@ffff8800a5b12680 x1830962858525440/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.357216:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b12680 with x1830962858525440 ext(3145728->3796991) 00010000:00010000:3.0:1746143125.357226:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 31 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.357239:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 31 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.357252:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b12680 00000100:00100000:3.0:1746143125.357285:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1934 00000100:00100000:3.0:1746143125.357293:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858525440:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143125.369085:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.372653:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858525696 00000100:00100000:2.0:1746143125.372669:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858525696 00000100:00100000:2.0:1746143125.372732:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8100 00000100:00100000:2.0:1746143125.372741:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+217:30801:x1830962858525696:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143125.372766:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.372787:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408600/0x25aee876ca70c77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb21 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.372886:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143125.372902:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143125.372915:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143125.372930:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143125.373059:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408600/0x25aee876ca70c77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 220 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.373088:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 219 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.373097:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143125.373100:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143125.373103:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408800, rc 0) 00000100:00100000:2.0:1746143125.373161:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+219:30801:x1830962858525696:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 420us (4089us total) trans 8589942311 rc 0/0 00000100:00100000:2.0:1746143125.373168:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8100 00000100:00100000:3.0:1746143125.376488:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858525440:12345-192.168.201.28@tcp:4:cat.0 Request processed in 19186us (19465us total) trans 17179872706 rc 0/0 00000100:00100000:3.0:1746143125.376502:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1934 00002000:00100000:3.0:1746143125.376512:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3796991) req@ffff8800a5b12680 x1830962858525440/t17179872706(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/448 e 0 to 0 dl 1746143136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.376523:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b12680 with x1830962858525440 ext(3145728->3796991) 00010000:00010000:3.0:1746143125.376535:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 33 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.376550:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 33 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.376558:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b12680 00000100:00100000:1.0:1746143125.392406:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.392688:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858525824 00000100:00100000:2.0:1746143125.392696:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858525824 00010000:00010000:2.0:1746143125.392727:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 33 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.392757:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6373 00000100:00100000:2.0:1746143125.392763:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858525824:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.392774:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.392968:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 33 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.392977:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 33 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.393004:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9d5400/0x25aee876ca70c70e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3796991) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab1 expref: 33 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.393025:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.393027:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.393044:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.393054:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.393083:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.393093:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861201280:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.393156:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.404101:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861201280:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.404127:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.404203:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1971:x1830962858525824:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11436us (11804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.404215:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6373 00000100:00100000:0.0:1746143125.406984:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.407025:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.407098:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.407216:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858526080 00000100:00100000:2.0:1746143125.407226:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858526080 00002000:00100000:2.0:1746143125.407273:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800a5b12d80 x1830962858526080/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.407291:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b12d80 with x1830962858526080 ext(2097152->3145727) 00002000:00010000:2.0:1746143125.407297:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b12d80 00000100:00100000:2.0:1746143125.407313:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858526336 00000100:00100000:2.0:1746143125.407316:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858526336 00002000:00100000:2.0:1746143125.407329:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5b13100 x1830962858526336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.407335:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b13100 with x1830962858526336 ext(3145728->4194303) 00002000:00010000:2.0:1746143125.407338:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b13100 00000100:00100000:2.0:1746143125.407348:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858526592 00000100:00100000:2.0:1746143125.407350:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858526592 00002000:00100000:2.0:1746143125.407374:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5b10e00 x1830962858526592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.407380:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b10e00 with x1830962858526592 ext(3145728->4194303) 00002000:00010000:2.0:1746143125.407384:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b10e00 00000100:00100000:2.0:1746143125.407397:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5855 00000100:00100000:2.0:1746143125.407403:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858526080:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143125.408146:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5856 00000100:00100000:1.0:1746143125.408155:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858526336:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143125.410211:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5857 00000100:00100000:2.0:1746143125.410222:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858526592:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143125.427087:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858526080:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19670us (20097us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143125.427101:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5855 00002000:00100000:2.0:1746143125.427113:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800a5b12d80 x1830962858526080/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.427129:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b12d80 with x1830962858526080 ext(2097152->3145727) 00002000:00010000:2.0:1746143125.427135:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b12d80 00000100:00100000:2.0:1746143125.436841:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858526336:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28675us (29801us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143125.436856:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5856 00002000:00100000:2.0:1746143125.436868:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5b13100 x1830962858526336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.436879:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b13100 with x1830962858526336 ext(3145728->4194303) 00002000:00010000:2.0:1746143125.436885:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b13100 00000100:00100000:0.0:1746143125.443620:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858526592:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33386us (36507us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143125.443635:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5857 00002000:00100000:0.0:1746143125.443650:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5b10e00 x1830962858526592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143125.443661:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b10e00 with x1830962858526592 ext(3145728->4194303) 00002000:00010000:0.0:1746143125.443668:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b10e00 00000100:00100000:0.0:1746143125.456334:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.457266:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858526720 00000100:00100000:2.0:1746143125.457276:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858526720 00000100:00100000:2.0:1746143125.457334:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12059 00000100:00100000:2.0:1746143125.457342:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858526720:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.457370:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.457389:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f408e00/0x25aee876ca70c793 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb28 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.457424:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f408e00/0x25aee876ca70c793 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb28 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.457435:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f408e00/0x25aee876ca70c793 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb28 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.457463:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408e00, rc 0) 00000100:00100000:2.0:1746143125.457507:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858526720:12345-192.168.201.28@tcp:101:cat.0 Request processed in 166us (1187us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.457513:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12059 00000100:00100000:0.0:1746143125.462100:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.462149:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858526848 00000100:00100000:2.0:1746143125.462159:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858526848 00000100:00100000:2.0:1746143125.462214:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12060 00000100:00100000:2.0:1746143125.462222:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30798:x1830962858526848:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.462242:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.462261:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb2f expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.462290:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.462293:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.462300:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.462316:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.462326:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f409000, rc 0) 00000100:00100000:2.0:1746143125.462382:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30798:x1830962858526848:12345-192.168.201.28@tcp:101:cat.0 Request processed in 160us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.462388:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12060 00000100:00100000:0.0:1746143125.471317:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.471398:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858527104 00000100:00100000:2.0:1746143125.471409:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858527104 00002000:00100000:2.0:1746143125.471460:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093b5b800 x1830962858527104/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.471477:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5b800 with x1830962858527104 ext(4194304->5210111) 00002000:00010000:2.0:1746143125.471483:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5b800 00000100:00100000:2.0:1746143125.471515:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5858 00000100:00100000:2.0:1746143125.471524:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858527104:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143125.488481:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858527104:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16945us (17164us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143125.488494:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5858 00002000:00100000:3.0:1746143125.488506:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093b5b800 x1830962858527104/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.488516:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5b800 with x1830962858527104 ext(4194304->5210111) 00002000:00010000:3.0:1746143125.488522:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5b800 00000100:00100000:0.0:1746143125.493853:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.493961:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858527232 00000100:00100000:1.0:1746143125.493971:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858527232 00000100:00100000:1.0:1746143125.494074:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12061 00000100:00100000:1.0:1746143125.494084:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858527232:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143125.494104:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.494135:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a542ca00/0x25aee876ca70c7a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb36 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.494172:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a542ca00/0x25aee876ca70c7a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb36 expref: 21 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.494183:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a542ca00/0x25aee876ca70c7a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb36 expref: 21 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.498824:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a542ca00, rc 0) 00000100:00100000:1.0:1746143125.498901:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858527232:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4815us (5055us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143125.498911:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12061 00010000:00010000:0.0:1746143125.503218:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143125.504155:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.504236:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858527360 00000100:00100000:2.0:1746143125.504252:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858527360 00000100:00100000:2.0:1746143125.504619:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12062 00000100:00100000:2.0:1746143125.504629:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858527360:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.504647:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.504665:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f409400/0x25aee876ca70c7a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb3d expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.504700:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f409400/0x25aee876ca70c7a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb3d expref: 21 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.504712:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f409400/0x25aee876ca70c7a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb3d expref: 21 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.504824:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f409400, rc 0) 00000100:00100000:2.0:1746143125.506205:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858527360:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1573us (2055us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.506214:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12062 00000100:00100000:0.0:1746143125.536305:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.536448:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858527488 00000100:00100000:2.0:1746143125.536459:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858527488 00000100:00100000:2.0:1746143125.536647:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12063 00000100:00100000:2.0:1746143125.536659:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858527488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.536679:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.536700:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f409600/0x25aee876ca70c7af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb44 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.536757:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861201408:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143125.536849:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.538495:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.538545:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143125.538633:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858527744 00000100:00100000:1.0:1746143125.538640:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858527744 00000100:00100000:1.0:1746143125.538685:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858527616 00000100:00100000:1.0:1746143125.538688:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858527616 00000100:00100000:1.0:1746143125.538705:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12064 00000100:00100000:1.0:1746143125.538713:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858527744:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143125.538725:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.538739:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb52 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.538757:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143125.538759:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143125.538767:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 33 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.538782:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 33 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.538794:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a542d000, rc 0) 00000100:00100000:1.0:1746143125.538829:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858527744:12345-192.168.201.28@tcp:101:cat.0 Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143125.538835:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12064 00000100:00100000:1.0:1746143125.538850:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12065 00000100:00100000:1.0:1746143125.538854:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858527616:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143125.538862:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143125.538870:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a542cc00/0x25aee876ca70c7bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb4b expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.538890:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a542cc00/0x25aee876ca70c7bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb4b expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.538898:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a542cc00/0x25aee876ca70c7bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb4b expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143125.538913:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a542cc00, rc 0) 00000100:00100000:1.0:1746143125.538929:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858527616:12345-192.168.201.28@tcp:101:cat.0 Request processed in 74us (384us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143125.538935:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12065 00000100:00100000:3.0:1746143125.539839:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861201408:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143125.539867:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f409600/0x25aee876ca70c7af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb44 expref: 18 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.539975:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f409600/0x25aee876ca70c7af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb44 expref: 18 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.540022:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f409600, rc 0) 00000100:00100000:3.0:1746143125.540111:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858527488:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3454us (3818us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143125.540118:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12063 00000100:00100000:0.0:1746143125.584094:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.586214:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858527872 00000100:00100000:3.0:1746143125.586226:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858527872 00000100:00100000:3.0:1746143125.586295:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12066 00000100:00100000:3.0:1746143125.586304:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:30806:x1830962858527872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143125.586321:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143125.586338:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb59 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.586379:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.586387:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143125.586389:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143125.586392:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.586428:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.586649:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 19 pid: 8449 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143125.586662:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861201536:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143125.587981:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143125.591992:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861201536:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143125.592026:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.592086:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be4e400, rc 0) 00000100:00100000:3.0:1746143125.592144:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30806:x1830962858527872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5839us (8061us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.592155:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12066 00000100:00100000:0.0:1746143125.593368:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.593524:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858528000 00000100:00100000:3.0:1746143125.593533:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858528000 00002000:00100000:3.0:1746143125.593577:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1216512->2097151) req@ffff880090f23480 x1830962858528000/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.593589:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23480 with x1830962858528000 ext(1216512->2097151) 00010000:00010000:3.0:1746143125.593599:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 20 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.593620:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 20 pid: 8449 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.593629:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090f23480 00000100:00100000:3.0:1746143125.593649:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1935 00000100:00100000:3.0:1746143125.593657:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858528000:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143125.624641:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.624707:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858528128 00000100:00100000:2.0:1746143125.624718:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858528128 00000100:00100000:2.0:1746143125.624772:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12067 00000100:00100000:2.0:1746143125.624781:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:30801:x1830962858528128:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143125.624799:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.625028:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb60 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.625077:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.625085:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 34 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.625091:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.625093:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.625096:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 34 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.625126:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 34 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.625138:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 34 pid: 4756 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143125.625149:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861201664:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143125.625250:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.625257:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 19 pid: 4756 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.625264:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861201792:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143125.625284:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143125.627221:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858528000:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 33558us (33864us total) trans 21474839960 rc 0/0 00000100:00100000:3.0:1746143125.627232:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1935 00002000:00100000:3.0:1746143125.627242:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1216512->2097151) req@ffff880090f23480 x1830962858528000/t21474839960(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/448 e 0 to 0 dl 1746143136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.627251:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23480 with x1830962858528000 ext(1216512->2097151) 00010000:00010000:3.0:1746143125.627259:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 22 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.627270:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 22 pid: 8449 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.627277:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090f23480 00000100:00100000:2.0:1746143125.631796:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861201664:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143125.631811:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861201792:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143125.631843:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 34 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.631863:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f409600, rc 0) 00000100:00100000:2.0:1746143125.633102:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:30801:x1830962858528128:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8314us (8463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.633113:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12067 00000100:00100000:0.0:1746143125.633623:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.633818:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858528256 00000100:00100000:2.0:1746143125.633824:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858528256 00010000:00010000:2.0:1746143125.633852:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 34 pid: 4756 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143125.633877:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6374 00000100:00100000:2.0:1746143125.633882:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858528256:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.633894:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.633915:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 34 pid: 4756 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143125.633925:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 34 pid: 4756 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143125.633945:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a542d000/0x25aee876ca70c7b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb52 expref: 34 pid: 4756 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143125.634580:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143125.634640:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.634817:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858528256:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 933us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.634823:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6374 00000100:00100000:2.0:1746143125.634862:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858528384 00000100:00100000:2.0:1746143125.634865:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858528384 00010000:00010000:2.0:1746143125.634876:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 22 pid: 8449 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.635202:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6375 00000100:00100000:2.0:1746143125.635209:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858528384:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.635217:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.635233:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 22 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.635241:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 22 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.635257:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c29a00/0x25aee876ca70c715 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fab8 expref: 22 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.635267:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.635269:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.635277:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.635285:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.635317:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.635328:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861201920:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.635882:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.641498:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861201920:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.641747:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.641811:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858528384:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6602us (7171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.641822:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6375 00000100:00100000:0.0:1746143125.643167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.643246:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.643338:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858528768 00000100:00100000:3.0:1746143125.643345:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858528768 00002000:00100000:3.0:1746143125.643398:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008e190380 x1830962858528768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.643408:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190380 with x1830962858528768 ext(1048576->2097151) 00002000:00010000:3.0:1746143125.643415:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e190380 00000100:00100000:3.0:1746143125.643429:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5859 00000100:00100000:3.0:1746143125.643436:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858528768:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143125.644181:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858528512 00000100:00100000:2.0:1746143125.644186:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858528512 00010000:00010000:2.0:1746143125.644209:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 20 pid: 4756 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.644237:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6376 00000100:00100000:2.0:1746143125.644241:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858528512:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.644251:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.644268:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 20 pid: 4756 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.644280:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 20 pid: 4756 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.644301:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f8b600/0x25aee876ca70c777 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb1a expref: 20 pid: 4756 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.644316:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.644318:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.644324:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.644333:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.644373:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.644608:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861202048:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.644670:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.646832:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861202048:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.646850:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.647521:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858528512:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3275us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.647534:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6376 00000100:00100000:0.0:1746143125.652661:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.652742:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858529024 00000100:00100000:2.0:1746143125.652750:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858529024 00002000:00100000:2.0:1746143125.652964:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2412544->2416639) req@ffff88008e190700 x1830962858529024/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.652976:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190700 with x1830962858529024 ext(2412544->2416639) 00002000:00010000:2.0:1746143125.652982:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e190700 00000100:00100000:2.0:1746143125.653001:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5860 00000100:00100000:2.0:1746143125.653007:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858529024:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143125.653623:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858529024:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 613us (970us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143125.653631:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5860 00002000:00100000:2.0:1746143125.653638:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2412544->2416639) req@ffff88008e190700 x1830962858529024/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/4536 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.653644:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190700 with x1830962858529024 ext(2412544->2416639) 00002000:00010000:2.0:1746143125.653647:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e190700 00000100:00100000:3.0:1746143125.656464:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858528768:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 13020us (13209us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143125.656475:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5859 00002000:00100000:3.0:1746143125.656484:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008e190380 x1830962858528768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.656494:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190380 with x1830962858528768 ext(1048576->2097151) 00002000:00010000:3.0:1746143125.656499:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e190380 00000100:00100000:0.0:1746143125.660645:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.660774:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858529152 00000100:00100000:2.0:1746143125.660784:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858529152 00000100:00100000:2.0:1746143125.660830:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12068 00000100:00100000:2.0:1746143125.660843:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30806:x1830962858529152:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.660906:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.660924:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb67 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.660955:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.660961:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143125.660963:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143125.660966:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.660993:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.661004:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 20 pid: 8449 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.661018:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861202176:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143125.661695:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.662923:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.663391:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861202176:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143125.663418:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.663432:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f409a00, rc 0) 00000100:00100000:3.0:1746143125.663466:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30806:x1830962858529152:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2624us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.663474:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12068 00000100:00100000:2.0:1746143125.663509:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858529280 00000100:00100000:2.0:1746143125.663515:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858529280 00000100:00100000:2.0:1746143125.663551:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12069 00000100:00100000:2.0:1746143125.663557:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30801:x1830962858529280:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143125.663571:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.663584:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb6e expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.663601:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143125.663602:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143125.663606:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->3260415] (req 3145728->3260415) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.663614:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->3260415] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.663621:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408200, rc 0) 00000100:00100000:2.0:1746143125.663844:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30801:x1830962858529280:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 286us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.663850:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12069 00000100:00100000:0.0:1746143125.663921:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.663986:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858529408 00000100:00100000:3.0:1746143125.663989:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858529408 00002000:00100000:3.0:1746143125.664017:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2256895) req@ffff88008e191180 x1830962858529408/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.664027:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191180 with x1830962858529408 ext(2097152->2256895) 00010000:00010000:3.0:1746143125.664050:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 21 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.664062:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 21 pid: 8449 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.664068:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e191180 00000100:00100000:3.0:1746143125.664082:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1936 00000100:00100000:3.0:1746143125.664092:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858529408:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:3.0:1746143125.668911:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858529408:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 4809us (4980us total) trans 21474839961 rc 0/0 00000100:00100000:3.0:1746143125.668920:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1936 00002000:00100000:3.0:1746143125.668928:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2256895) req@ffff88008e191180 x1830962858529408/t21474839961(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/448 e 0 to 0 dl 1746143136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.668934:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191180 with x1830962858529408 ext(2097152->2256895) 00010000:00010000:3.0:1746143125.668943:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 23 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.668955:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 23 pid: 8449 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.668961:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e191180 00000100:00100000:0.0:1746143125.674170:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.674276:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858529536 00000100:00100000:2.0:1746143125.674286:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858529536 00010000:00010000:2.0:1746143125.674325:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 23 pid: 8449 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.674663:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6377 00000100:00100000:2.0:1746143125.674672:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858529536:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.674690:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.674715:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 23 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.674732:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 23 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.674754:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c000/0x25aee876ca70c73f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->2256895) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae2 expref: 23 pid: 8449 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.674788:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.674791:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.674799:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.674807:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.674817:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.674818:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.674821:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.674828:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.674859:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 19 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.674871:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861202304:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.675480:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.675491:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861202432:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.675511:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.679756:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861202304:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.679769:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094510000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861202432:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.679789:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.680049:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858529536:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5166us (5679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.680061:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6377 00000100:00100000:0.0:1746143125.681269:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.681639:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858529792 00000100:00100000:2.0:1746143125.681646:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858529792 00002000:00100000:2.0:1746143125.681685:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3256320->3260415) req@ffff88008e191880 x1830962858529792/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.681694:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191880 with x1830962858529792 ext(3256320->3260415) 00002000:00010000:2.0:1746143125.681699:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e191880 00000100:00100000:2.0:1746143125.681721:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5861 00000100:00100000:2.0:1746143125.681727:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858529792:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143125.681884:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858529792:12345-192.168.201.28@tcp:3:cat.0 Request processed in 157us (618us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143125.681890:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5861 00002000:00100000:2.0:1746143125.681894:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3256320->3260415) req@ffff88008e191880 x1830962858529792/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/4536 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.681900:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191880 with x1830962858529792 ext(3256320->3260415) 00002000:00010000:2.0:1746143125.681903:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e191880 00000100:00100000:0.0:1746143125.687011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.687143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.687229:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858530176 00000100:00100000:3.0:1746143125.687238:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858530176 00002000:00100000:3.0:1746143125.687281:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2412543) req@ffff88008e191c00 x1830962858530176/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.687291:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191c00 with x1830962858530176 ext(2097152->2412543) 00002000:00010000:3.0:1746143125.687297:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e191c00 00000100:00100000:3.0:1746143125.687313:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858530304 00000100:00100000:3.0:1746143125.687316:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858530304 00002000:00100000:3.0:1746143125.687330:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008e191f80 x1830962858530304/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.687337:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191f80 with x1830962858530304 ext(2097152->3145727) 00002000:00010000:3.0:1746143125.687339:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e191f80 00000100:00100000:3.0:1746143125.687364:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5862 00000100:00100000:3.0:1746143125.687371:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858530176:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143125.687893:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5863 00000100:00100000:3.0:1746143125.687898:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858530304:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143125.693120:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858530176:12345-192.168.201.28@tcp:3:cat.0 Request processed in 5741us (6112us total) trans 0 rc 315392/315392 00000100:00100000:2.0:1746143125.693130:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5862 00002000:00100000:2.0:1746143125.693141:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2412543) req@ffff88008e191c00 x1830962858530176/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 315392/315392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.693151:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191c00 with x1830962858530176 ext(2097152->2412543) 00002000:00010000:2.0:1746143125.693155:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e191c00 00000100:00100000:2.0:1746143125.701949:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858530304:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14037us (14793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143125.701963:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5863 00002000:00100000:2.0:1746143125.701974:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008e191f80 x1830962858530304/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.701983:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191f80 with x1830962858530304 ext(2097152->3145727) 00002000:00010000:2.0:1746143125.704137:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e191f80 00000100:00100000:0.0:1746143125.709466:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.710731:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858530560 00000100:00100000:2.0:1746143125.710745:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858530560 00002000:00100000:2.0:1746143125.710819:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3260416->4194303) req@ffff88008e192300 x1830962858530560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.710828:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192300 with x1830962858530560 ext(3260416->4194303) 00002000:00010000:2.0:1746143125.710833:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e192300 00000100:00100000:2.0:1746143125.710870:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5864 00000100:00100000:2.0:1746143125.710878:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858530560:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143125.710943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.711089:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858530816 00000100:00100000:3.0:1746143125.711097:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858530816 00002000:00100000:3.0:1746143125.711131:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800906a5f80 x1830962858530816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.711141:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5f80 with x1830962858530816 ext(3145728->4194303) 00002000:00010000:3.0:1746143125.711146:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a5f80 00000100:00100000:3.0:1746143125.711173:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5865 00000100:00100000:3.0:1746143125.711181:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858530816:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143125.722104:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858530560:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11218us (12641us total) trans 0 rc 933888/933888 00000100:00100000:3.0:1746143125.722115:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5864 00002000:00100000:3.0:1746143125.722125:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3260416->4194303) req@ffff88008e192300 x1830962858530560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.722141:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192300 with x1830962858530560 ext(3260416->4194303) 00002000:00010000:3.0:1746143125.722145:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e192300 00000100:00100000:3.0:1746143125.730822:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858530816:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19633us (19874us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143125.730835:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5865 00002000:00100000:3.0:1746143125.730845:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800906a5f80 x1830962858530816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.730854:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5f80 with x1830962858530816 ext(3145728->4194303) 00002000:00010000:3.0:1746143125.730860:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a5f80 00000100:00100000:0.0:1746143125.735585:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.735747:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858530944 00000100:00100000:2.0:1746143125.735760:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858530944 00000100:00100000:2.0:1746143125.735833:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12070 00000100:00100000:2.0:1746143125.735841:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858530944:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.735861:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.735878:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f408a00/0x25aee876ca70c7e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb75 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.735909:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f408a00/0x25aee876ca70c7e0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb75 expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.735921:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f408a00/0x25aee876ca70c7e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb75 expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.735954:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408a00, rc 0) 00000100:00100000:2.0:1746143125.738206:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858530944:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2357us (2622us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.738215:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12070 00000100:00100000:0.0:1746143125.740971:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.741824:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858531072 00000100:00100000:2.0:1746143125.741834:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858531072 00000100:00100000:2.0:1746143125.741886:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12071 00000100:00100000:2.0:1746143125.741895:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858531072:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.742235:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.742251:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f408c00/0x25aee876ca70c7e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb7c expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.742281:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f408c00/0x25aee876ca70c7e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb7c expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.742298:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f408c00/0x25aee876ca70c7e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb7c expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.742307:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408c00, rc 0) 00000100:00100000:2.0:1746143125.742377:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858531072:12345-192.168.201.28@tcp:101:cat.0 Request processed in 482us (1411us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.742384:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12071 00000100:00100000:0.0:1746143125.746256:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.746578:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858531200 00000100:00100000:2.0:1746143125.746586:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858531200 00000100:00100000:2.0:1746143125.746986:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12072 00000100:00100000:2.0:1746143125.746995:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858531200:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.747010:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.747025:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb83 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.747152:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb83 expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.747162:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb83 expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.747172:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408400, rc 0) 00000100:00100000:2.0:1746143125.747326:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858531200:12345-192.168.201.28@tcp:101:cat.0 Request processed in 332us (1076us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143125.747331:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12072 00000100:00100000:0.0:1746143125.756092:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.756130:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.756170:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.757202:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858531456 00000100:00100000:3.0:1746143125.757207:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858531328 00000100:00100000:2.0:1746143125.757211:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858531456 00000100:00100000:3.0:1746143125.757212:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858531328 00000100:00100000:3.0:1746143125.757245:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858531584 00000100:00100000:3.0:1746143125.757247:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858531584 00000100:00100000:2.0:1746143125.757257:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12073 00000100:00100000:2.0:1746143125.757264:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858531328:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143125.757281:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143125.757297:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb8a expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.757319:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.757321:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.757328:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.757342:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143125.757366:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408400, rc 0) 00000100:00100000:2.0:1746143125.757408:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858531328:12345-192.168.201.28@tcp:101:cat.0 Request processed in 144us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.758222:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12074 00000100:00100000:3.0:1746143125.758230:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858531456:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143125.758239:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143125.758247:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70c7fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb91 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.758264:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70c7fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb91 expref: 25 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.758272:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013011b000/0x25aee876ca70c7fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb91 expref: 25 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.758289:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011b000, rc 0) 00000100:00100000:3.0:1746143125.758311:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858531456:12345-192.168.201.28@tcp:101:cat.0 Request processed in 83us (2228us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143125.758317:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12074 00000100:00100000:3.0:1746143125.758330:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12075 00000100:00100000:3.0:1746143125.758335:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858531584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143125.758342:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143125.758358:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013011b200/0x25aee876ca70c803 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb98 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143125.758392:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861202560:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143125.758609:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.758976:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12073 00000100:00100000:3.0:1746143125.768626:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861202560:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143125.768661:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013011b200/0x25aee876ca70c803 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb98 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.768675:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013011b200/0x25aee876ca70c803 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb98 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.769395:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011b200, rc 0) 00000100:00100000:3.0:1746143125.771549:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858531584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 13041us (15206us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143125.771557:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12075 00000100:00100000:0.0:1746143125.788911:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.790863:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858531840 00000100:00100000:3.0:1746143125.790875:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858531840 00002000:00100000:3.0:1746143125.790925:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008e193b80 x1830962858531840/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.790935:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193b80 with x1830962858531840 ext(1048576->2097151) 00002000:00010000:3.0:1746143125.790941:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e193b80 00000100:00100000:3.0:1746143125.790973:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5866 00000100:00100000:3.0:1746143125.790981:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858531840:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143125.809763:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858531840:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18769us (20850us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143125.809776:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5866 00002000:00100000:3.0:1746143125.809789:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008e193b80 x1830962858531840/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.809800:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193b80 with x1830962858531840 ext(1048576->2097151) 00002000:00010000:3.0:1746143125.809806:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e193b80 00000100:00100000:0.0:1746143125.823606:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.823718:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858531968 00000100:00100000:3.0:1746143125.823729:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858531968 00000100:00100000:3.0:1746143125.823961:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12076 00000100:00100000:3.0:1746143125.823969:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:30813:x1830962858531968:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143125.823989:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143125.824007:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fb9f expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.824066:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.824069:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.824079:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.824095:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.824105:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011b400, rc 0) 00000100:00100000:3.0:1746143125.824154:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30813:x1830962858531968:12345-192.168.201.28@tcp:101:cat.0 Request processed in 185us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.824160:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12076 00000100:00100000:0.0:1746143125.827118:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.827889:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858532224 00000100:00100000:3.0:1746143125.827899:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858532224 00002000:00100000:3.0:1746143125.827944:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094d7c380 x1830962858532224/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.827954:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7c380 with x1830962858532224 ext(2097152->3145727) 00002000:00010000:3.0:1746143125.827960:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7c380 00000100:00100000:3.0:1746143125.827989:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5867 00000100:00100000:3.0:1746143125.827997:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858532224:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143125.851480:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858532224:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23467us (24355us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143125.851496:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5867 00002000:00100000:3.0:1746143125.851511:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094d7c380 x1830962858532224/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.851522:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7c380 with x1830962858532224 ext(2097152->3145727) 00002000:00010000:3.0:1746143125.851529:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7c380 00000100:00100000:0.0:1746143125.859313:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.859665:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858532352 00000100:00100000:3.0:1746143125.859675:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858532352 00000100:00100000:3.0:1746143125.859738:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12077 00000100:00100000:3.0:1746143125.859747:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30813:x1830962858532352:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143125.859767:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143125.859787:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fba6 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.859819:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.859827:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143125.859828:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143125.859832:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.859862:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.860117:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 32 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143125.860131:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861202688:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143125.860224:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143125.870904:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861202688:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143125.870940:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.870965:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011b600, rc 0) 00000100:00100000:3.0:1746143125.871071:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30813:x1830962858532352:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11324us (11768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.871081:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12077 00000100:00100000:0.0:1746143125.871891:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.872091:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858532480 00000100:00100000:3.0:1746143125.872103:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858532480 00002000:00100000:3.0:1746143125.872143:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2412544->3145727) req@ffff880094d7ca80 x1830962858532480/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.872153:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7ca80 with x1830962858532480 ext(2412544->3145727) 00010000:00010000:3.0:1746143125.872160:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 33 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.872173:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 33 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143125.872180:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d7ca80 00000100:00100000:3.0:1746143125.872207:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1937 00000100:00100000:3.0:1746143125.872213:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858532480:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143125.893019:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.896151:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858532608 00000100:00100000:3.0:1746143125.896165:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858532608 00000100:00100000:3.0:1746143125.896231:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12078 00000100:00100000:3.0:1746143125.896240:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30817:x1830962858532608:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143125.896260:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143125.896280:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbad expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.896312:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.896320:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 25 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.896326:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.896328:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.896331:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.896372:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 25 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143125.896384:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 25 pid: 754 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143125.896397:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861202816:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143125.896501:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.896509:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 19 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143125.896517:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861202944:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143125.896537:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.903200:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858532480:12345-192.168.201.28@tcp:4:cat.0 Request processed in 30974us (31299us total) trans 17179872707 rc 0/0 00000100:00100000:2.0:1746143125.903214:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1937 00002000:00100000:2.0:1746143125.903226:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2412544->3145727) req@ffff880094d7ca80 x1830962858532480/t17179872707(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 488/448 e 0 to 0 dl 1746143136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.903237:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7ca80 with x1830962858532480 ext(2412544->3145727) 00010000:00010000:2.0:1746143125.903248:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 35 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.903263:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 35 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143125.903271:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d7ca80 00000100:00100000:3.0:1746143125.903482:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861202944:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143125.904120:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861202816:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143125.904146:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.904162:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011ba00, rc 0) 00000100:00100000:3.0:1746143125.904184:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30817:x1830962858532608:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7946us (11177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.904191:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12078 00000100:00100000:0.0:1746143125.904803:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.905136:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858532736 00000100:00100000:2.0:1746143125.905144:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858532736 00010000:00010000:2.0:1746143125.905174:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 20 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.905198:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6378 00000100:00100000:2.0:1746143125.905204:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858532736:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.905219:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.905240:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 20 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.905250:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 20 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.905274:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be4e400/0x25aee876ca70c7c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb59 expref: 20 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.905300:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.905324:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858532736:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 120us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.905330:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6378 00000100:00100000:2.0:1746143125.907368:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.907690:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858532864 00000100:00100000:0.0:1746143125.907697:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858532864 00010000:00010000:0.0:1746143125.907726:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 25 pid: 754 timeout: 1007 lvb_type: 1 00000100:00100000:0.0:1746143125.907759:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6379 00000100:00100000:0.0:1746143125.907766:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858532864:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143125.907776:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143125.907792:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 25 pid: 754 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143125.908003:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 25 pid: 754 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143125.908022:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f408400/0x25aee876ca70c7f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb8a expref: 25 pid: 754 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143125.908067:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143125.908070:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143125.908077:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.908087:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143125.908117:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143125.908130:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861203072:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143125.908192:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.911316:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.911369:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858533120 00000100:00100000:3.0:1746143125.911381:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858533120 00000100:00100000:0.0:1746143125.911409:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861203072:192.168.201.28@tcp:105: 00002000:00100000:3.0:1746143125.911421:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (2002944->2007039) req@ffff880094510a80 x1830962858533120/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746143125.911425:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143125.911430:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510a80 with x1830962858533120 ext(2002944->2007039) 00002000:00010000:3.0:1746143125.911434:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094510a80 00000100:00100000:0.0:1746143125.911465:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858532864:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3699us (4103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.911466:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5868 00000100:00100000:3.0:1746143125.911473:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858533120:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143125.911474:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6379 00000100:00100000:3.0:1746143125.911722:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858533120:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 249us (414us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143125.911728:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5868 00002000:00100000:3.0:1746143125.911734:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (2002944->2007039) req@ffff880094510a80 x1830962858533120/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/4536 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.911741:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510a80 with x1830962858533120 ext(2002944->2007039) 00002000:00010000:3.0:1746143125.911745:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094510a80 00000100:00100000:0.0:1746143125.912189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.912294:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858533248 00000100:00100000:2.0:1746143125.912298:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858533248 00010000:00010000:2.0:1746143125.912319:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 35 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143125.912339:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6380 00000100:00100000:2.0:1746143125.912355:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858533248:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143125.912366:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143125.912384:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 35 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.912396:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 35 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.912422:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0x25aee876ca70c7cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb60 expref: 35 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.912448:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.912450:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143125.912457:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.912467:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143125.912581:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.912594:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861203200:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143125.912773:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.915744:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.916125:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.916239:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858533376 00000100:00100000:3.0:1746143125.916247:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858533376 00000100:00100000:3.0:1746143125.916621:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12079 00000100:00100000:3.0:1746143125.916630:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30817:x1830962858533376:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143125.916647:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143125.916663:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbb4 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.916691:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.916698:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.916704:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143125.916706:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143125.916710:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->2416639] (req 2097152->2416639) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.916735:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143125.916837:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861203200:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143125.916855:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143125.916904:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858533248:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4559us (4714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143125.916913:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6380 00000100:00100000:2.0:1746143125.916950:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858533632 00000100:00100000:2.0:1746143125.916953:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858533632 00002000:00100000:2.0:1746143125.916977:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094d7d880 x1830962858533632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.916986:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7d880 with x1830962858533632 ext(2097152->3145727) 00002000:00010000:2.0:1746143125.916990:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7d880 00000100:00100000:2.0:1746143125.917003:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5869 00000100:00100000:2.0:1746143125.917009:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858533632:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:3.0:1746143125.917140:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 25 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143125.917151:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861203328:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143125.917202:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.917210:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 18 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143125.917216:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861203456:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143125.917230:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143125.921020:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861203328:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.921078:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861203456:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143125.922137:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.922425:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858533760 00000100:00100000:3.0:1746143125.922433:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858533760 00010000:00010000:3.0:1746143125.922472:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 26 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143125.922501:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6381 00000100:00100000:3.0:1746143125.922507:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858533760:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143125.922521:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143125.922543:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 26 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.922554:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 26 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.922577:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c80a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb9f expref: 26 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.922608:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143125.922639:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858533760:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 131us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.922645:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6381 00010000:00010000:1.0:1746143125.922955:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->2416639] (req 2097152->2416639) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.922968:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011be00, rc 0) 00000100:00100000:1.0:1746143125.923197:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30817:x1830962858533376:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6568us (7461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143125.923205:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12079 00000100:00100000:0.0:1746143125.925781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.925991:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858533888 00000100:00100000:3.0:1746143125.925999:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858533888 00010000:00010000:3.0:1746143125.926059:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143125.926090:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6382 00000100:00100000:3.0:1746143125.926098:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858533888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143125.926110:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143125.926134:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.926146:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.926168:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f409a00/0x25aee876ca70c7d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb67 expref: 19 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.926198:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.926201:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.926209:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 23 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.926217:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 23 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.926255:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 23 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143125.926267:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861203584:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143125.926362:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143125.927288:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858533632:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 10276us (11160us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143125.927298:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5869 00002000:00100000:2.0:1746143125.927307:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094d7d880 x1830962858533632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.927316:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7d880 with x1830962858533632 ext(2097152->3145727) 00002000:00010000:2.0:1746143125.927321:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7d880 00000100:00100000:3.0:1746143125.927769:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861203584:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143125.927785:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143125.927805:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858533888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1709us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.927812:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6382 00000100:00100000:0.0:1746143125.931493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.931553:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858534144 00000100:00100000:2.0:1746143125.931562:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858534144 00000100:00100000:0.0:1746143125.931580:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143125.931610:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2412544->2416639) req@ffff880094d7df80 x1830962858534144/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.931620:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7df80 with x1830962858534144 ext(2412544->2416639) 00002000:00010000:2.0:1746143125.931626:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7df80 00000100:00100000:0.0:1746143125.932385:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5870 00000100:00100000:0.0:1746143125.932395:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858534144:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143125.932561:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858534272 00000100:00100000:1.0:1746143125.932566:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858534272 00000100:00100000:0.0:1746143125.932584:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858534144:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 190us (1145us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143125.932591:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12080 00000100:00100000:0.0:1746143125.932591:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5870 00000100:00100000:1.0:1746143125.932596:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30813:x1830962858534272:12345-192.168.201.28@tcp:101:cat.0 00002000:00100000:0.0:1746143125.932597:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2412544->2416639) req@ffff880094d7df80 x1830962858534144/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/4536 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143125.932604:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746143125.932605:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7df80 with x1830962858534144 ext(2412544->2416639) 00002000:00010000:0.0:1746143125.932608:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7df80 00010000:00010000:1.0:1746143125.932619:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbbb expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.932644:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 17 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.932652:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143125.932654:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143125.932657:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.932684:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 17 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.932697:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 17 pid: 754 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143125.932708:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861203712:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143125.933428:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143125.935747:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143125.935802:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858534400 00000100:00100000:2.0:1746143125.935810:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858534400 00000100:00100000:1.0:1746143125.935847:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861203712:192.168.201.28@tcp:104: 00002000:00100000:2.0:1746143125.935848:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4157439) req@ffff880094d7e680 x1830962858534400/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 504/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.935857:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7e680 with x1830962858534400 ext(3145728->4157439) 00010000:00010000:2.0:1746143125.935866:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 18 pid: 754 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143125.936066:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143125.936082:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b3400, rc 0) 00000100:00100000:1.0:1746143125.936123:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30813:x1830962858534272:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3525us (4542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143125.936132:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12080 00010000:00010000:2.0:1746143125.937156:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 18 pid: 754 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143125.937164:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d7e680 00000100:00100000:2.0:1746143125.937185:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1938 00000100:00100000:2.0:1746143125.937193:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858534400:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:2.0:1746143125.949270:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858534400:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 12063us (13516us total) trans 21474839962 rc 0/0 00000100:00100000:2.0:1746143125.949285:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1938 00002000:00100000:2.0:1746143125.949298:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4157439) req@ffff880094d7e680 x1830962858534400/t21474839962(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:276/0 lens 504/448 e 0 to 0 dl 1746143136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143125.949316:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7e680 with x1830962858534400 ext(3145728->4157439) 00010000:00010000:2.0:1746143125.949327:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 20 pid: 754 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143125.949354:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 20 pid: 754 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143125.949363:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d7e680 00000100:00100000:0.0:1746143125.954430:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.954496:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858534528 00000100:00100000:3.0:1746143125.954506:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858534528 00010000:00010000:3.0:1746143125.954545:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 20 pid: 754 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143125.954583:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6383 00000100:00100000:3.0:1746143125.954591:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858534528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143125.954608:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143125.954628:0:4759:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143123 -> 1746143124 00010000:00010000:3.0:1746143125.954634:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 20 pid: 754 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.954646:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 20 pid: 754 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.954675:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f408200/0x25aee876ca70c7d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3260415) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb6e expref: 20 pid: 754 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143125.954712:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.954714:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143125.954722:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.954737:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143125.954774:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143125.954786:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861203840:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143125.955308:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143125.960027:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861203840:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143125.960067:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143125.960120:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858534528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5528us (5698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143125.960132:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6383 00000100:00100000:0.0:1746143125.971769:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143125.971826:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.973414:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858534784 00000100:00100000:1.0:1746143125.973414:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858535040 00000100:00100000:3.0:1746143125.973426:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858534784 00000100:00100000:1.0:1746143125.973426:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858535040 00002000:00100000:3.0:1746143125.973477:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094d7ed80 x1830962858534784/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.973495:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7ed80 with x1830962858534784 ext(3145728->4194303) 00002000:00010000:3.0:1746143125.973501:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7ed80 00002000:00100000:1.0:1746143125.973712:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094d7f100 x1830962858535040/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/0 e 0 to 0 dl 1746143136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143125.973725:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5871 00002000:00100000:1.0:1746143125.973725:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7f100 with x1830962858535040 ext(3145728->4194303) 00002000:00010000:1.0:1746143125.973729:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7f100 00000100:00100000:3.0:1746143125.973732:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858534784:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143125.973929:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5872 00000100:00100000:0.0:1746143125.973936:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858535040:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143125.996827:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143125.997150:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858534784:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 23416us (25391us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143125.997163:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5871 00002000:00100000:3.0:1746143125.997178:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094d7ed80 x1830962858534784/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143125.997188:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7ed80 with x1830962858534784 ext(3145728->4194303) 00002000:00010000:3.0:1746143125.997194:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7ed80 00000100:00100000:0.0:1746143125.999252:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.001575:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.001976:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858535040:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 28039us (30148us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143126.001988:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5872 00002000:00100000:0.0:1746143126.001999:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094d7f100 x1830962858535040/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:276/0 lens 488/440 e 0 to 0 dl 1746143136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.002010:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7f100 with x1830962858535040 ext(3145728->4194303) 00002000:00010000:0.0:1746143126.002016:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7f100 00000100:00100000:1.0:1746143126.002436:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858535296 00000100:00100000:1.0:1746143126.002445:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858535296 00000100:00100000:1.0:1746143126.002492:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858535168 00000100:00100000:1.0:1746143126.002496:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858535168 00000100:00100000:1.0:1746143126.002517:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858535424 00000100:00100000:1.0:1746143126.002519:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858535424 00000100:00100000:1.0:1746143126.002540:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12081 00000100:00100000:1.0:1746143126.002547:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858535296:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.002562:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.002581:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b2c00/0x25aee876ca70c82d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbc9 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.002615:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2c00/0x25aee876ca70c82d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbc9 expref: 21 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.002626:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2c00/0x25aee876ca70c82d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbc9 expref: 21 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.002642:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b2c00, rc 0) 00000100:00100000:1.0:1746143126.002666:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858535296:12345-192.168.201.28@tcp:101:cat.0 Request processed in 120us (5850us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143126.002673:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12081 00000100:00100000:1.0:1746143126.002684:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12082 00000100:00100000:1.0:1746143126.002688:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858535168:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.002695:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.002701:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b3200/0x25aee876ca70c834 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbc2 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143126.002740:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861203968:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143126.002811:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12083 00000100:00100000:1.0:1746143126.002816:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1968:x1830962858535424:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.002823:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.002832:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbd0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.002846:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.002848:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.002856:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 35 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.002869:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 35 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.002878:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b3600, rc 0) 00000100:00100000:1.0:1746143126.002895:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858535424:12345-192.168.201.28@tcp:101:cat.0 Request processed in 79us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.002900:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12083 00000100:00080000:1.0:1746143126.002942:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143126.002945:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143126.006562:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143126.006804:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861203968:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143126.006835:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3200/0x25aee876ca70c834 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbc2 expref: 20 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.006851:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3200/0x25aee876ca70c834 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbc2 expref: 20 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.006863:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b3200, rc 0) 00000100:00100000:1.0:1746143126.006911:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858535168:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4221us (7667us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143126.006919:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12082 00000100:00100000:0.0:1746143126.010500:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.010590:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858535552 00000100:00100000:1.0:1746143126.010600:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858535552 00000100:00100000:1.0:1746143126.010651:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12084 00000100:00100000:1.0:1746143126.010660:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858535552:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.010678:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.010696:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c842 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbd7 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.010728:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c842 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd7 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.010739:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c842 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd7 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.010749:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b2a00, rc 0) 00000100:00100000:1.0:1746143126.010787:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858535552:12345-192.168.201.28@tcp:101:cat.0 Request processed in 129us (299us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143126.010794:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12084 00000100:00100000:0.0:1746143126.015806:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.015889:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858535680 00000100:00100000:2.0:1746143126.015900:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858535680 00000100:00100000:2.0:1746143126.015956:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12085 00000100:00100000:2.0:1746143126.015964:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858535680:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143126.015984:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.016002:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec8fa00/0x25aee876ca70c849 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbde expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.016068:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec8fa00/0x25aee876ca70c849 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbde expref: 26 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.016079:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec8fa00/0x25aee876ca70c849 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbde expref: 26 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.016097:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec8fa00, rc 0) 00000100:00100000:2.0:1746143126.016140:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858535680:12345-192.168.201.28@tcp:101:cat.0 Request processed in 177us (345us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143126.016147:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12085 00000100:00100000:0.0:1746143126.022204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.022313:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858535808 00000100:00100000:1.0:1746143126.022323:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858535808 00000100:00100000:1.0:1746143126.022431:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12086 00000100:00100000:1.0:1746143126.022440:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858535808:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.022460:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.022480:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b2800/0x25aee876ca70c850 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbe5 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.022514:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2800/0x25aee876ca70c850 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbe5 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.022525:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2800/0x25aee876ca70c850 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbe5 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.022663:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b2800, rc 0) 00000100:00100000:1.0:1746143126.023260:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858535808:12345-192.168.201.28@tcp:101:cat.0 Request processed in 818us (1066us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143126.023267:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12086 00000100:00100000:0.0:1746143126.033130:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.033234:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858535936 00000100:00100000:1.0:1746143126.033245:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858535936 00000100:00100000:1.0:1746143126.033303:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12087 00000100:00100000:1.0:1746143126.033311:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30823:x1830962858535936:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.033333:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.033373:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbec expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.033410:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.033417:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.033419:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.033423:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.033455:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 24 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.033467:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 24 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143126.033479:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861204096:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143126.035197:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.072179:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.072535:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858536064 00000100:00100000:2.0:1746143126.072544:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858536064 00002000:00100000:2.0:1746143126.072590:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (2002944->2097151) req@ffff880091948e00 x1830962858536064/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.072600:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948e00 with x1830962858536064 ext(2002944->2097151) 00010000:00010000:2.0:1746143126.072612:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 25 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143126.072626:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 25 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143126.072633:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091948e00 00000100:00100000:2.0:1746143126.072664:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1939 00000100:00100000:2.0:1746143126.072672:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858536064:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143126.073195:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861204096:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143126.073219:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.073232:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b2e00, rc 0) 00000100:00100000:1.0:1746143126.073267:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30823:x1830962858535936:12345-192.168.201.28@tcp:101:cat.0 Request processed in 39956us (40149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.073275:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12087 00000100:00100000:2.0:1746143126.080193:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858536064:12345-192.168.201.28@tcp:4:cat.0 Request processed in 7511us (8014us total) trans 21474839963 rc 0/0 00000100:00100000:2.0:1746143126.080206:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1939 00002000:00100000:2.0:1746143126.080218:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (2002944->2097151) req@ffff880091948e00 x1830962858536064/t21474839963(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/448 e 0 to 0 dl 1746143137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.080227:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948e00 with x1830962858536064 ext(2002944->2097151) 00010000:00010000:2.0:1746143126.080237:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 27 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143126.080252:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 27 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143126.080263:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091948e00 00000100:00100000:0.0:1746143126.089105:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.089230:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858536192 00000100:00100000:3.0:1746143126.089239:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858536192 00010000:00010000:3.0:1746143126.089275:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 27 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143126.089301:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6384 00000100:00100000:3.0:1746143126.089307:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858536192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.089321:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143126.089353:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 27 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143126.089366:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 27 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143126.089395:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013011ba00/0x25aee876ca70c818 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbad expref: 27 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143126.089415:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.089417:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.089424:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.089431:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.089464:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143126.089476:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861204224:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143126.089563:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.103649:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.104238:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861204224:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143126.104258:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143126.104261:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858536448 00000100:00100000:2.0:1746143126.104268:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858536448 00000100:00100000:3.0:1746143126.104307:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858536192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 14999us (15211us total) trans 0 rc 0/0 00002000:00100000:2.0:1746143126.104313:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880091948a80 x1830962858536448/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143126.104317:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6384 00002000:00100000:2.0:1746143126.104324:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948a80 with x1830962858536448 ext(1048576->2097151) 00002000:00010000:2.0:1746143126.104330:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948a80 00000100:00100000:2.0:1746143126.104361:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5873 00000100:00100000:2.0:1746143126.104368:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858536448:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143126.135111:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858536448:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30731us (31459us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143126.135125:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5873 00002000:00100000:2.0:1746143126.135138:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880091948a80 x1830962858536448/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.135148:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948a80 with x1830962858536448 ext(1048576->2097151) 00002000:00010000:2.0:1746143126.135155:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948a80 00000100:00100000:0.0:1746143126.140644:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.140718:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858536576 00000100:00100000:1.0:1746143126.140727:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858536576 00000100:00100000:1.0:1746143126.140765:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12088 00000100:00100000:1.0:1746143126.140771:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30823:x1830962858536576:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.140790:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.140807:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbf3 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.140836:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.140842:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.140844:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.140847:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.140873:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 25 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.140883:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 25 pid: 21048 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143126.140893:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861204352:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143126.148086:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.149085:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.149228:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.149290:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858536704 00000100:00100000:3.0:1746143126.149299:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858536704 00000100:00100000:3.0:1746143126.149337:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858536832 00000100:00100000:3.0:1746143126.149338:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858536832 00000100:00100000:3.0:1746143126.149366:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12089 00000100:00100000:3.0:1746143126.149375:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1971:x1830962858536704:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143126.149392:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143126.149409:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fbfa expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.149648:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.149650:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.149658:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 28 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.149674:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 28 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.149685:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011ac00, rc 0) 00000100:00100000:3.0:1746143126.149729:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858536704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 355us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.149736:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12089 00000100:00100000:3.0:1746143126.149751:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12090 00000100:00100000:3.0:1746143126.149756:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858536832:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143126.149763:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143126.149769:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c86c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc01 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.149787:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c86c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc01 expref: 28 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.149796:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013011b400/0x25aee876ca70c86c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc01 expref: 28 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.149811:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013011b400, rc 0) 00000100:00100000:3.0:1746143126.150046:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858536832:12345-192.168.201.28@tcp:101:cat.0 Request processed in 71us (600us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143126.150053:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12090 00000100:00100000:0.0:1746143126.152229:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.152268:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.152290:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.152304:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858537472 00000100:00100000:0.0:1746143126.152310:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858537472 00000100:00100000:0.0:1746143126.152350:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 444 00000100:00100000:0.0:1746143126.152357:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858537472:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:0.0:1746143126.152408:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858537472:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.152413:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 444 00000100:00100000:0.0:1746143126.152439:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.152494:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.152508:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858537216 00000100:00100000:0.0:1746143126.152511:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858537216 00000100:00100000:0.0:1746143126.152534:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858537088 00000100:00100000:0.0:1746143126.152536:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858537088 00000100:00100000:0.0:1746143126.152550:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858537344 00000100:00100000:0.0:1746143126.152551:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858537344 00000100:00100000:0.0:1746143126.152565:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 228 00000100:00100000:0.0:1746143126.152569:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1970:x1830962858537216:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:0.0:1746143126.152602:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1970:x1830962858537216:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 32us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.152607:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 228 00000100:00100000:0.0:1746143126.152617:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 229 00000100:00100000:0.0:1746143126.152621:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+219:1970:x1830962858537088:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:0.0:1746143126.152641:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+219:1970:x1830962858537088:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 20us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.152646:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 229 00000100:00100000:0.0:1746143126.152654:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 230 00000100:00100000:0.0:1746143126.152658:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1970:x1830962858537344:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:0.0:1746143126.152679:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1970:x1830962858537344:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 21us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.152685:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 230 00000100:00100000:0.0:1746143126.152726:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.152738:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858537600 00000100:00100000:0.0:1746143126.152741:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858537600 00000100:00100000:0.0:1746143126.152761:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 445 00000100:00100000:0.0:1746143126.152765:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858537600:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:0.0:1746143126.152786:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858537600:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 21us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.152791:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 445 00000100:00080000:0.0:1746143126.152853:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143126.152857:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143126.152858:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143126.152915:0:14792:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858536960 00000100:00100000:2.0:1746143126.152920:0:14792:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858536960 00000100:00100000:2.0:1746143126.152944:0:14792:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 228 00000100:00100000:2.0:1746143126.152949:0:14792:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1970:x1830962858536960:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:2.0:1746143126.152976:0:14792:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1970:x1830962858536960:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 27us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.152981:0:14792:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 228 00000100:00100000:0.0:1746143126.155324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.155407:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858537728 00000100:00100000:2.0:1746143126.155413:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858537728 00002000:00100000:2.0:1746143126.155450:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2416639) req@ffff88008fe7bb80 x1830962858537728/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.155460:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7bb80 with x1830962858537728 ext(2097152->2416639) 00010000:00010000:2.0:1746143126.155468:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 27 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143126.155484:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 27 pid: 21048 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143126.155492:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe7bb80 00000100:00100000:2.0:1746143126.155518:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1940 00000100:00100000:2.0:1746143126.155524:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858537728:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143126.156243:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861204352:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143126.156270:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.156291:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b3800, rc 0) 00000100:00100000:1.0:1746143126.156327:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30823:x1830962858536576:12345-192.168.201.28@tcp:101:cat.0 Request processed in 15556us (15694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.156335:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12088 00000100:00100000:0.0:1746143126.164189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.165639:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858537984 00000100:00100000:2.0:1746143126.165650:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858537984 00002000:00100000:2.0:1746143126.165699:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008fe79880 x1830962858537984/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.165711:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe79880 with x1830962858537984 ext(1048576->2097151) 00002000:00010000:2.0:1746143126.165717:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe79880 00000100:00100000:2.0:1746143126.165739:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5874 00000100:00100000:2.0:1746143126.165746:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1971:x1830962858537984:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143126.190108:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1968:x1830962858537728:12345-192.168.201.28@tcp:4:cat.0 Request processed in 34572us (34780us total) trans 21474839964 rc 0/0 00000100:00100000:3.0:1746143126.190121:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1940 00002000:00100000:3.0:1746143126.190133:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2416639) req@ffff88008fe7bb80 x1830962858537728/t21474839964(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/448 e 0 to 0 dl 1746143137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.190143:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7bb80 with x1830962858537728 ext(2097152->2416639) 00010000:00010000:3.0:1746143126.190155:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 31 pid: 21048 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143126.190173:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 31 pid: 21048 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143126.190181:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe7bb80 00000100:00100000:0.0:1746143126.196710:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.200585:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1971:x1830962858537984:12345-192.168.201.28@tcp:3:cat.0 Request processed in 34821us (36391us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143126.200602:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5874 00002000:00100000:2.0:1746143126.200620:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008fe79880 x1830962858537984/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.200632:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe79880 with x1830962858537984 ext(1048576->2097151) 00002000:00010000:2.0:1746143126.200639:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe79880 00000100:00100000:3.0:1746143126.201009:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858538112 00000100:00100000:3.0:1746143126.201018:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858538112 00010000:00010000:3.0:1746143126.201064:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 29 pid: 21048 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.201093:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6385 00000100:00100000:3.0:1746143126.201100:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1968:x1830962858538112:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.201118:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143126.201141:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 29 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.201152:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 29 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.201179:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013011be00/0x25aee876ca70c81f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2416639) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbb4 expref: 29 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.201208:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.201210:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.201218:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.201227:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.201263:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143126.201274:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861204480:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143126.201373:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.204701:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861204480:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143126.204725:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143126.204778:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858538112:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3677us (8079us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.204789:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6385 00000100:00100000:0.0:1746143126.214231:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.214268:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.214298:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.214549:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.214580:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858538496 00000100:00100000:0.0:1746143126.214588:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858538496 00002000:00100000:0.0:1746143126.214635:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009b598e00 x1830962858538496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.214646:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598e00 with x1830962858538496 ext(2097152->3145727) 00002000:00010000:0.0:1746143126.214652:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b598e00 00000100:00100000:0.0:1746143126.214668:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858538624 00000100:00100000:0.0:1746143126.214670:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858538624 00002000:00100000:0.0:1746143126.214678:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009b599180 x1830962858538624/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.214685:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599180 with x1830962858538624 ext(3145728->4194303) 00002000:00010000:0.0:1746143126.214687:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b599180 00000100:00100000:0.0:1746143126.214694:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858539008 00000100:00100000:0.0:1746143126.214695:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858539008 00002000:00100000:0.0:1746143126.214705:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009b59b100 x1830962858539008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.214711:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b100 with x1830962858539008 ext(2097152->3145727) 00002000:00010000:0.0:1746143126.214713:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59b100 00000100:00100000:0.0:1746143126.214724:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5875 00000100:00100000:0.0:1746143126.214730:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858538496:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143126.216465:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5876 00000100:00100000:0.0:1746143126.216474:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858538624:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.217405:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5877 00000100:00100000:1.0:1746143126.217415:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858539008:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.219082:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858538240 00000100:00100000:1.0:1746143126.219090:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858538240 00000100:00100000:1.0:1746143126.219134:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12091 00000100:00100000:1.0:1746143126.219140:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:30832:x1830962858538240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.219154:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.219172:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc08 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.219196:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.219198:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.219207:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.219223:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.219233:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b3c00, rc 0) 00000100:00100000:1.0:1746143126.219262:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:30832:x1830962858538240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 122us (4963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.219272:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12091 00000100:00100000:1.0:1746143126.219364:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.219390:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858539264 00000100:00100000:1.0:1746143126.219392:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858539264 00002000:00100000:1.0:1746143126.219416:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800906a5880 x1830962858539264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.219425:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5880 with x1830962858539264 ext(3145728->4194303) 00002000:00010000:1.0:1746143126.219430:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a5880 00000100:00100000:1.0:1746143126.219444:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5878 00000100:00100000:1.0:1746143126.219449:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858539264:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143126.232131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.237209:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.238182:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858539520 00000100:00100000:3.0:1746143126.238193:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858539520 00002000:00100000:3.0:1746143126.238238:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009b598a80 x1830962858539520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.238255:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598a80 with x1830962858539520 ext(2097152->3145727) 00002000:00010000:3.0:1746143126.238261:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b598a80 00000100:00100000:0.0:1746143126.238636:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858539648 00000100:00100000:0.0:1746143126.238640:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858539648 00000100:00100000:0.0:1746143126.238666:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12092 00000100:00100000:0.0:1746143126.238673:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30825:x1830962858539648:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143126.238687:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143126.238703:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc0f expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.238732:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.238742:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 5 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.238748:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 25 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.238756:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.238758:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.238762:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [638976->1048575] (req 638976->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.238790:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 25 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.238801:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 25 pid: 21048 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.238812:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b598700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861204608:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143126.239570:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858538496:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24835us (25345us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143126.239579:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5875 00002000:00100000:1.0:1746143126.239587:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009b598e00 x1830962858538496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.239596:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598e00 with x1830962858538496 ext(2097152->3145727) 00002000:00010000:1.0:1746143126.239600:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b598e00 00000100:00100000:1.0:1746143126.239620:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5879 00000100:00100000:1.0:1746143126.239627:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1971:x1830962858539520:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.247768:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858539008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30341us (33429us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143126.247782:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5877 00002000:00100000:1.0:1746143126.247796:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009b59b100 x1830962858539008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.247806:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b100 with x1830962858539008 ext(2097152->3145727) 00002000:00010000:1.0:1746143126.247813:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59b100 00010000:00010000:0.0:1746143126.248124:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 5 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.248141:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 5 pid: 4758 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.248155:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861204736:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143126.248192:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.248202:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 30 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.248211:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861204864:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143126.248230:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143126.252530:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858538624:12345-192.168.201.28@tcp:3:cat.0 Request processed in 36045us (38248us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143126.252544:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5876 00002000:00100000:2.0:1746143126.252558:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009b599180 x1830962858538624/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.252569:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599180 with x1830962858538624 ext(3145728->4194303) 00002000:00010000:2.0:1746143126.252576:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b599180 00000100:00100000:2.0:1746143126.256328:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b598700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861204608:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143126.256351:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861204736:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143126.256360:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861204864:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143126.256393:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [638976->1048575] (req 638976->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.256450:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090019200, rc 0) 00000100:00100000:2.0:1746143126.256595:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30825:x1830962858539648:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 17919us (19396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.256604:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12092 00000100:00100000:0.0:1746143126.261555:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.261588:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.263939:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858539776 00000100:00100000:2.0:1746143126.263955:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858539776 00000100:00100000:0.0:1746143126.263984:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143126.263994:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 22 pid: 21048 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.264009:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858539904 00000100:00100000:0.0:1746143126.264012:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858539904 00010000:00010000:0.0:1746143126.264028:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 6 pid: 4758 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143126.264048:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858540032 00000100:00100000:2.0:1746143126.264051:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858540032 00000100:00100000:0.0:1746143126.264061:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6386 00010000:00010000:2.0:1746143126.264066:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 31 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.264068:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858539776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143126.264080:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6387 00010000:00010000:0.0:1746143126.264081:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143126.264084:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858539904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143126.264091:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143126.264103:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 22 pid: 21048 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143126.264104:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 6 pid: 4758 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746143126.264115:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 22 pid: 21048 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746143126.264150:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6388 00000100:00100000:3.0:1746143126.264158:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1971:x1830962858540032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.264164:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143126.265392:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 6 pid: 4758 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143126.265415:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094cf9a00/0x25aee876ca70c421 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f896 expref: 6 pid: 4758 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143126.265436:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143126.265478:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1970:x1830962858539904:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1393us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.265485:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6387 00010000:00010000:0.0:1746143126.265548:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba21800/0x25aee876ca70c341 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f826 expref: 22 pid: 21048 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746143126.265549:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 31 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.265557:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 31 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.265568:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4984200/0x25aee876ca70c310 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f818 expref: 31 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.265575:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.265577:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.265584:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.265592:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.265686:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143126.265702:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1971:x1830962858540032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1546us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.265707:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6388 00010000:00010000:1.0:1746143126.265836:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143126.265850:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861204992:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143126.265939:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143126.268801:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858539264:12345-192.168.201.28@tcp:3:cat.0 Request processed in 49342us (49429us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143126.268813:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5878 00002000:00100000:2.0:1746143126.268824:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800906a5880 x1830962858539264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.268835:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5880 with x1830962858539264 ext(3145728->4194303) 00002000:00010000:2.0:1746143126.268841:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a5880 00000100:00100000:0.0:1746143126.269249:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861204992:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143126.269267:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143126.269288:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858539776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5220us (7746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.269535:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.270575:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6386 00000100:00100000:3.0:1746143126.271171:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858540288 00000100:00100000:3.0:1746143126.271179:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858540288 00002000:00100000:3.0:1746143126.271213:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fc:0x0] (638976->643071) req@ffff8800906a5c00 x1830962858540288/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.271222:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5c00 with x1830962858540288 ext(638976->643071) 00002000:00010000:3.0:1746143126.271226:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a5c00 00000100:00100000:3.0:1746143126.271242:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5880 00000100:00100000:3.0:1746143126.271249:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858540288:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143126.271616:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858540288:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 366us (2274us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143126.271627:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5880 00002000:00100000:3.0:1746143126.271632:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fc:0x0] (638976->643071) req@ffff8800906a5c00 x1830962858540288/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.271640:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5c00 with x1830962858540288 ext(638976->643071) 00002000:00010000:3.0:1746143126.271643:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a5c00 00000100:00100000:1.0:1746143126.277137:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858539520:12345-192.168.201.28@tcp:3:cat.0 Request processed in 37500us (45007us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143126.277150:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5879 00002000:00100000:1.0:1746143126.277161:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009b598a80 x1830962858539520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.277172:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598a80 with x1830962858539520 ext(2097152->3145727) 00002000:00010000:1.0:1746143126.277178:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b598a80 00000100:00100000:1.0:1746143126.283984:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.284097:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858540416 00000100:00100000:2.0:1746143126.284107:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858540416 00000100:00100000:2.0:1746143126.284301:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12093 00000100:00100000:2.0:1746143126.284310:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:30825:x1830962858540416:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143126.284328:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.284360:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc16 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.284389:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 36 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.284398:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.284405:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 19 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.284412:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143126.284414:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143126.284417:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->1490943] (req 1048576->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.284448:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 19 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.284464:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 19 pid: 26949 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143126.284475:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861205120:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143126.286210:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.286221:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 6 pid: 8449 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746143126.286230:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861205248:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143126.286541:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 36 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.286548:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 36 pid: 26949 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.286556:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861205376:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143126.286572:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.286967:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.287099:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858540544 00000100:00100000:2.0:1746143126.287105:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858540544 00000100:00100000:2.0:1746143126.287146:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12094 00000100:00100000:2.0:1746143126.287153:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858540544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143126.287167:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.287178:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd1e00/0x25aee876ca70c888 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc1d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143126.287214:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861205504:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143126.287264:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.287875:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861205120:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143126.287886:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861205248:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143126.287892:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861205376:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143126.287914:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->1490943] (req 1048576->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.287925:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba21800, rc 0) 00000100:00100000:3.0:1746143126.287947:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:30825:x1830962858540416:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3639us (3975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.287953:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12093 00000100:00100000:0.0:1746143126.291740:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.291775:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.291804:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.291875:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858540672 00000100:00100000:2.0:1746143126.291883:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858540672 00010000:00010000:2.0:1746143126.291919:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 20 pid: 26949 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143126.291951:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858540928 00000100:00100000:2.0:1746143126.291952:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858540928 00010000:00010000:2.0:1746143126.291961:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 36 pid: 26949 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143126.291972:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858540800 00000100:00100000:2.0:1746143126.291974:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858540800 00010000:00010000:2.0:1746143126.291981:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 7 pid: 8449 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143126.291993:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6389 00000100:00100000:2.0:1746143126.291999:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858540672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143126.292011:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143126.292063:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 20 pid: 26949 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.292071:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6390 00010000:00010000:2.0:1746143126.292074:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 20 pid: 26949 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.292078:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858540928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143126.292085:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143126.292102:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 36 pid: 26949 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.292110:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 36 pid: 26949 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.292123:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b66de00/0x25aee876ca70c5da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9d8 expref: 36 pid: 26949 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143126.292138:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6391 00010000:00010000:0.0:1746143126.292144:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143126.292146:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858540800:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143126.292152:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143126.292160:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 7 pid: 8449 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746143126.292173:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 7 pid: 8449 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.292176:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858540928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 100us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.292182:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6390 00010000:00010000:1.0:1746143126.292185:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b375800/0x25aee876ca70c658 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa2c expref: 7 pid: 8449 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746143126.292197:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.292198:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.292204:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.292211:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.292239:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143126.292250:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861205632:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143126.292306:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143126.292487:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70c604 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f9f4 expref: 20 pid: 26949 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143126.292499:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143126.292530:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858540672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 530us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.292535:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6389 00002000:00010000:2.0:1746143126.296262:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143121 -> 1746143125 00002000:00010000:2.0:1746143126.296271:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143122 -> 1746143125 00002000:00010000:2.0:1746143126.296273:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143121 -> 1746143125 00000100:00100000:2.0:1746143126.296299:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861205504:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143126.296334:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd1e00/0x25aee876ca70c888 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc1d expref: 29 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.296366:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd1e00/0x25aee876ca70c888 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc1d expref: 29 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.296377:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd1e00, rc 0) 00000100:00100000:2.0:1746143126.296419:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858540544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9264us (9453us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143126.296428:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12094 00000100:00100000:1.0:1746143126.298833:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861205632:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143126.298851:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143126.298885:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858540800:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6740us (7078us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.298895:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6391 00000100:00100000:0.0:1746143126.308168:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.310312:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.311014:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.311244:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858541312 00000100:00100000:2.0:1746143126.311253:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858541312 00000100:00100000:2.0:1746143126.311293:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858541440 00000100:00100000:2.0:1746143126.311296:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858541440 00000100:00100000:2.0:1746143126.311315:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12095 00000100:00100000:2.0:1746143126.311322:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858541312:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143126.311350:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.311548:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c88f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc24 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143126.311601:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861205760:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143126.311666:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.312023:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12096 00000100:00100000:0.0:1746143126.312044:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858541440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143126.312052:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143126.312062:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090019400/0x25aee876ca70c896 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc2b expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143126.312086:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861205888:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143126.312107:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143126.312229:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858541184 00000100:00100000:1.0:1746143126.312234:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858541184 00002000:00100000:1.0:1746143126.312263:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1486848->1490943) req@ffff880094d7dc00 x1830962858541184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.312272:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7dc00 with x1830962858541184 ext(1486848->1490943) 00002000:00010000:1.0:1746143126.312275:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7dc00 00000100:00100000:1.0:1746143126.312295:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5881 00000100:00100000:1.0:1746143126.312299:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858541184:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.312450:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858541184:12345-192.168.201.28@tcp:3:cat.0 Request processed in 150us (4293us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143126.312457:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5881 00002000:00100000:1.0:1746143126.312462:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1486848->1490943) req@ffff880094d7dc00 x1830962858541184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.312468:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7dc00 with x1830962858541184 ext(1486848->1490943) 00002000:00010000:1.0:1746143126.312471:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d7dc00 00000100:00100000:2.0:1746143126.313199:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861205760:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143126.313219:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c88f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc24 expref: 29 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.313229:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c88f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc24 expref: 29 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.313740:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd0000, rc 0) 00000100:00100000:2.0:1746143126.313770:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858541312:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2448us (3466us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143126.313776:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12095 00002000:00010000:2.0:1746143126.314844:0:4756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143123 -> 1746143125 00002000:00010000:2.0:1746143126.314849:0:4756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143123 -> 1746143125 00002000:00010000:2.0:1746143126.314851:0:4756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143123 -> 1746143125 00000100:00100000:2.0:1746143126.314870:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861205888:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143126.314896:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090019400/0x25aee876ca70c896 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc2b expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.314906:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090019400/0x25aee876ca70c896 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc2b expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.314913:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090019400, rc 0) 00000100:00100000:2.0:1746143126.314935:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858541440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2906us (3922us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143126.314941:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12096 00000100:00100000:1.0:1746143126.324502:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.325015:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.325409:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858541568 00000100:00100000:2.0:1746143126.325419:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858541568 00000100:00100000:2.0:1746143126.325469:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858541696 00000100:00100000:2.0:1746143126.325471:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858541696 00000100:00100000:2.0:1746143126.325497:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12097 00000100:00100000:2.0:1746143126.325504:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858541568:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143126.325524:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.325543:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c89d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc32 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143126.325595:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861206016:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143126.325666:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12098 00000100:00100000:2.0:1746143126.325670:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143126.325674:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858541696:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.325683:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.325694:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317b2000/0x25aee876ca70c8a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc39 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143126.325723:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861206144:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143126.325747:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143126.334130:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861206016:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143126.334166:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c89d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc32 expref: 29 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.334180:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0200/0x25aee876ca70c89d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc32 expref: 29 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.334197:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd0200, rc 0) 00000100:00100000:1.0:1746143126.334233:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861206144:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143126.334253:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317b2000/0x25aee876ca70c8a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc39 expref: 20 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.334263:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801317b2000/0x25aee876ca70c8a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc39 expref: 20 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.334716:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b2000, rc 0) 00000100:00100000:2.0:1746143126.335541:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858541568:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10035us (11049us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143126.335551:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12097 00000100:00100000:1.0:1746143126.335662:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858541696:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9987us (10645us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143126.335668:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12098 00000100:00100000:0.0:1746143126.380389:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.380523:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858541824 00000100:00100000:1.0:1746143126.380533:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858541824 00000100:00100000:1.0:1746143126.380592:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12099 00000100:00100000:1.0:1746143126.380602:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:30829:x1830962858541824:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143126.380624:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.380643:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc40 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.380681:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.380690:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.380698:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.380700:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.380705:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2129920->3096575] (req 2129920->3096575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 29 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.380738:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.380751:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 29 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143126.380764:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861206272:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143126.381222:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.381232:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 20 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143126.381242:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a24aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861206400:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143126.381597:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfde40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143126.387264:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861206272:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143126.387278:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a24aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861206400:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143126.387309:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2129920->3096575] (req 2129920->3096575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 29 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.387328:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b3a00, rc 0) 00000100:00100000:0.0:1746143126.388001:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.388075:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858541952 00000100:00100000:2.0:1746143126.388082:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858541952 00010000:00010000:2.0:1746143126.388112:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 30 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143126.388150:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:30829:x1830962858541824:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7548us (7773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.388161:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12099 00000100:00100000:2.0:1746143126.388735:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6392 00000100:00100000:2.0:1746143126.388744:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858541952:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143126.388757:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143126.388782:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 29 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.388969:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 29 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.388991:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3c00/0x25aee876ca70c873 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc08 expref: 29 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.389006:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143126.390223:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858541952:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1476us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.390231:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6392 00000100:00100000:1.0:1746143126.390410:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.390430:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858542080 00000100:00100000:3.0:1746143126.390435:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858542080 00010000:00010000:3.0:1746143126.390455:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 21 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.390478:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6393 00000100:00100000:3.0:1746143126.390483:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858542080:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.390491:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143126.390504:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 21 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.391208:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 21 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.391229:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3800/0x25aee876ca70c85e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbf3 expref: 21 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.391252:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.391254:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.391262:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 27 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.391270:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 27 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.391300:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 27 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143126.391313:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861206528:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143126.392187:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.395138:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861206528:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143126.395160:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143126.395213:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858542080:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4727us (4802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.395224:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6393 00000100:00100000:0.0:1746143126.396858:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.396932:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858542336 00000100:00100000:3.0:1746143126.396940:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858542336 00002000:00100000:3.0:1746143126.396979:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2129920->2134015) req@ffff8800a5e3b100 x1830962858542336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.396990:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3b100 with x1830962858542336 ext(2129920->2134015) 00002000:00010000:3.0:1746143126.396995:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3b100 00000100:00100000:3.0:1746143126.397023:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5882 00000100:00100000:3.0:1746143126.397054:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858542336:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143126.397552:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858542336:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 520us (699us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143126.397559:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5882 00002000:00100000:3.0:1746143126.397564:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2129920->2134015) req@ffff8800a5e3b100 x1830962858542336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.397572:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3b100 with x1830962858542336 ext(2129920->2134015) 00002000:00010000:3.0:1746143126.397575:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3b100 00000100:00100000:0.0:1746143126.406221:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.406273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.406442:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858542592 00000100:00100000:3.0:1746143126.406451:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858542592 00002000:00100000:3.0:1746143126.406498:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3092480->3096575) req@ffff8800a5e3bb80 x1830962858542592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143126.406605:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858542720 00000100:00100000:1.0:1746143126.406610:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858542720 00002000:00100000:3.0:1746143126.406630:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3bb80 with x1830962858542592 ext(3092480->3096575) 00002000:00010000:3.0:1746143126.406637:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3bb80 00000100:00100000:1.0:1746143126.406654:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12100 00000100:00100000:3.0:1746143126.406660:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5883 00000100:00100000:1.0:1746143126.406661:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858542720:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143126.406665:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858542592:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:1.0:1746143126.406675:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.406692:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b2800/0x25aee876ca70c8b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc47 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.406721:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2800/0x25aee876ca70c8b2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc47 expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.406731:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2800/0x25aee876ca70c8b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc47 expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.406751:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b2800, rc 0) 00000100:00100000:1.0:1746143126.406991:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858542720:12345-192.168.201.28@tcp:101:cat.0 Request processed in 331us (717us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143126.406998:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12100 00000100:00100000:3.0:1746143126.407064:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858542592:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 397us (851us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143126.407069:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5883 00002000:00100000:3.0:1746143126.407074:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3092480->3096575) req@ffff8800a5e3bb80 x1830962858542592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.407080:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3bb80 with x1830962858542592 ext(3092480->3096575) 00002000:00010000:3.0:1746143126.407083:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3bb80 00000100:00100000:0.0:1746143126.412294:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.412366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.412441:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858543104 00000100:00100000:3.0:1746143126.412451:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858543104 00000100:00100000:2.0:1746143126.412490:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858543232 00000100:00100000:2.0:1746143126.412495:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858543232 00002000:00100000:3.0:1746143126.412497:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->638975) req@ffff8800a5e3a680 x1830962858543104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.412507:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3a680 with x1830962858543104 ext(0->638975) 00002000:00010000:3.0:1746143126.412513:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3a680 00002000:00100000:2.0:1746143126.412516:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1490944->2097151) req@ffff8800a5e3b800 x1830962858543232/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.412523:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3b800 with x1830962858543232 ext(1490944->2097151) 00002000:00010000:2.0:1746143126.412527:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e3b800 00000100:00100000:3.0:1746143126.412533:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5884 00000100:00100000:3.0:1746143126.412539:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858543104:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143126.412539:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5885 00000100:00100000:2.0:1746143126.412543:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858543232:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143126.424555:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858543104:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12004us (12906us total) trans 0 rc 638976/638976 00000100:00100000:3.0:1746143126.424567:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5884 00002000:00100000:3.0:1746143126.424579:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fc:0x0] (0->638975) req@ffff8800a5e3a680 x1830962858543104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 638976/638976 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.424588:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3a680 with x1830962858543104 ext(0->638975) 00002000:00010000:3.0:1746143126.424595:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3a680 00000100:00100000:2.0:1746143126.424807:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858543232:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12261us (12441us total) trans 0 rc 606208/606208 00000100:00100000:2.0:1746143126.424814:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5885 00002000:00100000:2.0:1746143126.424819:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1490944->2097151) req@ffff8800a5e3b800 x1830962858543232/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 606208/606208 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.424833:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3b800 with x1830962858543232 ext(1490944->2097151) 00002000:00010000:2.0:1746143126.424837:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e3b800 00000100:00100000:0.0:1746143126.438747:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.438963:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858543360 00000100:00100000:1.0:1746143126.438972:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858543360 00000100:00100000:1.0:1746143126.439062:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12101 00000100:00100000:1.0:1746143126.439071:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30838:x1830962858543360:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.439607:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.439626:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc4e expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.439943:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 27 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.439952:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.439954:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.439958:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 21 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.439989:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 27 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.440002:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 27 pid: 754 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143126.440015:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a24b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861206656:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143126.441081:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfde40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.446888:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.446937:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858543488 00000100:00100000:2.0:1746143126.446945:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858543488 00002000:00100000:2.0:1746143126.446985:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2129920->3096575) req@ffff8800a5e38e00 x1830962858543488/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.446992:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e38e00 with x1830962858543488 ext(2129920->3096575) 00010000:00010000:2.0:1746143126.447000:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 28 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.447011:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 28 pid: 754 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143126.447016:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e38e00 00000100:00100000:1.0:1746143126.447408:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a24b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861206656:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143126.447619:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 21 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.447634:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b2a00, rc 0) 00000100:00100000:1.0:1746143126.447677:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30838:x1830962858543360:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8606us (8941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.447685:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12101 00000100:00100000:2.0:1746143126.447754:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1941 00000100:00100000:2.0:1746143126.447761:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858543488:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:2.0:1746143126.470982:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858543488:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 23209us (24092us total) trans 21474839965 rc 0/0 00000100:00100000:2.0:1746143126.470996:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1941 00002000:00100000:2.0:1746143126.471010:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2129920->3096575) req@ffff8800a5e38e00 x1830962858543488/t21474839965(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/448 e 0 to 0 dl 1746143137 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.471018:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e38e00 with x1830962858543488 ext(2129920->3096575) 00010000:00010000:2.0:1746143126.471041:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 30 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.471058:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 30 pid: 754 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143126.471065:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e38e00 00000100:00100000:3.0:1746143126.484396:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.484654:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.485159:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858543744 00000100:00100000:3.0:1746143126.485168:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858543744 00010000:00010000:3.0:1746143126.485209:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 30 pid: 754 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.485238:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6394 00000100:00100000:3.0:1746143126.485246:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858543744:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.485262:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143126.485283:0:4759:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143124 -> 1746143125 00002000:00010000:3.0:1746143126.485286:0:4759:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143124 -> 1746143125 00010000:00010000:3.0:1746143126.485291:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 30 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.485303:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 30 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.485327:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3a00/0x25aee876ca70c8ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2129920->3145727] (req 2129920->3096575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc40 expref: 30 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.485360:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.485363:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.485370:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.485573:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.485609:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 20 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143126.485621:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861206784:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143126.485702:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.485724:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858543616 00000100:00100000:3.0:1746143126.485727:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858543616 00000100:00100000:3.0:1746143126.485748:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858543872 00000100:00100000:3.0:1746143126.485750:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858543872 00000100:00100000:0.0:1746143126.485779:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12102 00000100:00100000:0.0:1746143126.485788:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858543616:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143126.485803:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143126.485815:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090018800/0x25aee876ca70c8c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc55 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143126.485827:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12103 00000100:00100000:3.0:1746143126.485833:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858543872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143126.485842:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143126.485848:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861206912:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143126.485852:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b608200/0x25aee876ca70c8c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc5c expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143126.485878:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861207040:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143126.486022:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.486129:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858544000 00000100:00100000:3.0:1746143126.486132:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858544000 00000100:00100000:3.0:1746143126.486149:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12104 00000100:00100000:3.0:1746143126.486153:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858544000:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143126.486159:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143126.486165:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc63 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.486176:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.486178:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.486182:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 33 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.486192:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 33 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.486200:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b608a00, rc 0) 00000100:00100000:3.0:1746143126.486408:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1968:x1830962858544000:12345-192.168.201.28@tcp:101:cat.0 Request processed in 252us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.486414:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12104 00000100:00100000:3.0:1746143126.486659:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.486939:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.487027:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.495914:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861206784:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143126.495938:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143126.495988:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858543744:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10742us (11332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.495999:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6394 00000100:00100000:1.0:1746143126.496019:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861206912:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143126.496072:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090018800/0x25aee876ca70c8c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc55 expref: 31 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.496086:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090018800/0x25aee876ca70c8c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc55 expref: 31 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.496101:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090018800, rc 0) 00000100:00100000:2.0:1746143126.496103:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861207040:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143126.496120:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b608200/0x25aee876ca70c8c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc5c expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143126.496122:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858543616:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10336us (11738us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143126.496128:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12102 00010000:00010000:2.0:1746143126.496130:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b608200/0x25aee876ca70c8c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc5c expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.496140:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b608200, rc 0) 00000100:00100000:2.0:1746143126.496156:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858543872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10324us (10455us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143126.496161:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12103 00000100:00100000:0.0:1746143126.499601:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.499643:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.499666:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858544256 00000100:00100000:2.0:1746143126.499702:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858544512 00000100:00100000:2.0:1746143126.499706:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858544512 00002000:00100000:2.0:1746143126.499750:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800942c5c00 x1830962858544512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.499759:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5c00 with x1830962858544512 ext(3145728->4194303) 00002000:00010000:2.0:1746143126.499765:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c5c00 00000100:00100000:2.0:1746143126.499793:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5886 00000100:00100000:2.0:1746143126.499801:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858544512:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143126.499832:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858544256 00002000:00100000:3.0:1746143126.499850:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800942c6d80 x1830962858544256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.499857:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6d80 with x1830962858544256 ext(2097152->3145727) 00002000:00010000:3.0:1746143126.499860:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c6d80 00000100:00100000:3.0:1746143126.499878:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5887 00000100:00100000:3.0:1746143126.499883:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858544256:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.502409:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.505157:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858544640 00000100:00100000:3.0:1746143126.505170:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858544640 00000100:00100000:3.0:1746143126.505225:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12105 00000100:00100000:3.0:1746143126.505233:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:30842:x1830962858544640:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143126.505278:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143126.505298:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc6a expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.505331:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.505356:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143126.505358:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143126.505362:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 31 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.505391:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.505403:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 24 pid: 8449 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.505413:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861207168:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143126.505482:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.508128:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861207168:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143126.508156:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 31 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.508172:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b608e00, rc 0) 00000100:00100000:3.0:1746143126.508209:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:30842:x1830962858544640:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2976us (5806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.508217:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12105 00010000:00010000:1.0:1746143126.510249:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143126.511758:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.511847:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858544768 00000100:00100000:1.0:1746143126.511855:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858544768 00002000:00100000:1.0:1746143126.511896:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (638976->1048575) req@ffff8800942c7b80 x1830962858544768/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.511905:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7b80 with x1830962858544768 ext(638976->1048575) 00010000:00010000:1.0:1746143126.511926:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 25 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.511939:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 25 pid: 8449 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746143126.511947:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c7b80 00000100:00100000:1.0:1746143126.511964:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1942 00000100:00100000:1.0:1746143126.511970:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858544768:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143126.513472:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858544256:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13580us (13871us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143126.513482:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5887 00002000:00100000:3.0:1746143126.513490:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800942c6d80 x1830962858544256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.513498:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6d80 with x1830962858544256 ext(2097152->3145727) 00002000:00010000:3.0:1746143126.513503:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c6d80 00000100:00100000:2.0:1746143126.518465:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858544512:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18653us (18809us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143126.518478:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5886 00002000:00100000:2.0:1746143126.518490:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800942c5c00 x1830962858544512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.518500:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5c00 with x1830962858544512 ext(3145728->4194303) 00002000:00010000:2.0:1746143126.518507:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c5c00 00000100:00100000:0.0:1746143126.532643:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.532741:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858544896 00000100:00100000:3.0:1746143126.532751:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858544896 00000100:00100000:3.0:1746143126.533052:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12106 00000100:00100000:3.0:1746143126.533061:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858544896:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143126.534739:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143126.534763:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b608c00/0x25aee876ca70c8dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc71 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143126.534990:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861207296:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143126.535068:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858544768:12345-192.168.201.28@tcp:4:cat.0 Request processed in 23095us (23316us total) trans 21474839966 rc 0/0 00000100:00100000:2.0:1746143126.535078:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1942 00002000:00100000:2.0:1746143126.535089:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (638976->1048575) req@ffff8800942c7b80 x1830962858544768/t21474839966(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/448 e 0 to 0 dl 1746143137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.535098:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7b80 with x1830962858544768 ext(638976->1048575) 00010000:00010000:2.0:1746143126.535105:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 25 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.535118:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 25 pid: 8449 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143126.535125:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c7b80 00000100:00100000:3.0:1746143126.536487:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.542322:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861207296:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143126.542366:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b608c00/0x25aee876ca70c8dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc71 expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.542381:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b608c00/0x25aee876ca70c8dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc71 expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.542397:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b608c00, rc 0) 00000100:00100000:3.0:1746143126.544844:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858544896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11772us (12199us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143126.544855:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12106 00000100:00100000:0.0:1746143126.545744:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.547688:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858545024 00000100:00100000:3.0:1746143126.547700:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858545024 00010000:00010000:3.0:1746143126.547741:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 23 pid: 8449 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.547785:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6395 00000100:00100000:3.0:1746143126.547792:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858545024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.547806:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143126.547830:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 23 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.547842:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 23 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.547865:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090019200/0x25aee876ca70c87a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc0f expref: 23 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.547880:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.547882:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.547895:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.547904:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.547937:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143126.547948:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861207424:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143126.548068:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.551801:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.552081:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858545152 00000100:00100000:3.0:1746143126.552087:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858545152 00000100:00100000:1.0:1746143126.553466:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12107 00000100:00100000:1.0:1746143126.553478:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858545152:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.553497:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.553532:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc78 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.553555:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.553558:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.553568:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.553584:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.553595:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b2200, rc 0) 00000100:00100000:1.0:1746143126.553642:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858545152:12345-192.168.201.28@tcp:101:cat.0 Request processed in 168us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.553648:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12107 00000100:00100000:3.0:1746143126.578951:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861207424:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143126.578978:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143126.579028:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858545024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 31235us (33286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.579057:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6395 00000100:00100000:1.0:1746143126.579230:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.579394:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858545408 00000100:00100000:2.0:1746143126.579400:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858545408 00002000:00100000:2.0:1746143126.579436:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009a24aa00 x1830962858545408/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.579446:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24aa00 with x1830962858545408 ext(0->1048575) 00002000:00010000:2.0:1746143126.579451:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a24aa00 00000100:00100000:2.0:1746143126.579467:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5888 00000100:00100000:2.0:1746143126.579473:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1970:x1830962858545408:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143126.592059:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1970:x1830962858545408:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12573us (12818us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143126.592071:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5888 00002000:00100000:2.0:1746143126.592083:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009a24aa00 x1830962858545408/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.592094:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24aa00 with x1830962858545408 ext(0->1048575) 00002000:00010000:2.0:1746143126.592100:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a24aa00 00000100:00100000:0.0:1746143126.597484:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.598077:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858545536 00000100:00100000:3.0:1746143126.598088:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858545536 00000100:00100000:3.0:1746143126.598146:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12108 00000100:00100000:3.0:1746143126.598155:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30842:x1830962858545536:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143126.598175:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143126.598194:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc7f expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.598225:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.598234:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143126.598236:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143126.598240:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.598268:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.598280:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 34 pid: 8449 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.598293:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861207552:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143126.598387:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.601716:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861207552:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143126.601747:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.601763:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b609000, rc 0) 00000100:00100000:3.0:1746143126.601803:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30842:x1830962858545536:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3649us (4329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.601811:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12108 00000100:00100000:0.0:1746143126.602712:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.602783:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858545664 00000100:00100000:2.0:1746143126.602789:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858545664 00002000:00100000:2.0:1746143126.602823:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1490943) req@ffff880094427800 x1830962858545664/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.602834:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427800 with x1830962858545664 ext(1048576->1490943) 00010000:00010000:2.0:1746143126.602842:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 35 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.602854:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 35 pid: 8449 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143126.602861:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094427800 00000100:00100000:2.0:1746143126.603547:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1943 00000100:00100000:2.0:1746143126.603555:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858545664:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143126.610782:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.611143:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858545792 00000100:00100000:3.0:1746143126.611153:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858545792 00000100:00100000:3.0:1746143126.611212:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12109 00000100:00100000:3.0:1746143126.611221:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30844:x1830962858545792:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143126.611242:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143126.611260:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc86 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.611290:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 21 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.611298:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 36 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.611309:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.611311:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143126.611314:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 21 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.611355:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 36 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143126.611367:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 36 pid: 21048 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746143126.611380:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861207680:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143126.611469:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 21 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.611478:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 21 pid: 21048 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.611486:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861207808:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143126.611503:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.617683:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861207680:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143126.617695:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861207808:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143126.617727:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 21 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.617749:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b609200, rc 0) 00000100:00100000:3.0:1746143126.617805:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:30844:x1830962858545792:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6585us (7033us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.617813:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12109 00000100:00100000:2.0:1746143126.622688:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1969:x1830962858545664:12345-192.168.201.28@tcp:4:cat.0 Request processed in 19116us (19960us total) trans 17179872708 rc 0/0 00000100:00100000:2.0:1746143126.622709:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1943 00002000:00100000:2.0:1746143126.622724:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1490943) req@ffff880094427800 x1830962858545664/t17179872708(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/448 e 0 to 0 dl 1746143137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.622736:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427800 with x1830962858545664 ext(1048576->1490943) 00010000:00010000:2.0:1746143126.622748:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 37 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.622763:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 37 pid: 8449 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143126.622771:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094427800 00000100:00100000:0.0:1746143126.623140:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.623295:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858545920 00000100:00100000:3.0:1746143126.623303:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858545920 00010000:00010000:3.0:1746143126.623329:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 21 pid: 21048 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.623371:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6396 00000100:00100000:3.0:1746143126.623378:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858545920:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.623391:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143126.623415:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 21 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.623425:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 21 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.623449:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013011b600/0x25aee876ca70c811 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fba6 expref: 21 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.623474:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143126.623511:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858545920:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 134us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.623518:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6396 00000100:00100000:0.0:1746143126.627598:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.627697:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858546048 00000100:00100000:2.0:1746143126.627706:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858546048 00010000:00010000:2.0:1746143126.627740:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 37 pid: 21048 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143126.627783:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6397 00000100:00100000:2.0:1746143126.627791:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1969:x1830962858546048:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143126.627806:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143126.627830:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 37 pid: 21048 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143126.627842:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 37 pid: 21048 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143126.627872:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3600/0x25aee876ca70c83b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbd0 expref: 37 pid: 21048 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143126.627900:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143126.627902:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143126.627909:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.627917:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.627950:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143126.627963:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861207936:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143126.628070:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143126.630175:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861207936:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143126.630195:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143126.630409:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858546048:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2618us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.630419:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6397 00000100:00100000:0.0:1746143126.631643:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.632381:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858546176 00000100:00100000:2.0:1746143126.632389:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858546176 00010000:00010000:2.0:1746143126.632423:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 36 pid: 8449 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143126.632467:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6398 00000100:00100000:2.0:1746143126.632474:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858546176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143126.632710:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143126.632734:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 36 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.632747:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 36 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.632771:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba21800/0x25aee876ca70c881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc16 expref: 36 pid: 8449 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143126.632791:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143126.632792:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143126.632799:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.632807:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.632836:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143126.635584:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861208064:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143126.635720:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143126.636763:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.637007:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858546432 00000100:00100000:0.0:1746143126.637014:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858546432 00002000:00100000:0.0:1746143126.637076:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3018752->3022847) req@ffff88009b598700 x1830962858546432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.637086:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598700 with x1830962858546432 ext(3018752->3022847) 00002000:00010000:0.0:1746143126.637091:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598700 00000100:00100000:0.0:1746143126.637113:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5889 00000100:00100000:0.0:1746143126.637119:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858546432:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143126.637273:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858546432:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 153us (511us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143126.637280:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5889 00002000:00100000:0.0:1746143126.637286:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3018752->3022847) req@ffff88009b598700 x1830962858546432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.637294:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598700 with x1830962858546432 ext(3018752->3022847) 00002000:00010000:0.0:1746143126.637296:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598700 00000100:00100000:0.0:1746143126.642599:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.642797:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861208064:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143126.642822:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143126.642882:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858546176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10406us (11240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.642894:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6398 00000100:00100000:3.0:1746143126.642989:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858546688 00000100:00100000:3.0:1746143126.642996:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858546688 00002000:00100000:3.0:1746143126.643071:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb76d80 x1830962858546688/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.643082:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb76d80 with x1830962858546688 ext(1048576->2097151) 00002000:00010000:3.0:1746143126.643087:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb76d80 00000100:00100000:3.0:1746143126.643109:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5890 00000100:00100000:3.0:1746143126.643117:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858546688:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143126.643641:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.644170:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858546816 00000100:00100000:2.0:1746143126.644174:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858546816 00000100:00100000:2.0:1746143126.644211:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12110 00000100:00100000:2.0:1746143126.644217:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:30844:x1830962858546816:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143126.644228:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.644245:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc8d expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.644271:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 22 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.644279:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.644287:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.644295:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143126.644297:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143126.644301:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->3559423] (req 3145728->3559423) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 32 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.644345:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.644362:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 32 pid: 21048 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143126.644374:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861208192:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143126.644442:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.644450:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 32 pid: 4758 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143126.644457:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861208320:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143126.644478:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 22 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.644485:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 22 pid: 754 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143126.644492:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861208448:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143126.644523:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143126.647205:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861208192:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143126.647219:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861208320:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143126.647227:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861208448:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143126.647255:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->3559423] (req 3145728->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 32 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.647271:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093171600, rc 0) 00000100:00100000:2.0:1746143126.649752:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:30844:x1830962858546816:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5524us (6100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.649764:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12110 00000100:00100000:0.0:1746143126.650936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.653531:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.653584:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.653726:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858547072 00000100:00100000:3.0:1746143126.653735:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858547072 00010000:00010000:3.0:1746143126.653769:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 32 pid: 4758 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746143126.653802:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858546944 00000100:00100000:3.0:1746143126.653804:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858546944 00010000:00010000:3.0:1746143126.653813:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 33 pid: 21048 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.653825:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858547200 00000100:00100000:3.0:1746143126.653827:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858547200 00010000:00010000:3.0:1746143126.653835:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 23 pid: 754 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143126.653848:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6399 00000100:00100000:3.0:1746143126.653854:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1968:x1830962858547072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.653869:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143126.653892:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 33 pid: 4758 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746143126.653903:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 33 pid: 4758 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746143126.653926:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b608a00/0x25aee876ca70c8ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc63 expref: 33 pid: 4758 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746143126.653966:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143126.654007:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858547072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 153us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.654013:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6399 00000100:00100000:3.0:1746143126.654030:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6400 00000100:00100000:3.0:1746143126.654034:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858546944:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143126.654042:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143126.654067:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 31 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.654076:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 31 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.654087:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b3400/0x25aee876ca70c826 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbbb expref: 31 pid: 21048 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.654096:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143126.654306:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6401 00000100:00100000:1.0:1746143126.654314:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858547200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143126.654322:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143126.654331:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 23 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.654360:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 23 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.654374:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2a00/0x25aee876ca70c8b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc4e expref: 23 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.654388:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.654390:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.654397:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.654405:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.654438:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143126.654450:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861208576:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143126.654916:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858546944:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 879us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143126.654926:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6400 00000100:00100000:1.0:1746143126.655777:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfde40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.657259:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858546688:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 14136us (14664us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143126.657270:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5890 00002000:00100000:3.0:1746143126.657281:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb76d80 x1830962858546688/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.657290:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb76d80 with x1830962858546688 ext(1048576->2097151) 00002000:00010000:3.0:1746143126.657296:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb76d80 00000100:00100000:1.0:1746143126.659475:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861208576:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143126.659496:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143126.659538:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858547200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5224us (5952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.659550:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6401 00000100:00100000:0.0:1746143126.664661:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.664874:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858547456 00000100:00100000:3.0:1746143126.664884:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858547456 00002000:00100000:3.0:1746143126.664930:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3555328->3559423) req@ffff88012b801500 x1830962858547456/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.664940:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801500 with x1830962858547456 ext(3555328->3559423) 00002000:00010000:3.0:1746143126.664946:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b801500 00000100:00100000:3.0:1746143126.664965:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5891 00000100:00100000:3.0:1746143126.664971:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858547456:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143126.665186:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858547456:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 214us (536us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143126.665192:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5891 00002000:00100000:3.0:1746143126.665197:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3555328->3559423) req@ffff88012b801500 x1830962858547456/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.665205:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801500 with x1830962858547456 ext(3555328->3559423) 00002000:00010000:3.0:1746143126.665207:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b801500 00000100:00100000:0.0:1746143126.684621:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.687661:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858547584 00000100:00100000:2.0:1746143126.687677:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858547584 00000100:00100000:2.0:1746143126.687752:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12111 00000100:00100000:2.0:1746143126.687762:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:30842:x1830962858547584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143126.687783:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.687808:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc94 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.687837:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143126.687840:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143126.687848:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 31 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.687863:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 31 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.687874:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d928200, rc 0) 00000100:00100000:2.0:1746143126.687940:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:30842:x1830962858547584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 179us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.687946:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12111 00000100:00100000:0.0:1746143126.705453:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.705529:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858547840 00000100:00100000:3.0:1746143126.705538:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858547840 00002000:00100000:3.0:1746143126.705584:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88012d3d4e00 x1830962858547840/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.705595:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d4e00 with x1830962858547840 ext(2097152->3145727) 00002000:00010000:3.0:1746143126.705602:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3d4e00 00000100:00100000:3.0:1746143126.705637:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5892 00000100:00100000:3.0:1746143126.705645:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1968:x1830962858547840:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143126.706613:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.709316:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.709366:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.709387:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858548096 00000100:00100000:3.0:1746143126.709388:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858548352 00000100:00100000:3.0:1746143126.709394:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858548352 00000100:00100000:0.0:1746143126.709394:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858548096 00002000:00100000:3.0:1746143126.709429:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3272703) req@ffff8800a5840a80 x1830962858548352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 504/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.709429:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3559424->4194303) req@ffff8800a5840000 x1830962858548096/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.709439:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840a80 with x1830962858548352 ext(2097152->3272703) 00002000:00100000:0.0:1746143126.709439:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840000 with x1830962858548096 ext(3559424->4194303) 00002000:00010000:3.0:1746143126.709445:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840a80 00002000:00010000:0.0:1746143126.709445:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5840000 00000100:00100000:3.0:1746143126.710313:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858548608 00000100:00100000:3.0:1746143126.710317:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858548608 00002000:00100000:3.0:1746143126.710344:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3272704->4194303) req@ffff8800a5843800 x1830962858548608/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.710350:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5843800 with x1830962858548608 ext(3272704->4194303) 00002000:00010000:3.0:1746143126.710354:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5843800 00000100:00100000:0.0:1746143126.714844:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5893 00000100:00100000:0.0:1746143126.714866:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858548352:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.714875:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5894 00000100:00100000:1.0:1746143126.714886:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1968:x1830962858548096:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143126.714973:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5895 00000100:00100000:2.0:1746143126.714982:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858548608:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143126.744106:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1968:x1830962858547840:12345-192.168.201.28@tcp:3:cat.0 Request processed in 38448us (38651us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143126.744121:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5892 00002000:00100000:3.0:1746143126.744134:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88012d3d4e00 x1830962858547840/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.744152:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d4e00 with x1830962858547840 ext(2097152->3145727) 00002000:00010000:3.0:1746143126.744159:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3d4e00 00000100:00100000:2.0:1746143126.758012:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858548608:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43020us (48634us total) trans 0 rc 921600/921600 00000100:00100000:1.0:1746143126.758224:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858548352:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43368us (48915us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143126.758733:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5895 00002000:00100000:2.0:1746143126.758747:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3272704->4194303) req@ffff8800a5843800 x1830962858548608/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 921600/921600 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.758830:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5843800 with x1830962858548608 ext(3272704->4194303) 00002000:00010000:2.0:1746143126.758845:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5843800 00000100:00100000:1.0:1746143126.759183:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5893 00002000:00100000:1.0:1746143126.759191:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3272703) req@ffff8800a5840a80 x1830962858548352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 504/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.759198:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840a80 with x1830962858548352 ext(2097152->3272703) 00002000:00010000:1.0:1746143126.759201:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840a80 00000100:00100000:0.0:1746143126.759689:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1968:x1830962858548096:12345-192.168.201.28@tcp:3:cat.0 Request processed in 44803us (53076us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746143126.759697:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5894 00002000:00100000:0.0:1746143126.759703:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3559424->4194303) req@ffff8800a5840000 x1830962858548096/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.759710:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840000 with x1830962858548096 ext(3559424->4194303) 00002000:00010000:0.0:1746143126.759714:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5840000 00000100:00100000:0.0:1746143126.766696:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.767075:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858548736 00000100:00100000:2.0:1746143126.767085:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858548736 00000100:00100000:2.0:1746143126.767147:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12112 00000100:00100000:2.0:1746143126.767155:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30846:x1830962858548736:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143126.767175:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.767193:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fc9b expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.767225:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.767232:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143126.767234:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143126.767238:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.767268:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.767279:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 30 pid: 4756 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143126.767291:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861208704:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143126.767396:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.779938:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.780253:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861208704:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143126.780455:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143126.781377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143126.781442:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d929a00, rc 0) 00000100:00100000:2.0:1746143126.781489:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30846:x1830962858548736:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14334us (14804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143126.781497:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12112 00000100:00100000:2.0:1746143126.781528:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858548864 00000100:00100000:1.0:1746143126.781781:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858548992 00000100:00100000:1.0:1746143126.781788:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858548992 00010000:00010000:1.0:1746143126.781816:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 31 pid: 4756 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143126.781845:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6402 00000100:00100000:1.0:1746143126.781851:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858548992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143126.781864:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143126.781887:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 31 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.781898:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 31 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.781921:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d928200/0x25aee876ca70c8ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc94 expref: 31 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.781947:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.781948:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.781955:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 22 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.781968:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 22 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.781998:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 22 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143126.782010:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861208832:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143126.782070:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858548864 00000100:00100000:2.0:1746143126.782090:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12113 00000100:00100000:2.0:1746143126.782095:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1968:x1830962858548864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143126.782108:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.782123:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d929c00/0x25aee876ca70c90d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fca2 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.782147:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d929c00/0x25aee876ca70c90d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca2 expref: 32 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.782156:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d929c00/0x25aee876ca70c90d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca2 expref: 32 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.782171:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d929c00, rc 0) 00000100:00100000:1.0:1746143126.785201:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfde40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.785694:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1968:x1830962858548864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3592us (5759us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143126.785705:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12113 00000100:00100000:1.0:1746143126.789205:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861208832:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143126.789228:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143126.789286:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858548992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7433us (7909us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.789298:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6402 00000100:00100000:0.0:1746143126.789314:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.789600:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858549248 00000100:00100000:1.0:1746143126.789607:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858549248 00002000:00100000:1.0:1746143126.789644:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2490368->2494463) req@ffff8800a5843480 x1830962858549248/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.789654:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5843480 with x1830962858549248 ext(2490368->2494463) 00002000:00010000:1.0:1746143126.789659:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5843480 00000100:00100000:1.0:1746143126.789677:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5896 00000100:00100000:1.0:1746143126.789684:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858549248:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143126.789858:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858549248:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 174us (551us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143126.789868:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5896 00002000:00100000:1.0:1746143126.789873:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2490368->2494463) req@ffff8800a5843480 x1830962858549248/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.789880:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5843480 with x1830962858549248 ext(2490368->2494463) 00002000:00010000:1.0:1746143126.789883:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5843480 00000100:00100000:0.0:1746143126.799521:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.799568:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.799604:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.799640:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858549376 00000100:00100000:1.0:1746143126.799649:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858549376 00000100:00100000:3.0:1746143126.799683:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858549504 00000100:00100000:3.0:1746143126.799695:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858549504 00000100:00100000:1.0:1746143126.799695:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858549632 00000100:00100000:1.0:1746143126.799697:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858549632 00000100:00100000:1.0:1746143126.799717:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12114 00000100:00100000:1.0:1746143126.799723:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1971:x1830962858549376:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143126.799735:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12115 00010000:00010000:1.0:1746143126.799741:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143126.799744:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1971:x1830962858549632:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.799759:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fca9 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143126.799762:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143126.799776:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093114e00/0x25aee876ca70c91b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcb7 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.799782:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.799785:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143126.799794:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 38 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.799810:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 38 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143126.799822:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b3c00, rc 0) 00000100:00100000:3.0:1746143126.799829:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861208960:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143126.799869:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1971:x1830962858549376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.799880:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12114 00000100:00100000:3.0:1746143126.799908:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.799910:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.800129:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858549760 00000100:00100000:0.0:1746143126.800133:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858549760 00000100:00100000:0.0:1746143126.800159:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12116 00000100:00100000:0.0:1746143126.800165:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858549504:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143126.800176:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143126.800186:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd0a00/0x25aee876ca70c922 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcb0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.800207:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd0a00/0x25aee876ca70c922 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcb0 expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.800218:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0a00/0x25aee876ca70c922 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcb0 expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.800234:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd0a00, rc 0) 00000100:00100000:0.0:1746143126.800254:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858549504:12345-192.168.201.28@tcp:101:cat.0 Request processed in 89us (686us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143126.800260:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12116 00000100:00100000:0.0:1746143126.800274:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12117 00000100:00100000:0.0:1746143126.800279:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858549760:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143126.800286:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143126.800292:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd1200/0x25aee876ca70c929 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcbe expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.800307:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd1200/0x25aee876ca70c929 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcbe expref: 31 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.800320:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd1200/0x25aee876ca70c929 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcbe expref: 31 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.800342:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd1200, rc 0) 00000100:00100000:0.0:1746143126.801653:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858549760:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1369us (1739us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143126.801661:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12117 00002000:00010000:0.0:1746143126.802884:0:26949:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143124 -> 1746143125 00002000:00010000:0.0:1746143126.802890:0:26949:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143124 -> 1746143125 00002000:00010000:0.0:1746143126.802892:0:26949:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143124 -> 1746143125 00000100:00100000:0.0:1746143126.802917:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861208960:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143126.802948:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093114e00/0x25aee876ca70c91b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcb7 expref: 37 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.802962:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093114e00/0x25aee876ca70c91b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcb7 expref: 37 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.802972:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093114e00, rc 0) 00000100:00100000:0.0:1746143126.803020:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1971:x1830962858549632:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3275us (3413us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143126.803026:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12115 00000100:00100000:0.0:1746143126.807365:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.807872:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.808287:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858549888 00000100:00100000:2.0:1746143126.808298:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858549888 00000100:00100000:2.0:1746143126.808705:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858550016 00000100:00100000:2.0:1746143126.808709:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858550016 00000100:00100000:1.0:1746143126.808785:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12118 00000100:00100000:1.0:1746143126.808796:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:30846:x1830962858549888:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143126.808815:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.808834:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcc5 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.808867:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.808875:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.808877:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.808881:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 37 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.808912:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.808925:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 19 pid: 4756 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143126.808937:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861209088:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143126.809216:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12119 00000100:00100000:2.0:1746143126.809223:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858550016:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143126.809232:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143126.809242:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d929c00/0x25aee876ca70c937 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fccc expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143126.809264:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d929c00/0x25aee876ca70c937 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fccc expref: 31 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.809274:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d929c00/0x25aee876ca70c937 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fccc expref: 31 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143126.809290:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d929c00, rc 0) 00000100:00100000:2.0:1746143126.809315:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858550016:12345-192.168.201.28@tcp:101:cat.0 Request processed in 93us (1444us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143126.809325:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12119 00000100:00100000:1.0:1746143126.810537:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.816767:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.816831:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.816940:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858550272 00000100:00100000:1.0:1746143126.816950:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858550272 00002000:00100000:1.0:1746143126.816996:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092aec380 x1830962858550272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.817007:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec380 with x1830962858550272 ext(0->1048575) 00002000:00010000:1.0:1746143126.817012:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aec380 00000100:00100000:1.0:1746143126.817066:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858550528 00000100:00100000:1.0:1746143126.817068:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858550528 00002000:00100000:1.0:1746143126.817082:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880092aed180 x1830962858550528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.817088:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aed180 with x1830962858550528 ext(1048576->2097151) 00002000:00010000:1.0:1746143126.817092:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092aed180 00000100:00100000:1.0:1746143126.817103:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5897 00000100:00100000:1.0:1746143126.817108:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858550272:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.818832:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5898 00000100:00100000:1.0:1746143126.818842:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1968:x1830962858550528:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143126.822372:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.825236:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861209088:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143126.825271:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 39 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.825290:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317b3200, rc 0) 00000100:00100000:3.0:1746143126.827608:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858550656 00000100:00100000:3.0:1746143126.827623:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858550656 00002000:00100000:3.0:1746143126.827675:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3018752->3145727) req@ffff880092aee680 x1830962858550656/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.827686:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aee680 with x1830962858550656 ext(3018752->3145727) 00010000:00010000:3.0:1746143126.827696:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 20 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143126.827713:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 20 pid: 4756 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143126.827725:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aee680 00000100:00100000:3.0:1746143126.827747:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1944 00000100:00100000:3.0:1746143126.827755:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858550656:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143126.832499:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:30846:x1830962858549888:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 23690us (25129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143126.832511:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12118 00000100:00100000:1.0:1746143126.833377:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858550272:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16267us (16622us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143126.833386:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5897 00002000:00100000:1.0:1746143126.833399:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092aec380 x1830962858550272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.833409:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec380 with x1830962858550272 ext(0->1048575) 00002000:00010000:1.0:1746143126.833415:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aec380 00000100:00100000:2.0:1746143126.838779:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858550528:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19929us (21938us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143126.838790:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5898 00002000:00100000:2.0:1746143126.838802:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880092aed180 x1830962858550528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143126.838811:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aed180 with x1830962858550528 ext(1048576->2097151) 00002000:00010000:2.0:1746143126.838817:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092aed180 00000100:00100000:1.0:1746143126.839790:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858550656:12345-192.168.201.28@tcp:4:cat.0 Request processed in 12028us (17423us total) trans 17179872709 rc 0/0 00000100:00100000:1.0:1746143126.839801:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1944 00002000:00100000:1.0:1746143126.839811:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3018752->3145727) req@ffff880092aee680 x1830962858550656/t17179872709(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/448 e 0 to 0 dl 1746143137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.839820:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aee680 with x1830962858550656 ext(3018752->3145727) 00010000:00010000:1.0:1746143126.839830:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 22 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.839845:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 22 pid: 4756 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746143126.839851:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aee680 00000100:00100000:0.0:1746143126.847835:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.847861:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858550784 00000100:00100000:0.0:1746143126.847868:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858550784 00010000:00010000:0.0:1746143126.847898:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 22 pid: 4756 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.847920:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6403 00000100:00100000:0.0:1746143126.847926:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858550784:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143126.847936:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143126.847953:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 22 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.847964:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 22 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.847982:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b609200/0x25aee876ca70c8f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc86 expref: 22 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.847993:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.847995:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.848000:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 36 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.848008:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 36 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.848053:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 36 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143126.848064:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861209216:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143126.848121:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143126.853547:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.853571:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858550912 00000100:00100000:1.0:1746143126.853578:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858550912 00000100:00100000:1.0:1746143126.853612:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12120 00000100:00100000:1.0:1746143126.853619:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30851:x1830962858550912:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143126.853635:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143126.853649:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcd3 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.853679:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 24 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.853686:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.853688:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143126.853691:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.853718:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 24 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143126.853728:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 24 pid: 4756 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143126.853741:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861209344:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143126.853799:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.854917:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861209216:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143126.854932:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143126.854958:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858550784:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7031us (7129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.854967:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6403 00000100:00100000:2.0:1746143126.856418:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.860077:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.860121:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861209344:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143126.860147:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.860162:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d928a00, rc 0) 00000100:00100000:0.0:1746143126.860197:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30851:x1830962858550912:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6578us (6658us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.860204:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12120 00000100:00100000:1.0:1746143126.860451:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858551168 00000100:00100000:1.0:1746143126.860459:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858551168 00002000:00100000:1.0:1746143126.860492:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2449408->2453503) req@ffff8800a5b13b80 x1830962858551168/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.860501:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b13b80 with x1830962858551168 ext(2449408->2453503) 00002000:00010000:1.0:1746143126.860506:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b13b80 00000100:00100000:1.0:1746143126.860520:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858551296 00000100:00100000:1.0:1746143126.860522:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858551296 00002000:00100000:1.0:1746143126.860533:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2490368->3145727) req@ffff88009310f100 x1830962858551296/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.860544:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310f100 with x1830962858551296 ext(2490368->3145727) 00010000:00010000:1.0:1746143126.860550:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 24 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.860561:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 24 pid: 4756 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746143126.860567:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310f100 00000100:00100000:1.0:1746143126.860581:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1945 00000100:00100000:1.0:1746143126.860588:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858551296:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143126.860653:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5899 00000100:00100000:0.0:1746143126.860660:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858551168:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143126.860780:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858551168:12345-192.168.201.28@tcp:3:cat.0 Request processed in 121us (4366us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143126.860790:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5899 00002000:00100000:0.0:1746143126.860794:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2449408->2453503) req@ffff8800a5b13b80 x1830962858551168/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.860802:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b13b80 with x1830962858551168 ext(2449408->2453503) 00002000:00010000:0.0:1746143126.860805:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b13b80 00000100:00100000:1.0:1746143126.877720:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858551296:12345-192.168.201.28@tcp:4:cat.0 Request processed in 17123us (17641us total) trans 21474839967 rc 0/0 00000100:00100000:1.0:1746143126.877732:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1945 00002000:00100000:1.0:1746143126.877743:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2490368->3145727) req@ffff88009310f100 x1830962858551296/t21474839967(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/448 e 0 to 0 dl 1746143137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.877752:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310f100 with x1830962858551296 ext(2490368->3145727) 00010000:00010000:1.0:1746143126.877761:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 26 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143126.877776:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 26 pid: 4756 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746143126.877783:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310f100 00000100:00100000:0.0:1746143126.885729:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.885766:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858551424 00000100:00100000:0.0:1746143126.885776:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858551424 00010000:00010000:0.0:1746143126.885811:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 26 pid: 4756 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.885839:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6404 00000100:00100000:0.0:1746143126.885846:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858551424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143126.885860:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143126.885882:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 26 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.885894:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 26 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.885917:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d929a00/0x25aee876ca70c906 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc9b expref: 26 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.885934:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.885936:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.885942:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 25 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.885951:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 25 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.885986:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 25 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143126.885999:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861209472:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143126.886092:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.895614:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861209472:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143126.895635:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143126.895679:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858551424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9832us (9960us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.895691:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6404 00000100:00100000:0.0:1746143126.897922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143126.902399:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858551808 00000100:00100000:1.0:1746143126.902636:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858551808 00002000:00100000:1.0:1746143126.902690:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800906a5180 x1830962858551808/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143126.902702:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5180 with x1830962858551808 ext(2097152->3145727) 00002000:00010000:1.0:1746143126.902708:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a5180 00000100:00100000:1.0:1746143126.902740:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5900 00000100:00100000:1.0:1746143126.902748:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858551808:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.919480:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.919590:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858551936 00000100:00100000:3.0:1746143126.919601:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858551936 00002000:00100000:3.0:1746143126.919690:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2453504->3145727) req@ffff880093b5a300 x1830962858551936/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.919702:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5a300 with x1830962858551936 ext(2453504->3145727) 00002000:00010000:3.0:1746143126.919712:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5a300 00000100:00100000:3.0:1746143126.919741:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5901 00000100:00100000:3.0:1746143126.919748:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858551936:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143126.926612:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858551808:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23853us (28685us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143126.926625:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5900 00002000:00100000:0.0:1746143126.926638:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800906a5180 x1830962858551808/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.926647:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5180 with x1830962858551808 ext(2097152->3145727) 00002000:00010000:0.0:1746143126.926654:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a5180 00000100:00100000:0.0:1746143126.937822:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.937850:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858552064 00000100:00100000:0.0:1746143126.937860:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858552064 00000100:00100000:0.0:1746143126.937901:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12121 00000100:00100000:0.0:1746143126.937908:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:30855:x1830962858552064:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143126.937926:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143126.937959:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcda expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.937989:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.937997:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 31 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.938003:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.938005:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.938009:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1298432->1581055] (req 1298432->1581055) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 31 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.938038:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 31 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143126.938072:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 31 pid: 26949 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.938084:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861209600:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143126.938159:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.938171:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 24 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.938178:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861209728:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143126.938195:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143126.938213:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858551936:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18464us (18741us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746143126.938223:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5901 00002000:00100000:3.0:1746143126.938233:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2453504->3145727) req@ffff880093b5a300 x1830962858551936/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.938242:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5a300 with x1830962858551936 ext(2453504->3145727) 00002000:00010000:3.0:1746143126.938247:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5a300 00000100:00100000:0.0:1746143126.948842:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.949060:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.949111:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.949140:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858552320 00000100:00100000:0.0:1746143126.949148:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858552320 00010000:00010000:0.0:1746143126.949184:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 32 pid: 26949 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.949211:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858552192 00000100:00100000:0.0:1746143126.949214:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858552192 00010000:00010000:0.0:1746143126.949224:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 25 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.949241:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6405 00000100:00100000:0.0:1746143126.949248:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858552320:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143126.949262:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143126.949288:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 32 pid: 26949 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746143126.949300:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 32 pid: 26949 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746143126.949341:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143126.949380:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858552320:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 132us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.949387:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6405 00000100:00100000:0.0:1746143126.949402:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6406 00000100:00100000:0.0:1746143126.949406:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858552192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143126.949412:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143126.949419:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 25 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.949428:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 25 pid: 4758 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.949439:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.949441:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.949447:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 31 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.949455:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 31 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.949485:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 31 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143126.949498:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861209856:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143126.949554:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.949578:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858552448 00000100:00100000:0.0:1746143126.949581:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858552448 00000100:00100000:0.0:1746143126.949601:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12122 00000100:00100000:0.0:1746143126.949606:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30851:x1830962858552448:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143126.949619:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143126.949631:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fce1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.949648:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 31 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.949654:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143126.949655:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143126.949658:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.949674:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 31 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.949684:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 31 pid: 4756 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.949692:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861209984:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143126.949711:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143126.949745:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013011ac00/0x25aee876ca70c865 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbfa expref: 31 pid: 26949 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143126.949764:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861209600:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143126.949773:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2e00/0x25aee876ca70c857 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fbec expref: 27 pid: 4758 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.949780:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861209728:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143126.949799:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 30 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.949808:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd0000, rc 0) 00000100:00100000:0.0:1746143126.949826:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:30855:x1830962858552064:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11918us (12012us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.949831:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12121 00000100:00100000:0.0:1746143126.955864:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.955896:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.955941:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861209984:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143126.955970:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.955989:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd1600, rc 0) 00000100:00100000:0.0:1746143126.956049:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30851:x1830962858552448:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6425us (6920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.956059:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12122 00000100:00100000:0.0:1746143126.956097:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858552704 00000100:00100000:0.0:1746143126.956104:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858552704 00002000:00100000:0.0:1746143126.956138:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2fe:0x0] (1298432->1302527) req@ffff880094d7e300 x1830962858552704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.956147:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7e300 with x1830962858552704 ext(1298432->1302527) 00002000:00010000:0.0:1746143126.956152:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7e300 00000100:00100000:0.0:1746143126.956166:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858552832 00000100:00100000:0.0:1746143126.956168:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858552832 00002000:00100000:0.0:1746143126.956177:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3559423) req@ffff880094d7f480 x1830962858552832/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.956184:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7f480 with x1830962858552832 ext(3145728->3559423) 00010000:00010000:0.0:1746143126.956189:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 31 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.956202:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 31 pid: 4756 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143126.956208:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d7f480 00000100:00100000:0.0:1746143126.956219:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1946 00000100:00100000:0.0:1746143126.956225:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1968:x1830962858552832:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143126.956829:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5902 00000100:00100000:0.0:1746143126.956835:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858552704:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143126.956952:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858552704:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 117us (1100us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143126.956958:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5902 00002000:00100000:0.0:1746143126.956963:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1298432->1302527) req@ffff880094d7e300 x1830962858552704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143126.956971:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7e300 with x1830962858552704 ext(1298432->1302527) 00002000:00010000:0.0:1746143126.956974:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7e300 00000100:00100000:0.0:1746143126.957003:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861209856:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143126.957012:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143126.957045:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858552192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7622us (7969us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.957054:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6406 00000100:00100000:1.0:1746143126.971794:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.972098:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858553088 00000100:00100000:3.0:1746143126.972108:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858553088 00002000:00100000:3.0:1746143126.972160:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1576960->1581055) req@ffff8801317b5c00 x1830962858553088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.972176:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b5c00 with x1830962858553088 ext(1576960->1581055) 00002000:00010000:3.0:1746143126.972182:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b5c00 00000100:00100000:3.0:1746143126.972203:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5903 00000100:00100000:3.0:1746143126.972210:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858553088:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143126.973004:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1968:x1830962858552832:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 16769us (17097us total) trans 21474839968 rc 0/0 00000100:00100000:0.0:1746143126.973017:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1946 00002000:00100000:0.0:1746143126.973027:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3559423) req@ffff880094d7f480 x1830962858552832/t21474839968(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/448 e 0 to 0 dl 1746143137 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143126.973054:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1968:x1830962858553088:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 822us (1249us total) trans 0 rc 4096/4096 00002000:00100000:0.0:1746143126.973055:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7f480 with x1830962858552832 ext(3145728->3559423) 00000100:00100000:3.0:1746143126.973061:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5903 00010000:00010000:0.0:1746143126.973064:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 33 pid: 4756 timeout: 1008 lvb_type: 0 00002000:00100000:3.0:1746143126.973068:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1576960->1581055) req@ffff8801317b5c00 x1830962858553088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:277/0 lens 488/4536 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.973074:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b5c00 with x1830962858553088 ext(1576960->1581055) 00002000:00010000:3.0:1746143126.973078:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b5c00 00010000:00010000:0.0:1746143126.973080:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 33 pid: 4756 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143126.973088:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d7f480 00000100:00100000:1.0:1746143126.979465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143126.979531:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858553216 00000100:00100000:0.0:1746143126.979540:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858553216 00010000:00010000:0.0:1746143126.979571:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 32 pid: 4756 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143126.979601:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6407 00000100:00100000:0.0:1746143126.979607:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858553216:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143126.979619:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143126.979634:0:16965:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143124 -> 1746143125 00010000:00010000:0.0:1746143126.979639:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 32 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.979650:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 32 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.979669:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093171600/0x25aee876ca70c8f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3559423) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc8d expref: 32 pid: 4756 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143126.979685:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.979687:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143126.979693:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.979701:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143126.979729:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143126.979972:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861210112:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143126.980721:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143126.987765:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861210112:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143126.988186:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143126.988243:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858553216:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8634us (8784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143126.988255:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6407 00000100:00100000:2.0:1746143126.996114:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143126.996143:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143126.996209:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858553600 00000100:00100000:3.0:1746143126.996220:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858553600 00002000:00100000:3.0:1746143126.996268:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5b11880 x1830962858553600/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.996278:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b11880 with x1830962858553600 ext(3145728->4194303) 00002000:00010000:3.0:1746143126.996284:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b11880 00000100:00100000:3.0:1746143126.996301:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858553728 00000100:00100000:3.0:1746143126.996303:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858553728 00002000:00100000:3.0:1746143126.996315:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5b11c00 x1830962858553728/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/0 e 0 to 0 dl 1746143137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143126.996323:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b11c00 with x1830962858553728 ext(3145728->4194303) 00002000:00010000:3.0:1746143126.996335:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b11c00 00000100:00100000:3.0:1746143126.996351:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5904 00000100:00100000:3.0:1746143126.996358:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858553600:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143126.998780:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5905 00000100:00100000:1.0:1746143126.998793:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858553728:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143127.022418:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858553600:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26045us (26295us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143127.022432:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5904 00002000:00100000:3.0:1746143127.022449:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5b11880 x1830962858553600/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143127.022459:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b11880 with x1830962858553600 ext(3145728->4194303) 00002000:00010000:3.0:1746143127.022466:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b11880 00000100:00100000:1.0:1746143127.030818:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858553728:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32017us (34662us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143127.030832:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5905 00002000:00100000:1.0:1746143127.030844:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5b11c00 x1830962858553728/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:277/0 lens 488/440 e 0 to 0 dl 1746143137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.030853:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b11c00 with x1830962858553728 ext(3145728->4194303) 00002000:00010000:1.0:1746143127.030859:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b11c00 00000001:00080000:3.0:1746143127.036231:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872687 is committed 00000001:00080000:3.0:1746143127.036250:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872702 is committed 00000001:00080000:3.0:1746143127.036264:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872691 is committed 00000001:00080000:3.0:1746143127.036287:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872708 is committed 00000001:00080000:3.0:1746143127.036318:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872693 is committed 00000001:00080000:3.0:1746143127.036345:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872704 is committed 00000001:00080000:3.0:1746143127.036374:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872694 is committed 00000100:00100000:0.0:1746143127.044770:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.044904:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858553856 00000100:00100000:2.0:1746143127.044916:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858553856 00000100:00100000:2.0:1746143127.044976:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12123 00000100:00100000:2.0:1746143127.044987:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858553856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143127.045008:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.045028:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ffa000/0x25aee876ca70c953 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fce8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.045114:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861210240:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143127.045210:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17bcc0 going to sleep for 11 seconds 00002000:00010000:3.0:1746143127.049195:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143124 -> 1746143125 00002000:00010000:3.0:1746143127.049204:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143124 -> 1746143125 00002000:00010000:3.0:1746143127.049206:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143124 -> 1746143125 00000100:00100000:3.0:1746143127.049236:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861210240:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143127.049573:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ffa000/0x25aee876ca70c953 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce8 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.049587:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ffa000/0x25aee876ca70c953 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce8 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.049768:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ffa000, rc 0) 00000100:00100000:3.0:1746143127.050133:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858553856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5146us (5376us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143127.050143:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12123 00000100:00100000:3.0:1746143127.056214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.058866:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858553984 00000100:00100000:2.0:1746143127.058879:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858553984 00000100:00100000:3.0:1746143127.058965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143127.059000:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143127.059787:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858554112 00000100:00100000:2.0:1746143127.059792:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858554112 00000100:00100000:3.0:1746143127.059809:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.059816:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858554240 00000100:00100000:2.0:1746143127.059818:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858554240 00000100:00100000:3.0:1746143127.059841:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12124 00000100:00100000:1.0:1746143127.059848:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12125 00000100:00100000:3.0:1746143127.059850:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858553984:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143127.059854:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858554112:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143127.059869:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.059869:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.059886:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70c95a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcf6 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.059887:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcef expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.059909:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.059911:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.059919:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.059934:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143127.059938:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861210368:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143127.059944:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093114e00, rc 0) 00000100:00100000:2.0:1746143127.060025:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12126 00000100:00100000:2.0:1746143127.060042:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858554240:12345-192.168.201.28@tcp:101:cat.0 00000100:00080000:0.0:1746143127.060047:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746143127.060050:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.060061:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70c968 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fcfd expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143127.060118:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858553984:12345-192.168.201.28@tcp:101:cat.0 Request processed in 269us (3915us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.060125:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12124 00000100:00100000:1.0:1746143127.060145:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143127.060180:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861210496:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143127.060203:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143127.062933:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861210368:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143127.062977:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70c95a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcf6 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.062993:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70c95a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcf6 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143127.063116:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861210496:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143127.063134:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70c968 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcfd expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.063142:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ffb200/0x25aee876ca70c968 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcfd expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.063163:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ffb200, rc 0) 00000100:00100000:2.0:1746143127.063899:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858554240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3864us (4086us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143127.063907:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12126 00010000:00010000:1.0:1746143127.064980:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475ae00, rc 0) 00000100:00100000:1.0:1746143127.065019:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858554112:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5164us (6063us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143127.065025:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12125 00000100:00100000:0.0:1746143127.072247:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.072623:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858554368 00000100:00100000:1.0:1746143127.072633:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858554368 00000100:00100000:1.0:1746143127.072679:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12127 00000100:00100000:1.0:1746143127.072687:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858554368:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143127.072707:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.072725:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132051400/0x25aee876ca70c96f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd04 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143127.072781:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861210624:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143127.073073:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143127.074746:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861210624:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143127.074959:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132051400/0x25aee876ca70c96f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd04 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.074977:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132051400/0x25aee876ca70c96f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd04 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.075369:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132051400, rc 0) 00000100:00100000:1.0:1746143127.076057:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858554368:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3342us (3800us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143127.076067:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12127 00000100:00100000:0.0:1746143127.086663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.086766:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858554624 00000100:00100000:1.0:1746143127.086776:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858554624 00002000:00100000:1.0:1746143127.086821:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094d7fb80 x1830962858554624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 504/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.086831:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7fb80 with x1830962858554624 ext(1048576->2097151) 00002000:00010000:1.0:1746143127.086837:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7fb80 00000100:00100000:1.0:1746143127.086904:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5906 00000100:00100000:1.0:1746143127.086911:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858554624:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143127.097477:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858554624:12345-192.168.201.28@tcp:3:cat.0 Request processed in 10548us (10809us total) trans 0 rc 765952/765952 00000100:00100000:1.0:1746143127.097492:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5906 00002000:00100000:1.0:1746143127.097508:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094d7fb80 x1830962858554624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 504/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.097519:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7fb80 with x1830962858554624 ext(1048576->2097151) 00002000:00010000:1.0:1746143127.097527:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7fb80 00000100:00100000:0.0:1746143127.112143:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.112299:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858554880 00000100:00100000:1.0:1746143127.112312:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858554880 00002000:00100000:1.0:1746143127.112383:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094d7f800 x1830962858554880/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.112395:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7f800 with x1830962858554880 ext(2097152->3145727) 00002000:00010000:1.0:1746143127.112401:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7f800 00000100:00100000:1.0:1746143127.116080:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5907 00000100:00100000:1.0:1746143127.116104:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858554880:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143127.136176:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1968:x1830962858554880:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20071us (24036us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143127.136189:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5907 00002000:00100000:1.0:1746143127.136202:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094d7f800 x1830962858554880/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.136212:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7f800 with x1830962858554880 ext(2097152->3145727) 00002000:00010000:1.0:1746143127.136218:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7f800 00000100:00100000:2.0:1746143127.147924:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.148973:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858555008 00000100:00100000:0.0:1746143127.148985:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858555008 00000100:00100000:0.0:1746143127.149082:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12128 00000100:00100000:0.0:1746143127.149095:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30861:x1830962858555008:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143127.149117:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143127.149139:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd0b expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.149177:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 18 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.149186:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143127.149188:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143127.149192:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 10 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.149235:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 18 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.149250:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 18 pid: 754 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143127.149263:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861210752:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.149395:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.156419:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861210752:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143127.156461:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 10 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.156481:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f28000, rc 0) 00000100:00100000:0.0:1746143127.156562:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30861:x1830962858555008:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7466us (8846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.156572:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12128 00000100:00100000:2.0:1746143127.156788:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.157382:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858555136 00000100:00100000:0.0:1746143127.157389:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858555136 00002000:00100000:0.0:1746143127.157427:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2453503) req@ffff8800a5b10380 x1830962858555136/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.157437:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b10380 with x1830962858555136 ext(2097152->2453503) 00010000:00010000:0.0:1746143127.157444:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 19 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143127.157683:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 19 pid: 754 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143127.157689:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b10380 00000100:00100000:0.0:1746143127.157716:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1947 00000100:00100000:0.0:1746143127.157734:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858555136:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143127.175473:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858555136:12345-192.168.201.28@tcp:4:cat.0 Request processed in 17739us (18677us total) trans 17179872710 rc 0/0 00000100:00100000:0.0:1746143127.175487:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1947 00002000:00100000:0.0:1746143127.175499:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2453503) req@ffff8800a5b10380 x1830962858555136/t17179872710(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/448 e 0 to 0 dl 1746143138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.175509:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b10380 with x1830962858555136 ext(2097152->2453503) 00010000:00010000:0.0:1746143127.175520:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 21 pid: 754 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143127.175536:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 21 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:0.0:1746143127.175543:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b10380 00000100:00100000:0.0:1746143127.208975:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.209014:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858555264 00000100:00100000:0.0:1746143127.209024:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858555264 00010000:00010000:0.0:1746143127.209088:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 21 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143127.209130:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6408 00000100:00100000:0.0:1746143127.209139:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858555264:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143127.209157:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143127.209184:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 21 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.209197:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 21 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.209222:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3200/0x25aee876ca70c930 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcc5 expref: 21 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.209236:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143127.209239:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143127.209247:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.209256:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.209289:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 9 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143127.209302:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861210880:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143127.209404:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00000001:00080000:1.0:1746143127.218671:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942297 is committed 00000001:00080000:1.0:1746143127.218687:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942310 is committed 00000001:00080000:1.0:1746143127.218692:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942308 is committed 00000001:00080000:1.0:1746143127.218698:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942291 is committed 00000001:00080000:1.0:1746143127.218706:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942311 is committed 00000001:00080000:1.0:1746143127.218714:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942309 is committed 00000100:00100000:0.0:1746143127.220360:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.220409:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.223424:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858555392 00000100:00100000:2.0:1746143127.223438:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858555392 00000100:00100000:2.0:1746143127.223503:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858555520 00000100:00100000:2.0:1746143127.223506:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858555520 00000100:00100000:2.0:1746143127.223531:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12129 00000100:00100000:2.0:1746143127.223539:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858555392:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143127.223560:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.223579:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132eb3e00/0x25aee876ca70c97d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd12 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.223635:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861211008:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143127.223728:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143127.223832:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12130 00000100:00100000:1.0:1746143127.223841:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858555520:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143127.223850:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.223861:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd19 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.223874:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.223876:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.223884:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.223899:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.223908:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050000, rc 0) 00000100:00100000:1.0:1746143127.223932:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858555520:12345-192.168.201.28@tcp:101:cat.0 Request processed in 93us (3522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.223938:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12130 00000100:00100000:2.0:1746143127.224526:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861210880:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143127.224546:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.224571:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858555264:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 15434us (15607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.224581:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6408 00000100:00100000:0.0:1746143127.243136:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.243428:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858555648 00000100:00100000:3.0:1746143127.243439:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858555648 00000100:00100000:3.0:1746143127.243488:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12131 00000100:00100000:3.0:1746143127.243496:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30858:x1830962858555648:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143127.243516:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143127.243535:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd20 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.243566:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.243575:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.243581:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.243583:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.243586:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->2965503] (req 2101248->2965503) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 22 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.243616:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.243629:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143127.243641:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861211136:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.243729:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.243739:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 9 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.243747:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861211264:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143127.243767:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ff00 going to sleep for 11 seconds 00002000:00010000:2.0:1746143127.244202:0:754:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143125 -> 1746143126 00000100:00100000:2.0:1746143127.244226:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861211008:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143127.244255:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132eb3e00/0x25aee876ca70c97d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd12 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.244265:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132eb3e00/0x25aee876ca70c97d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd12 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.244280:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb3e00, rc 0) 00000100:00100000:2.0:1746143127.244308:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858555392:12345-192.168.201.28@tcp:101:cat.0 Request processed in 20769us (23954us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143127.244314:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12129 00000100:00100000:0.0:1746143127.246090:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.246127:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.246172:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.246174:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858555904 00000100:00100000:2.0:1746143127.246181:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858555904 00002000:00100000:2.0:1746143127.246231:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009c1e8380 x1830962858555904/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.246240:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8380 with x1830962858555904 ext(2097152->3145727) 00010000:00010000:2.0:1746143127.246250:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 10 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.246256:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858556160 00000100:00100000:3.0:1746143127.246259:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858556160 00010000:00010000:2.0:1746143127.246261:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 10 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143127.246267:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1e8380 00002000:00100000:3.0:1746143127.246277:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009c1e8e00 x1830962858556160/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143127.246285:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8e00 with x1830962858556160 ext(3145728->4194303) 00010000:00010000:3.0:1746143127.246289:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 11 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.246293:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858556416 00000100:00100000:2.0:1746143127.246296:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858556416 00010000:00010000:3.0:1746143127.246297:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 11 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:3.0:1746143127.246302:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1e8e00 00002000:00100000:2.0:1746143127.246307:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009c1e8700 x1830962858556416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.246314:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8700 with x1830962858556416 ext(3145728->4194303) 00000100:00100000:3.0:1746143127.246316:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1948 00002000:00010000:2.0:1746143127.246318:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e8700 00000100:00100000:3.0:1746143127.246332:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858555904:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143127.246342:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1949 00000100:00100000:2.0:1746143127.246347:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858556160:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143127.246596:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5908 00000100:00100000:3.0:1746143127.246603:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858556416:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143127.251741:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861211136:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143127.251756:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861211264:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.251788:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->2965503] (req 2101248->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 22 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.251804:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093114200, rc 0) 00000100:00100000:3.0:1746143127.251858:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30858:x1830962858555648:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8362us (8733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.251883:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12131 00000100:00100000:1.0:1746143127.297999:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.298081:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.298164:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858556544 00000100:00100000:1.0:1746143127.298234:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858556544 00000100:00100000:1.0:1746143127.298295:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12132 00000100:00100000:1.0:1746143127.298308:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30867:x1830962858556544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143127.298342:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.298362:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd27 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.298397:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 33 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.298412:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143127.298414:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143127.298417:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.298444:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 33 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.298455:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 33 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.298467:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861211392:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.298533:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143127.298548:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858556672 00000100:00100000:1.0:1746143127.298550:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858556672 00010000:00010000:1.0:1746143127.298566:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143127.298585:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6409 00000100:00100000:1.0:1746143127.298590:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858556672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.298598:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.298616:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.298627:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.298645:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132050000/0x25aee876ca70c984 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd19 expref: 22 pid: 8450 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.298660:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.298678:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858556672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 88us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.298684:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6409 00000100:00100000:1.0:1746143127.299114:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1969:x1830962858556416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 52508us (52938us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143127.299124:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5908 00002000:00100000:1.0:1746143127.299135:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009c1e8700 x1830962858556416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.299145:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8700 with x1830962858556416 ext(3145728->4194303) 00002000:00010000:1.0:1746143127.299150:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e8700 00000100:00100000:0.0:1746143127.328864:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.329299:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861211392:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143127.329350:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.329373:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bdd000, rc 0) 00000100:00100000:0.0:1746143127.329440:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30867:x1830962858556544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 31134us (31453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.329451:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12132 00000100:00100000:0.0:1746143127.329504:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858556800 00000100:00100000:0.0:1746143127.329513:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858556800 00002000:00100000:0.0:1746143127.329571:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1298432->1581055) req@ffff88009c1e8a80 x1830962858556800/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.329582:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8a80 with x1830962858556800 ext(1298432->1581055) 00010000:00010000:0.0:1746143127.329590:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 32 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.329602:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 32 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:0.0:1746143127.329609:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1e8a80 00000100:00100000:0.0:1746143127.329636:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1950 00000100:00100000:0.0:1746143127.329644:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:1971:x1830962858556800:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143127.335114:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3301:1830962861211520:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.335204:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143127.335251:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861212032:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.335286:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143127.335317:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143127.335340:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1830962861211648:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.335374:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143127.335400:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1830962861212160:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.335426:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143127.335466:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1830962861211776:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.335493:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143127.335516:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746143127.335523:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861211904:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.335550:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143127.335593:0:14791:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861211520 00000100:00100000:3.0:1746143127.335601:0:14791:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861211520 00000100:00100000:3.0:1746143127.335652:0:14791:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1746143127.335662:0:14791:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3301:x1830962861211520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.335724:0:14791:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3301:x1830962861211520:12345-0@lo:400:kworker.0 Request processed in 62us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.335732:0:14791:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1746143127.335948:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861211648 00000100:00100000:3.0:1746143127.335954:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861211648 00000100:00100000:3.0:1746143127.336007:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861212160 00000100:00100000:3.0:1746143127.336009:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861212160 00000100:00100000:3.0:1746143127.336022:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861211776 00000100:00100000:3.0:1746143127.336024:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861211776 00000100:00100000:3.0:1746143127.336075:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1746143127.336084:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830962861211648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.336126:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830962861211648:12345-0@lo:400:kworker.0 Request processed in 42us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.336133:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1746143127.336147:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1746143127.336153:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1830962861212160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.336188:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1830962861212160:12345-0@lo:400:kworker.0 Request processed in 34us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.336194:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1746143127.336206:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1746143127.336212:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1830962861211776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.336251:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1830962861211776:12345-0@lo:400:kworker.0 Request processed in 38us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.336257:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1746143127.336288:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143127.336313:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861212032 00000100:00100000:3.0:1746143127.336317:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861212032 00000100:00100000:3.0:1746143127.336365:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861211904 00000100:00100000:3.0:1746143127.336370:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861211904 00000100:00100000:3.0:1746143127.336395:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1746143127.336401:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3301:x1830962861212032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.336440:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3301:x1830962861212032:12345-0@lo:400:kworker.0 Request processed in 38us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.336446:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1746143127.336459:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1746143127.336465:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861211904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.336501:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861211904:12345-0@lo:400:kworker.0 Request processed in 35us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.336507:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00080000:3.0:1746143127.336527:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143127.336530:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143127.336558:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839952 gen 2 00000004:00080000:3.0:1746143127.336566:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb20000, transno 21474839915 00000004:00080000:3.0:1746143127.336575:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094512300, transno 21474839916 00000004:00080000:3.0:1746143127.336578:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094511500, transno 21474839917 00000004:00080000:3.0:1746143127.336580:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb23800, transno 21474839918 00000004:00080000:3.0:1746143127.336583:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009535fb80, transno 21474839919 00000004:00080000:3.0:1746143127.336585:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb20e00, transno 21474839920 00000004:00080000:3.0:1746143127.336588:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb23480, transno 21474839921 00000004:00080000:3.0:1746143127.336591:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094512a00, transno 21474839922 00000004:00080000:3.0:1746143127.336594:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094513100, transno 21474839923 00000004:00080000:3.0:1746143127.336596:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094515180, transno 21474839924 00000004:00080000:3.0:1746143127.336599:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094515c00, transno 21474839925 00000004:00080000:3.0:1746143127.336601:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094515f80, transno 21474839926 00000004:00080000:3.0:1746143127.336603:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094514380, transno 21474839927 00000004:00080000:3.0:1746143127.336607:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094514700, transno 21474839928 00000004:00080000:3.0:1746143127.336610:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094517480, transno 21474839929 00000004:00080000:3.0:1746143127.336612:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094516680, transno 21474839930 00000004:00080000:3.0:1746143127.336615:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094514e00, transno 21474839931 00000004:00080000:3.0:1746143127.336618:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e97480, transno 21474839932 00000004:00080000:3.0:1746143127.336620:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d5880, transno 21474839935 00000004:00080000:3.0:1746143127.336624:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314d500, transno 21474839936 00000004:00080000:3.0:1746143127.336626:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d6d80, transno 21474839937 00000004:00080000:3.0:1746143127.336629:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d5500, transno 21474839938 00000004:00080000:3.0:1746143127.336631:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e300, transno 21474839939 00000004:00080000:3.0:1746143127.336634:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314ce00, transno 21474839940 00000004:00080000:3.0:1746143127.336636:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d4a80, transno 21474839941 00000004:00080000:3.0:1746143127.336639:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d4380, transno 21474839942 00000004:00080000:3.0:1746143127.336641:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314d180, transno 21474839943 00000004:00080000:3.0:1746143127.336644:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314df80, transno 21474839944 00000004:00080000:3.0:1746143127.336646:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314f100, transno 21474839945 00000004:00080000:3.0:1746143127.336649:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80f100, transno 21474839946 00000004:00080000:3.0:1746143127.336651:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314fb80, transno 21474839947 00000004:00080000:3.0:1746143127.336654:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d5f80, transno 21474839948 00000004:00080000:3.0:1746143127.336656:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314c380, transno 21474839949 00000004:00080000:3.0:1746143127.336658:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d6a00, transno 21474839950 00000004:00080000:3.0:1746143127.336660:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e680, transno 21474839951 00000004:00080000:3.0:1746143127.336663:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b6a00, transno 21474839952 00000100:00100000:3.0:1746143127.336669:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861211904:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.336684:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1830962861211776:0@lo:400:kworker.0 00000004:00080000:3.0:1746143127.337609:0:14835:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 36 done 00000100:00100000:3.0:1746143127.337646:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1830962861211648:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.337658:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1830962861212160:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.337668:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3301:1830962861211520:0@lo:400:kworker.0 00000100:00100000:3.0:1746143127.337676:0:3301:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872694 gen 2 00000004:00080000:3.0:1746143127.337680:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a709880, transno 17179872679 00000004:00080000:3.0:1746143127.337690:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aece00, transno 17179872680 00000004:00080000:3.0:1746143127.337694:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a709c00, transno 17179872681 00000004:00080000:3.0:1746143127.337696:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a709f80, transno 17179872682 00000004:00080000:3.0:1746143127.337699:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a70b800, transno 17179872683 00000004:00080000:3.0:1746143127.337701:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aed880, transno 17179872684 00000004:00080000:3.0:1746143127.337704:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a708a80, transno 17179872685 00000004:00080000:3.0:1746143127.337706:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aeca80, transno 17179872686 00000004:00080000:3.0:1746143127.337708:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aeea00, transno 17179872687 00000004:00080000:3.0:1746143127.337710:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aedc00, transno 17179872688 00000004:00080000:3.0:1746143127.337713:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb55f80, transno 17179872689 00000004:00080000:3.0:1746143127.337716:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb57480, transno 17179872690 00000004:00080000:3.0:1746143127.337718:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb55500, transno 17179872691 00000004:00080000:3.0:1746143127.337721:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb56d80, transno 17179872692 00000004:00080000:3.0:1746143127.337723:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aefb80, transno 17179872693 00000004:00080000:3.0:1746143127.337726:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb56a00, transno 17179872694 00000100:00100000:3.0:1746143127.337730:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861212032:0@lo:400:kworker.0 00000004:00080000:3.0:1746143127.338123:0:14837:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 16 done 00000100:00100000:0.0:1746143127.340957:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861212288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143127.341014:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143127.341074:0:25353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861212288 00000100:00100000:0.0:1746143127.341079:0:25353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861212288 00000100:00100000:0.0:1746143127.341110:0:25353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1746143127.341115:0:25353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861212288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746143127.341136:0:25353:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 499843072 pending 28966912 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746143127.341166:0:25353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861212288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.341172:0:25353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1746143127.341203:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861212288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143127.342110:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858556160:12345-192.168.201.28@tcp:3:cat.0 Request processed in 95759us (95980us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143127.342118:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1949 00002000:00100000:0.0:1746143127.342128:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009c1e8e00 x1830962858556160/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.342138:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8e00 with x1830962858556160 ext(3145728->4194303) 00010000:00010000:0.0:1746143127.342148:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 12 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.342162:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 12 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:0.0:1746143127.342175:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1e8e00 00000100:00100000:1.0:1746143127.357713:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858555904:12345-192.168.201.28@tcp:3:cat.0 Request processed in 111382us (111622us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143127.357727:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1948 00002000:00100000:1.0:1746143127.357742:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009c1e8380 x1830962858555904/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.357753:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8380 with x1830962858555904 ext(2097152->3145727) 00010000:00010000:1.0:1746143127.357764:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 10 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.357784:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 10 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:1.0:1746143127.357791:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1e8380 00000100:00100000:0.0:1746143127.370052:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+34:1971:x1830962858556800:12345-192.168.201.28@tcp:4:cat.0 Request processed in 40387us (41180us total) trans 21474839969 rc 0/0 00000100:00100000:0.0:1746143127.370066:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1950 00002000:00100000:0.0:1746143127.370081:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1298432->1581055) req@ffff88009c1e8a80 x1830962858556800/t21474839969(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/448 e 0 to 0 dl 1746143138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.370092:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8a80 with x1830962858556800 ext(1298432->1581055) 00010000:00010000:0.0:1746143127.370104:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 34 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.370118:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 34 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:0.0:1746143127.370126:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1e8a80 00000100:00100000:0.0:1746143127.373068:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.373354:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858556928 00000100:00100000:2.0:1746143127.373363:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858556928 00000100:00100000:2.0:1746143127.373410:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12133 00000100:00100000:2.0:1746143127.373416:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30861:x1830962858556928:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143127.373434:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.373453:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd2e expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.373478:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.373481:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.373489:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.373503:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.373515:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb2a00, rc 0) 00000100:00100000:2.0:1746143127.373563:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30861:x1830962858556928:12345-192.168.201.28@tcp:101:cat.0 Request processed in 146us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.373570:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12133 00000100:00100000:0.0:1746143127.375182:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861212416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143127.375229:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143127.375283:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861212416 00000100:00100000:0.0:1746143127.375287:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861212416 00000100:00100000:0.0:1746143127.375309:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1746143127.375314:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830962861212416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143127.375357:0:8451:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 498008064 pending 3407872 free 3851419648 avail 3849322496 00000100:00100000:0.0:1746143127.375385:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830962861212416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.375394:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1746143127.375619:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861212416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143127.393689:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.400715:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.400747:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858557312 00000100:00100000:0.0:1746143127.400755:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858557312 00002000:00100000:0.0:1746143127.400800:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009194b480 x1830962858557312/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.400811:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194b480 with x1830962858557312 ext(3145728->4194303) 00002000:00010000:0.0:1746143127.400817:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009194b480 00000100:00100000:0.0:1746143127.400836:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5909 00000100:00100000:0.0:1746143127.400844:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858557312:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143127.404767:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858557056 00000100:00100000:1.0:1746143127.404785:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858557056 00010000:00010000:1.0:1746143127.404832:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.404874:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6410 00000100:00100000:1.0:1746143127.404883:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858557056:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.404900:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.404924:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.404939:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.404966:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f28000/0x25aee876ca70c976 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd0b expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.404990:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.404992:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.405002:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.405015:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.406212:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143127.406227:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861212544:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143127.407154:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143127.414014:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.414065:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858557440 00000100:00100000:2.0:1746143127.414074:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858557440 00010000:00010000:2.0:1746143127.414112:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 34 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.414150:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6411 00000100:00100000:2.0:1746143127.414158:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+34:1970:x1830962858557440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143127.414175:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143127.414203:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 34 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.414215:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 34 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.414243:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd0000/0x25aee876ca70c945 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->1581055) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcda expref: 34 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.414261:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.414263:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.414273:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.414283:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.414338:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.414354:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861212672:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143127.414438:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.421102:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861212544:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143127.421127:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143127.421175:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858557056:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 16292us (27495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.421188:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6410 00000100:00100000:2.0:1746143127.421717:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861212672:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143127.421737:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.421760:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1970:x1830962858557440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7602us (7758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.421769:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6411 00000100:00100000:0.0:1746143127.431389:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.431454:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.431483:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858557696 00000100:00100000:0.0:1746143127.431492:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858557696 00002000:00100000:0.0:1746143127.431536:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2101248->2105343) req@ffff88009ad58700 x1830962858557696/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.431548:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58700 with x1830962858557696 ext(2101248->2105343) 00002000:00010000:0.0:1746143127.431556:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad58700 00000100:00100000:0.0:1746143127.431574:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858557952 00000100:00100000:0.0:1746143127.431577:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858557952 00002000:00100000:0.0:1746143127.431590:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009ad5b100 x1830962858557952/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.431598:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5b100 with x1830962858557952 ext(1048576->2097151) 00002000:00010000:0.0:1746143127.431602:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5b100 00000100:00100000:0.0:1746143127.431617:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5910 00000100:00100000:0.0:1746143127.431625:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858557696:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143127.431813:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858557696:12345-192.168.201.28@tcp:3:cat.0 Request processed in 187us (433us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143127.431821:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5910 00002000:00100000:0.0:1746143127.431828:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2101248->2105343) req@ffff88009ad58700 x1830962858557696/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/4536 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.431836:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58700 with x1830962858557696 ext(2101248->2105343) 00002000:00010000:0.0:1746143127.431839:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad58700 00000100:00100000:0.0:1746143127.431854:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5911 00000100:00100000:0.0:1746143127.431859:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858557952:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143127.482097:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858557312:12345-192.168.201.28@tcp:3:cat.0 Request processed in 81238us (81377us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143127.482113:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5909 00002000:00100000:0.0:1746143127.482131:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009194b480 x1830962858557312/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143127.482141:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194b480 with x1830962858557312 ext(3145728->4194303) 00002000:00010000:0.0:1746143127.482150:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009194b480 00000100:00100000:2.0:1746143127.486753:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.486802:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858558208 00000100:00100000:2.0:1746143127.486813:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858558208 00002000:00100000:2.0:1746143127.486865:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2961408->2965503) req@ffff8800a5b10700 x1830962858558208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.486884:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b10700 with x1830962858558208 ext(2961408->2965503) 00002000:00010000:2.0:1746143127.486890:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b10700 00000100:00100000:2.0:1746143127.488699:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5912 00000100:00100000:2.0:1746143127.488716:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858558208:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143127.488963:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858558208:12345-192.168.201.28@tcp:3:cat.0 Request processed in 250us (2222us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143127.488971:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5912 00002000:00100000:2.0:1746143127.488979:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2961408->2965503) req@ffff8800a5b10700 x1830962858558208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/4536 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.488988:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b10700 with x1830962858558208 ext(2961408->2965503) 00002000:00010000:2.0:1746143127.488994:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b10700 00000100:00100000:1.0:1746143127.498731:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858557952:12345-192.168.201.28@tcp:3:cat.0 Request processed in 66853us (67260us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143127.498745:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5911 00002000:00100000:1.0:1746143127.498762:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009ad5b100 x1830962858557952/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.498771:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5b100 with x1830962858557952 ext(1048576->2097151) 00002000:00010000:1.0:1746143127.498778:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5b100 00000100:00100000:0.0:1746143127.505686:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.505715:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.506059:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858558464 00000100:00100000:1.0:1746143127.506069:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858558464 00000100:00100000:1.0:1746143127.506115:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858558336 00000100:00100000:1.0:1746143127.506118:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858558336 00000100:00100000:1.0:1746143127.506137:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12134 00000100:00100000:1.0:1746143127.506144:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858558464:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143127.506161:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.506181:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bdd800/0x25aee876ca70c9a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd3c expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.506222:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bdd800/0x25aee876ca70c9a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd3c expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.506234:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bdd800/0x25aee876ca70c9a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd3c expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.506244:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bdd800, rc 0) 00000100:00100000:1.0:1746143127.506289:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858558464:12345-192.168.201.28@tcp:101:cat.0 Request processed in 145us (614us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143127.506296:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12134 00000100:00100000:1.0:1746143127.506310:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12135 00000100:00100000:1.0:1746143127.506315:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+33:1969:x1830962858558336:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143127.506333:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.506344:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd35 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.506358:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.506360:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.506370:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 34 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.506385:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 34 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.506395:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bdda00, rc 0) 00000100:00100000:1.0:1746143127.506414:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+34:1969:x1830962858558336:12345-192.168.201.28@tcp:101:cat.0 Request processed in 99us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.506419:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12135 00010000:00010000:1.0:1746143127.511781:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143127.514294:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.515227:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858558592 00000100:00100000:3.0:1746143127.515238:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858558592 00000100:00100000:3.0:1746143127.515282:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12136 00000100:00100000:3.0:1746143127.515291:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30867:x1830962858558592:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143127.515311:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143127.515343:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd43 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.515382:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 22 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.515391:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143127.515392:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143127.515396:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.515430:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 22 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.515442:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 22 pid: 4758 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.515455:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861212800:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143127.515536:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.516182:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.516242:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858558720 00000100:00100000:0.0:1746143127.516246:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858558720 00000100:00100000:0.0:1746143127.516270:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12137 00000100:00100000:0.0:1746143127.516276:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858558720:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143127.516284:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143127.516292:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e81c800/0x25aee876ca70c9b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd4a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.516313:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e81c800/0x25aee876ca70c9b5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd4a expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.516340:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e81c800/0x25aee876ca70c9b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd4a expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.516349:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81c800, rc 0) 00000100:00100000:0.0:1746143127.516379:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858558720:12345-192.168.201.28@tcp:101:cat.0 Request processed in 103us (198us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143127.516386:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12137 00000100:00100000:3.0:1746143127.520078:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861212800:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.520110:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.520129:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a48e1a00, rc 0) 00000100:00100000:3.0:1746143127.520171:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30867:x1830962858558592:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4879us (5883us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.520179:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12136 00000100:00100000:0.0:1746143127.524351:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.524598:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.524759:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858558848 00000100:00100000:1.0:1746143127.524768:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858558848 00002000:00100000:1.0:1746143127.524813:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2101248->2965503) req@ffff880091981880 x1830962858558848/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.524823:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091981880 with x1830962858558848 ext(2101248->2965503) 00010000:00010000:1.0:1746143127.524833:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 22 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.524848:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 22 pid: 4758 timeout: 1009 lvb_type: 0 00002000:00010000:1.0:1746143127.524855:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091981880 00000100:00100000:1.0:1746143127.524875:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1951 00000100:00100000:1.0:1746143127.524882:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858558848:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143127.526536:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858558976 00000100:00100000:2.0:1746143127.526543:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858558976 00000100:00100000:2.0:1746143127.526579:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12138 00000100:00100000:2.0:1746143127.526585:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858558976:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143127.526598:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.526615:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009490d200/0x25aee876ca70c9bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd51 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.526643:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009490d200/0x25aee876ca70c9bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd51 expref: 11 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.526653:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009490d200/0x25aee876ca70c9bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd51 expref: 11 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.526668:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490d200, rc 0) 00000100:00100000:2.0:1746143127.526700:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858558976:12345-192.168.201.28@tcp:101:cat.0 Request processed in 114us (2102us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143127.526706:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12138 00000100:00100000:2.0:1746143127.547050:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858558848:12345-192.168.201.28@tcp:4:cat.0 Request processed in 22140us (22684us total) trans 17179872711 rc 0/0 00000100:00100000:2.0:1746143127.547063:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1951 00002000:00100000:2.0:1746143127.547075:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2101248->2965503) req@ffff880091981880 x1830962858558848/t17179872711(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/448 e 0 to 0 dl 1746143138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.547086:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091981880 with x1830962858558848 ext(2101248->2965503) 00010000:00010000:2.0:1746143127.547096:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 24 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.547114:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 24 pid: 4758 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143127.547122:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091981880 00000001:00080000:2.0:1746143127.574808:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839968 is committed 00000001:00080000:2.0:1746143127.574827:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839955 is committed 00000001:00080000:2.0:1746143127.574838:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839967 is committed 00000100:00100000:0.0:1746143127.585179:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.585436:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858559104 00000100:00100000:2.0:1746143127.585446:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858559104 00010000:00010000:2.0:1746143127.585487:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 24 pid: 4758 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.585523:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6412 00000100:00100000:2.0:1746143127.585532:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858559104:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143127.585546:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143127.585567:0:16965:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143125 -> 1746143126 00002000:00010000:2.0:1746143127.585570:0:16965:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143125 -> 1746143126 00010000:00010000:2.0:1746143127.585576:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 24 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.585588:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 24 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.585614:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093114200/0x25aee876ca70c98b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2101248->3145727] (req 2101248->2965503) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd20 expref: 24 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.585630:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.585632:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.585640:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 23 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.585649:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 23 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.585681:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 23 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.585699:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861212928:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143127.585797:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143127.587859:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861212928:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143127.587878:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.587914:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858559104:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2382us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.587924:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6412 00000100:00100000:0.0:1746143127.594171:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.594225:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.594308:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858559488 00000100:00100000:2.0:1746143127.594327:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858559488 00002000:00100000:2.0:1746143127.594380:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a70a80 x1830962858559488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143127.594385:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858559360 00002000:00100000:2.0:1746143127.594391:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70a80 with x1830962858559488 ext(3145728->4194303) 00000100:00100000:1.0:1746143127.594391:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858559360 00002000:00010000:2.0:1746143127.594398:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a70a80 00002000:00100000:1.0:1746143127.594414:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092a71500 x1830962858559360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.594423:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71500 with x1830962858559360 ext(2097152->3145727) 00002000:00010000:1.0:1746143127.594427:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a71500 00000100:00100000:2.0:1746143127.594430:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5913 00000100:00100000:2.0:1746143127.594438:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858559488:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143127.594636:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5914 00000100:00100000:1.0:1746143127.594645:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858559360:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143127.608941:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858559360:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14286us (14704us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143127.608954:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5914 00002000:00100000:1.0:1746143127.608967:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092a71500 x1830962858559360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143127.608976:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71500 with x1830962858559360 ext(2097152->3145727) 00002000:00010000:1.0:1746143127.608982:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a71500 00000100:00100000:2.0:1746143127.612754:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858559488:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18302us (18581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143127.612768:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5913 00002000:00100000:2.0:1746143127.612781:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a70a80 x1830962858559488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:278/0 lens 488/440 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.612792:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70a80 with x1830962858559488 ext(3145728->4194303) 00002000:00010000:2.0:1746143127.612798:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a70a80 00000100:00100000:0.0:1746143127.613080:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.613308:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858559744 00000100:00100000:1.0:1746143127.613325:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858559744 00000100:00100000:1.0:1746143127.613377:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12139 00000100:00100000:1.0:1746143127.613384:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30866:x1830962858559744:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143127.613400:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.613420:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd58 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.613451:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.613462:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.613468:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.613470:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.613473:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 11 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.613510:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.613523:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 22 pid: 8449 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143127.613534:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213056:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143127.613609:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.613618:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.613626:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213184:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.613646:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143127.621134:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213056:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.621148:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213184:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143127.621181:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 11 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.621201:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bdd400, rc 0) 00000100:00100000:1.0:1746143127.621252:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30866:x1830962858559744:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7867us (8173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.621266:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12139 00000100:00100000:0.0:1746143127.623143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.623238:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.623332:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858559872 00000100:00100000:1.0:1746143127.623340:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858559872 00000100:00100000:1.0:1746143127.623806:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12140 00000100:00100000:1.0:1746143127.623815:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858559872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143127.624073:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.624093:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bdc200/0x25aee876ca70c9ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd5f expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.624116:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.624127:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bdc200/0x25aee876ca70c9ca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd5f expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.624138:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bdc200/0x25aee876ca70c9ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd5f expref: 24 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143127.624329:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858560000 00000100:00100000:2.0:1746143127.624334:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858560000 00010000:00010000:2.0:1746143127.624358:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 24 pid: 8449 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143127.624379:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6413 00000100:00100000:2.0:1746143127.624385:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858560000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143127.624395:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143127.624416:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 24 pid: 8449 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143127.624428:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 24 pid: 8449 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143127.624445:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801317b3c00/0x25aee876ca70c914 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fca9 expref: 24 pid: 8449 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143127.624459:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.624490:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858560000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 105us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.624497:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6413 00000100:00100000:0.0:1746143127.624873:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.624928:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858560128 00000100:00100000:2.0:1746143127.624932:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858560128 00010000:00010000:1.0:1746143127.625013:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bdc200, rc 0) 00000100:00100000:1.0:1746143127.625052:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858559872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1238us (1916us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143127.625058:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12140 00010000:00010000:2.0:1746143127.625754:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.625862:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6414 00000100:00100000:2.0:1746143127.625869:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858560128:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143127.625879:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143127.625893:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.625903:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.625918:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b609000/0x25aee876ca70c8ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc7f expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.625928:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.625930:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.625937:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 10 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.625945:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 10 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.625976:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 10 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.625988:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861213312:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143127.626694:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.635436:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.635463:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861213312:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143127.635488:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.635553:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858560128:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9682us (10678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.635565:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6414 00000100:00100000:3.0:1746143127.635806:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858560384 00000100:00100000:3.0:1746143127.635900:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858560384 00002000:00100000:3.0:1746143127.635941:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1957888->1961983) req@ffff88008e80d880 x1830962858560384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143127.635951:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d880 with x1830962858560384 ext(1957888->1961983) 00002000:00010000:3.0:1746143127.635956:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80d880 00000100:00100000:3.0:1746143127.635971:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5915 00000100:00100000:3.0:1746143127.635977:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858560384:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143127.637144:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858560384:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1163us (1716us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143127.637152:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5915 00002000:00100000:3.0:1746143127.637158:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1957888->1961983) req@ffff88008e80d880 x1830962858560384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/4536 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143127.637166:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d880 with x1830962858560384 ext(1957888->1961983) 00002000:00010000:3.0:1746143127.637170:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80d880 00000100:00100000:0.0:1746143127.640910:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.641440:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858560512 00000100:00100000:1.0:1746143127.641451:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858560512 00000100:00100000:1.0:1746143127.641517:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12141 00000100:00100000:1.0:1746143127.641525:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30866:x1830962858560512:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143127.641548:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.641567:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd66 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.641599:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.641609:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.641617:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 5 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.641624:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.641626:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.641629:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->1871871] (req 1048576->1871871) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 11 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.641661:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 5 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.641673:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 5 pid: 754 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143127.641683:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213440:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143127.641787:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.641796:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 21 pid: 8449 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143127.641806:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213568:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143127.641836:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.641845:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.641853:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213696:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.641870:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.647996:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.648529:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858560768 00000100:00100000:2.0:1746143127.648539:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858560768 00010000:00010000:2.0:1746143127.648583:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 12 pid: 4756 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.648794:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213440:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.648806:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213568:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.648816:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861213696:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.648827:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6415 00000100:00100000:2.0:1746143127.648834:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858560768:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.648850:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->1871871] (req 1048576->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.648852:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.648867:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bddc00, rc 0) 00010000:00010000:2.0:1746143127.648876:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 12 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.648886:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 12 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.648908:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ca8200/0x25aee876ca70c66d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa48 expref: 12 pid: 4756 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.648916:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30866:x1830962858560512:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7393us (8019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.648923:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12141 00010000:00010000:2.0:1746143127.648927:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.648944:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858560768:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 111us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.648949:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6415 00000100:00100000:0.0:1746143127.649237:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.650486:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858560640 00000100:00100000:2.0:1746143127.650494:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858560640 00010000:00010000:2.0:1746143127.650517:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 6 pid: 754 timeout: 1009 lvb_type: 1 00000100:00100000:0.0:1746143127.650522:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.650543:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858560896 00000100:00100000:2.0:1746143127.650545:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858560896 00000100:00100000:0.0:1746143127.650550:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6416 00010000:00010000:2.0:1746143127.650555:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 22 pid: 8449 timeout: 1009 lvb_type: 1 00000100:00100000:0.0:1746143127.650558:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858560640:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143127.650569:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6417 00010000:00010000:0.0:1746143127.650569:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143127.650573:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858560896:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143127.650579:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143127.650585:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 22 pid: 8449 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143127.650586:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 6 pid: 754 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143127.650595:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 6 pid: 754 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143127.650611:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50cea00/0x25aee876ca70c6a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa64 expref: 6 pid: 754 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143127.650627:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143127.650656:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1970:x1830962858560640:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 98us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.650661:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6416 00010000:00010000:2.0:1746143127.651360:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 22 pid: 8449 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143127.651376:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f6c800/0x25aee876ca70c700 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164faa3 expref: 22 pid: 8449 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143127.651389:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.651391:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.651398:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.651406:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.651439:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.651453:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861213824:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143127.652373:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143127.658357:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861213824:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143127.658384:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.659063:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858560896:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8485us (8537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.659076:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6417 00000100:00100000:0.0:1746143127.669972:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.670335:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858561152 00000100:00100000:3.0:1746143127.670345:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858561152 00002000:00100000:3.0:1746143127.670395:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1867776->1871871) req@ffff88008e80f100 x1830962858561152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143127.670600:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f100 with x1830962858561152 ext(1867776->1871871) 00002000:00010000:3.0:1746143127.670607:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80f100 00000100:00100000:3.0:1746143127.670630:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5916 00000100:00100000:3.0:1746143127.670638:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858561152:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143127.670844:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858561152:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 205us (883us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143127.670854:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5916 00002000:00100000:3.0:1746143127.670861:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1867776->1871871) req@ffff88008e80f100 x1830962858561152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/4536 e 0 to 0 dl 1746143138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143127.670869:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f100 with x1830962858561152 ext(1867776->1871871) 00002000:00010000:3.0:1746143127.670872:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80f100 00000100:00100000:0.0:1746143127.701768:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.702276:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858561280 00000100:00100000:3.0:1746143127.702287:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858561280 00000100:00100000:3.0:1746143127.702350:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8101 00000100:00100000:3.0:1746143127.702359:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30873:x1830962858561280:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143127.702382:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143127.702404:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3600/0x25aee876ca70c9d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd6d expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.702484:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.702984:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.702998:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.703014:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.703019:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.703024:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.706279:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.706303:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.706310:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.706330:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.706370:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.706387:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 200 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.706400:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861213952:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.707215:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.707226:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 10 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.707236:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861214080:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143127.710465:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.711214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.711572:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861213952:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.711752:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858561536 00000100:00100000:0.0:1746143127.711761:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858561536 00000100:00100000:1.0:1746143127.712093:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3412 00000100:00100000:1.0:1746143127.712102:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:15437:x1830962858561536:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143127.712671:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:15437:x1830962858561536:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 568us (1462us total) trans 8589942312 rc 0/0 00000100:00100000:1.0:1746143127.712680:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3412 00000100:00100000:0.0:1746143127.718018:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.721198:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858561664 00000100:00100000:2.0:1746143127.721212:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858561664 00010000:00010000:2.0:1746143127.721257:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 202 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.721287:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6418 00000100:00100000:2.0:1746143127.721295:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1971:x1830962858561664:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143127.721310:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143127.721331:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 202 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.721342:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 202 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.721365:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408800/0x25aee876ca70c785 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb21 expref: 202 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.721519:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.721577:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861214080:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143127.721603:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:1.0:1746143127.721630:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858561920 00000100:00100000:1.0:1746143127.721633:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858561920 00000100:00100000:1.0:1746143127.721656:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3413 00000100:00100000:1.0:1746143127.721661:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:7717:x1830962858561920:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143127.721868:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:7717:x1830962858561920:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 204us (348us total) trans 8589942313 rc 0/0 00000100:00100000:1.0:1746143127.721875:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3413 00010000:00010000:2.0:1746143127.723677:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143127.723688:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.723704:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.723710:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.723715:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.723780:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1971:x1830962858561664:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2482us (5770us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.724002:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6418 00000100:00100000:1.0:1746143127.729453:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.729547:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858562048 00000100:00100000:2.0:1746143127.729557:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858562048 00010000:00010000:2.0:1746143127.729594:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 12 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.729623:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6419 00000100:00100000:2.0:1746143127.729630:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858562048:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143127.729647:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143127.729653:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 12 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.729665:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 12 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.729687:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094efbc00/0x25aee876ca70c6eb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa95 expref: 12 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.729704:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143127.729710:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.729720:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.729726:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.729756:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.729798:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858562048:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 168us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.729805:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6419 00010000:00010000:0.0:1746143127.729908:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.729917:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143127.729962:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143127.729966:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143127.729985:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.729994:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.730004:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.730010:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.730015:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.730021:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008efa3c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143127.730025:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.730052:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.730065:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143127.730068:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143127.730072:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.730076:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3c00/0x25aee876ca70c9df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.732483:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.732498:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.732504:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.732510:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008efa3000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143127.732514:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.732520:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.732532:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531300) 00010000:00010000:0.0:1746143127.732535:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143127.732537:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.732542:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3000/0x25aee876ca70c9e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.732646:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3600/0x25aee876ca70c9d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.732661:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.732668:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143127.732670:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143127.732672:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efa2600, rc 0) 00000100:00100000:0.0:1746143127.732731:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858561280:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 30370us (30974us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.732740:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8101 00000100:00100000:0.0:1746143127.738204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.738248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.738271:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.738299:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858562176 00000100:00100000:0.0:1746143127.738308:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858562176 00000100:00100000:0.0:1746143127.738362:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858562432 00000100:00100000:0.0:1746143127.738364:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858562432 00000100:00100000:0.0:1746143127.738377:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858562688 00000100:00100000:0.0:1746143127.738379:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858562688 00000100:00100000:0.0:1746143127.738393:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12142 00000100:00100000:0.0:1746143127.738400:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858562176:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143127.738422:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143127.738442:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd74 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.738468:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143127.738471:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143127.738481:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.738499:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.738512:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093244400, rc 0) 00000100:00100000:0.0:1746143127.738559:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858562176:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 158us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.738565:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12142 00000100:00100000:0.0:1746143127.738581:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12143 00000100:00100000:0.0:1746143127.738586:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1971:x1830962858562432:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143127.738593:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143127.738602:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093245200/0x25aee876ca70c9fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd82 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143127.738641:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861214208:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143127.738709:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.738731:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12144 00000100:00100000:0.0:1746143127.738736:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858562688:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143127.738742:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143127.738749:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd90 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.738762:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143127.738763:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143127.738769:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.738783:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.738791:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245000, rc 0) 00000100:00100000:0.0:1746143127.738808:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858562688:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 72us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.738832:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12144 00000100:00100000:0.0:1746143127.738863:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.738876:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858562304 00000100:00100000:0.0:1746143127.738879:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858562304 00000100:00100000:1.0:1746143127.739085:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.739489:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.739505:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858562560 00000100:00100000:1.0:1746143127.739508:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858562560 00000100:00100000:1.0:1746143127.739525:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858562816 00000100:00100000:1.0:1746143127.739526:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858562816 00000100:00100000:1.0:1746143127.739539:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12145 00000100:00100000:1.0:1746143127.739545:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858562560:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143127.739552:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.739561:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd89 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.739578:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.739580:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.739585:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.739596:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.739604:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a524a200, rc 0) 00000100:00100000:1.0:1746143127.739623:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858562560:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 78us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.739629:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12145 00000100:00100000:1.0:1746143127.739641:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12146 00000100:00100000:1.0:1746143127.739645:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858562816:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143127.739651:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143127.739658:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd97 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.739670:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.739672:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.739676:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.739686:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.739698:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bdd200, rc 0) 00000100:00100000:1.0:1746143127.739714:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858562816:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.739718:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12146 00000100:00100000:0.0:1746143127.741945:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12147 00000100:00100000:0.0:1746143127.741960:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858562304:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143127.741973:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143127.741987:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093244c00/0x25aee876ca70ca17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd7b expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143127.742055:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091980e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861214336:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143127.742138:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746143127.748311:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143123 -> 1746143126 00002000:00010000:2.0:1746143127.748330:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143123 -> 1746143126 00002000:00010000:2.0:1746143127.748332:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143123 -> 1746143126 00000100:00100000:2.0:1746143127.748358:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861214208:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143127.748392:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093245200/0x25aee876ca70c9fb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd82 expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.748407:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093245200/0x25aee876ca70c9fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd82 expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.748432:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245200, rc 0) 00000100:00100000:2.0:1746143127.748484:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858562432:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 9896us (10234us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143127.748496:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12143 00002000:00010000:1.0:1746143127.748818:0:4756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143125 -> 1746143126 00002000:00010000:1.0:1746143127.748822:0:4756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143125 -> 1746143126 00002000:00010000:1.0:1746143127.748824:0:4756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143125 -> 1746143126 00000100:00100000:1.0:1746143127.748835:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091980e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861214336:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143127.748853:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093244c00/0x25aee876ca70ca17 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd7b expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.748862:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093244c00/0x25aee876ca70ca17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd7b expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143127.748875:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093244c00, rc 0) 00000100:00100000:1.0:1746143127.748897:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858562304:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 6943us (10033us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143127.748902:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12147 00000100:00100000:0.0:1746143127.751538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.752594:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858563072 00000100:00100000:2.0:1746143127.752605:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858563072 00000100:00100000:2.0:1746143127.752656:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8102 00000100:00100000:2.0:1746143127.752664:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858563072:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143127.752686:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.752706:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab400/0x25aee876ca70ca1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fd9e expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.756510:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.756535:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.756542:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.756582:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.756596:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 9 pid: 14794 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.756609:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861214464:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.756715:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.759689:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.759871:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861214464:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.759897:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143127.759998:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858563200 00000100:00100000:3.0:1746143127.760004:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858563200 00010000:00010000:3.0:1746143127.760056:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 10 pid: 14794 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.760092:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6420 00000100:00100000:3.0:1746143127.760100:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858563200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143127.760115:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.760121:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 10 pid: 14794 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.760132:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 10 pid: 14794 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.760154:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa2600/0x25aee876ca70c9ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd6d expref: 10 pid: 14794 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.760184:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143127.760189:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.760199:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.760206:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.760223:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.760272:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858563200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 172us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.760282:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6420 00010000:00010000:2.0:1746143127.760345:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.760352:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143127.760375:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143127.760527:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab400/0x25aee876ca70ca1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.760542:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.760549:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143127.760551:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143127.760554:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eab000, rc 0) 00000100:00100000:2.0:1746143127.760582:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858563072:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7918us (9053us total) trans 8589942314 rc 0/0 00000100:00100000:2.0:1746143127.760589:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8102 00000100:00100000:0.0:1746143127.766328:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.766395:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858563328 00000100:00100000:2.0:1746143127.766406:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858563328 00000100:00100000:2.0:1746143127.766463:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8103 00000100:00100000:2.0:1746143127.766471:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858563328:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143127.766499:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.766519:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408800/0x25aee876ca70ca33 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fda5 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.766611:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.766626:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.766633:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.766664:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.766676:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 10 pid: 14794 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.766687:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861214592:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.768590:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.772118:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.772136:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861214592:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.772169:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143127.772671:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858563456 00000100:00100000:3.0:1746143127.772678:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858563456 00010000:00010000:3.0:1746143127.772710:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 11 pid: 14794 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.772743:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6421 00000100:00100000:3.0:1746143127.772750:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858563456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143127.772765:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.772770:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 11 pid: 14794 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.772782:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 11 pid: 14794 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.772803:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eab000/0x25aee876ca70ca25 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd9e expref: 11 pid: 14794 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.772830:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143127.772834:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.772845:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.772851:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.772868:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.772912:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858563456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 162us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.772919:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6421 00010000:00010000:2.0:1746143127.773021:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.773027:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143127.773092:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143127.773097:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143127.773115:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.773145:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408800/0x25aee876ca70ca33 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fda5 expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.773159:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fda5 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.773166:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143127.773169:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143127.773171:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d408400, rc 0) 00000100:00100000:2.0:1746143127.777494:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858563328:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 11009us (11174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.777506:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8103 00000100:00100000:0.0:1746143127.782626:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.782682:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.787792:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858563712 00000100:00100000:2.0:1746143127.787805:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858563712 00000100:00100000:2.0:1746143127.787865:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858563584 00000100:00100000:2.0:1746143127.787868:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858563584 00000100:00100000:2.0:1746143127.787889:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12148 00000100:00100000:2.0:1746143127.787896:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858563712:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143127.787915:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.787933:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d409000/0x25aee876ca70ca41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdb3 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.787988:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861214720:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143127.788059:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12149 00000100:00100000:3.0:1746143127.788068:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858563584:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143127.788076:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143127.788081:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4480 going to sleep for 11 seconds 00010000:00010000:3.0:1746143127.788085:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdac expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143127.788113:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861214848:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143127.788138:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143127.792723:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861214848:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143127.792768:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdac expref: 9 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.792785:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdac expref: 9 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143127.793362:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861214720:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143127.793384:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d409000/0x25aee876ca70ca41 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdb3 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.793590:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d409000/0x25aee876ca70ca41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdb3 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.793603:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409000, rc 0) 00000100:00100000:2.0:1746143127.793659:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858563712:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5762us (11045us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143127.793667:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12148 00010000:00010000:3.0:1746143127.793839:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efa3400, rc 0) 00000100:00100000:3.0:1746143127.793868:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858563584:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5802us (11185us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143127.793874:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12149 00000100:00100000:0.0:1746143127.800626:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.800744:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858563968 00000100:00100000:2.0:1746143127.800756:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858563968 00000100:00100000:2.0:1746143127.801021:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8104 00000100:00100000:2.0:1746143127.801052:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858563968:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143127.801072:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143127.801092:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408e00/0x25aee876ca70ca4f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdba expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.801207:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409800/0x25aee876ca70ca56 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.801223:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409800/0x25aee876ca70ca56 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.801687:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409800/0x25aee876ca70ca56 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143127.801706:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143127.802026:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408e00/0x25aee876ca70ca4f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdba expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.802073:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409800/0x25aee876ca70ca56 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdba expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.802082:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143127.802085:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143127.802578:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409800, rc 0) 00000100:00100000:2.0:1746143127.803190:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30873:x1830962858563968:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 2156us (2571us total) trans 8589942315 rc 0/0 00000100:00100000:2.0:1746143127.803199:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8104 00000100:00100000:0.0:1746143127.812687:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.817900:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.818147:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.818175:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858564096 00000100:00100000:3.0:1746143127.818186:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858564096 00000100:00100000:3.0:1746143127.818235:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858564224 00000100:00100000:3.0:1746143127.818238:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858564224 00000100:00100000:3.0:1746143127.818266:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12150 00000100:00100000:3.0:1746143127.818273:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858564096:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:3.0:1746143127.818335:0:26949:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.818356:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.818365:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.818374:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 15 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.818382:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.818384:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.818388:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.818422:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 15 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.818437:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 15 pid: 8449 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143127.818450:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861214976:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.818536:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143127.818545:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 8 pid: 8450 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143127.818554:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861215104:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.818576:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 11 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.818584:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.818591:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861215232:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143127.818605:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143127.818622:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12151 00000100:00100000:3.0:1746143127.818628:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858564224:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:3.0:1746143127.818647:0:8449:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.818657:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.818663:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143127.818664:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143127.818667:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.818687:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.818695:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 9 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.818703:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861215360:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143127.818723:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143127.818852:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858564480 00000100:00100000:2.0:1746143127.818858:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858564480 00000100:00100000:2.0:1746143127.818882:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12152 00000100:00100000:0.0:1746143127.818884:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.818888:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858564480:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:2.0:1746143127.818906:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143127.818906:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143127.818920:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.818929:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.818935:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.818940:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143127.818942:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143127.818943:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143127.818944:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.818960:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143127.818960:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858564736 00000100:00100000:0.0:1746143127.818963:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858564736 00010000:00010000:2.0:1746143127.818968:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 11 pid: 4758 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143127.818976:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861215488:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.818985:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858564608 00000100:00100000:0.0:1746143127.818987:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858564608 00000100:00100000:2.0:1746143127.818988:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858564352 00000100:00100000:2.0:1746143127.818991:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858564352 00000100:00100000:0.0:1746143127.818998:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12153 00000100:00100000:0.0:1746143127.819003:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858564736:12345-192.168.201.28@tcp:1:lfs.0 00000100:00100000:2.0:1746143127.819016:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12154 00010000:00010000:0.0:1746143127.819019:0:8169:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.819020:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858564608:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143127.819045:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 20 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819052:0:8448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.819053:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.819059:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819062:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.819064:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143127.819065:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143127.819068:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819069:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.819076:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.819082:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.819087:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819090:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.819095:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 9 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.819097:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 11 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819102:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746143127.819103:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00000100:00100000:0.0:1746143127.819103:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861215616:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.819104:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 9/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819118:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 11 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819125:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 11 pid: 21048 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.819131:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861215744:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143127.819131:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.819138:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 8 pid: 4758 timeout: 1009 lvb_type: 1 00000100:00100000:0.0:1746143127.819146:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861215872:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.819160:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.819164:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 20 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819167:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 15 pid: 8449 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.819172:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 20 pid: 26949 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.819174:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216000:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.819179:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861216128:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.819192:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec0240 going to sleep for 11 seconds 00010000:00010000:2.0:1746143127.819193:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819200:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 15 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143127.819206:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12155 00000100:00100000:2.0:1746143127.819207:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216256:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.819210:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858564352:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:2.0:1746143127.819225:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.819226:0:20836:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819231:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 11 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143127.819234:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.819237:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216384:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143127.819239:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143127.819240:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143127.819242:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819252:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143127.819253:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 9 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819260:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 10 pid: 4756 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143127.819260:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 9 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.819266:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216512:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.819267:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861216640:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.819280:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec03c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143127.819287:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.819293:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 15 pid: 8450 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.819301:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216768:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.819311:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4840 going to sleep for 11 seconds 00010000:00010000:2.0:1746143127.819355:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143127.819363:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 10 pid: 4758 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143127.820913:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861216896:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.828178:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.828221:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 15 pid: 4758 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.828242:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861217024:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.828391:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.834237:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.834257:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861214976:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143127.834271:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861215104:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143127.834280:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861215232:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.834321:0:26949:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143127.834340:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861215616:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.834341:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861215360:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.834615:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858564864 00000100:00100000:1.0:1746143127.834622:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858564864 00010000:00010000:1.0:1746143127.834659:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 11 pid: 8450 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143127.834699:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6422 00000100:00100000:1.0:1746143127.834707:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858564864:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.834721:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143127.835437:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.835523:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 11 pid: 8450 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.835534:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 11 pid: 8450 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.835556:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093244400/0x25aee876ca70c9f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd74 expref: 11 pid: 8450 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.835577:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.835624:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858564864:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 918us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.835632:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6422 00000100:00100000:2.0:1746143127.838224:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861215744:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143127.854579:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861215872:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.854586:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.854592:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861216128:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.854612:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858564992 00000100:00100000:1.0:1746143127.854618:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858564992 00010000:00010000:0.0:1746143127.854618:0:8169:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.854650:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 16 pid: 8449 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143127.854693:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6423 00000100:00100000:1.0:1746143127.854702:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858564992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.854715:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.854741:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 16 pid: 8449 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.854753:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 16 pid: 8449 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143127.854810:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216000:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.854819:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216256:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143127.854967:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801317b2200/0x25aee876ca70c8e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc78 expref: 16 pid: 8449 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.854997:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.855053:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1971:x1830962858564992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 351us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.855060:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6423 00000100:00100000:0.0:1746143127.855068:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.855794:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858565248 00000100:00100000:2.0:1746143127.855799:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858565248 00010000:00010000:2.0:1746143127.855819:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 12 pid: 21048 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.855837:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6424 00000100:00100000:2.0:1746143127.855842:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858565248:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143127.855851:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143127.855865:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 12 pid: 21048 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.856075:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 12 pid: 21048 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.856089:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f409000/0x25aee876ca70c79a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fb2f expref: 12 pid: 21048 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.856108:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143127.856129:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858565248:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 286us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143127.856135:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6424 00000100:00100000:1.0:1746143127.856922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.856940:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.856972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.856982:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858565504 00000100:00100000:3.0:1746143127.856987:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858565504 00000100:00100000:1.0:1746143127.856988:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.857002:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858565760 00000100:00100000:1.0:1746143127.857005:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858565760 00010000:00010000:3.0:1746143127.857006:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 15 pid: 8449 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.857020:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 16 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.857025:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858565376 00000100:00100000:3.0:1746143127.857027:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858565376 00000100:00100000:0.0:1746143127.857046:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6425 00000100:00100000:1.0:1746143127.857051:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6426 00000100:00100000:0.0:1746143127.857054:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858565504:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143127.857055:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858565760:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.857062:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143127.857062:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.857073:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 9 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.857073:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 16 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.857073:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 16 pid: 8449 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.857082:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 16 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.857089:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 16 pid: 8449 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.857097:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6427 00000100:00100000:3.0:1746143127.857104:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858565376:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143127.857114:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.857129:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 9 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:3.0:1746143127.857139:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 9 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:3.0:1746143127.857155:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bdd200/0x25aee876ca70ca10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd97 expref: 9 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:3.0:1746143127.857170:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.857194:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858565376:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 91us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.857200:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6427 00010000:00010000:1.0:1746143127.857501:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70c93e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcd3 expref: 16 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.857513:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.857530:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1971:x1830962858565760:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 475us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.857536:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6426 00000100:00100000:1.0:1746143127.857573:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.857585:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858565632 00000100:00100000:1.0:1746143127.857588:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858565632 00010000:00010000:1.0:1746143127.857600:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 10 pid: 4758 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.857629:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6428 00000100:00100000:1.0:1746143127.857634:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858565632:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.857641:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.857649:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 10 pid: 4758 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.857654:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216384:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143127.857658:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 10 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.857670:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132eb2a00/0x25aee876ca70c999 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd2e expref: 10 pid: 4758 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.857676:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143127.857680:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.857694:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858565632:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.857704:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6428 00000100:00100000:2.0:1746143127.857705:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.857713:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858565888 00000100:00100000:3.0:1746143127.857714:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858566016 00000100:00100000:1.0:1746143127.857715:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858565888 00000100:00100000:3.0:1746143127.857718:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858566016 00010000:00010000:1.0:1746143127.857726:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.857733:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 21 pid: 26949 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.857737:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861216640:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143127.857740:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6429 00000100:00100000:1.0:1746143127.857744:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858565888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.857750:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143127.857752:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6430 00010000:00010000:2.0:1746143127.857752:0:20836:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143127.857756:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858566016:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.857759:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.857763:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.857768:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.857771:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 21 pid: 26949 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.857779:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b608e00/0x25aee876ca70c8d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fc6a expref: 11 pid: 4756 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.857784:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 21 pid: 26949 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.857788:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216512:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143127.857789:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.857791:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.857796:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a48e1a00/0x25aee876ca70c9ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd43 expref: 21 pid: 26949 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.857796:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.857805:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.857805:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.857806:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.857808:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.857812:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861216768:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.857816:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.857825:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143127.857830:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143127.857839:0:8448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143127.857847:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858566016:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 91us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.857853:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6430 00010000:00010000:3.0:1746143127.857870:0:26949:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.857878:0:26949:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.857897:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143127.857898:0:26949:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.857910:0:26949:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.857914:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143127.857917:0:26949:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.857922:0:26949:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008efa3000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143127.857926:0:26949:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.857931:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858565120 00010000:00010000:3.0:1746143127.857933:0:26949:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143127.857934:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858565120 00010000:00010000:3.0:1746143127.857942:0:26949:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.857946:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70ca64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143127.857962:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1957888->2097151) req@ffff880092aec700 x1830962858565120/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.857971:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec700 with x1830962858565120 ext(1957888->2097151) 00010000:00010000:2.0:1746143127.857978:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 9 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.857985:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858564096:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 39713us (45310us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143127.857987:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 9 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.857992:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12150 00002000:00010000:2.0:1746143127.857993:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aec700 00000100:00100000:2.0:1746143127.858004:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858566144 00000100:00100000:2.0:1746143127.858007:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858566144 00000100:00100000:3.0:1746143127.858013:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1952 00000100:00100000:3.0:1746143127.858018:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858565120:12345-192.168.201.28@tcp:4:multiop.0 00002000:00100000:2.0:1746143127.858018:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1871871) req@ffff88008e80c380 x1830962858566144/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/0 e 0 to 0 dl 1746143138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.858025:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c380 with x1830962858566144 ext(1048576->1871871) 00010000:00010000:2.0:1746143127.858050:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 10 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.858059:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 10 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143127.858066:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e80c380 00000100:00100000:2.0:1746143127.858079:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1953 00000100:00100000:2.0:1746143127.858084:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858566144:12345-192.168.201.28@tcp:4:multiop.0 00010000:00010000:0.0:1746143127.858145:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f6c200/0x25aee876ca70c746 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fae9 expref: 14 pid: 8449 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.858185:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.858201:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858566272 00000100:00100000:3.0:1746143127.858204:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858566272 00010000:00010000:3.0:1746143127.858214:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 9 pid: 4756 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143127.858227:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6431 00000100:00100000:3.0:1746143127.858232:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858566272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143127.858235:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1971:x1830962858565504:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1178us (1311us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143127.858237:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.858244:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 9 pid: 4756 timeout: 1009 lvb_type: 1 00000100:00100000:0.0:1746143127.858244:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6425 00010000:00010000:3.0:1746143127.858253:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 9 pid: 4756 timeout: 1009 lvb_type: 1 00010000:00010000:3.0:1746143127.858264:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70ca02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd90 expref: 9 pid: 4756 timeout: 1009 lvb_type: 1 00010000:00010000:3.0:1746143127.858270:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.858284:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858566272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 53us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.858289:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6431 00010000:00010000:0.0:1746143127.858290:0:8169:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.858298:0:8169:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.858334:0:8169:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.858348:0:8169:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.858355:0:8169:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143127.858356:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858565888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 606us (675us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143127.858361:0:8169:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093245400 already unused, calling callback (ffffffffa0868d70) 00000100:00100000:1.0:1746143127.858362:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6429 00010000:00010000:0.0:1746143127.858364:0:8169:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.858370:0:8169:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.858382:0:8169:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.858387:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70ca79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143127.858422:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858564736:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 39418us (39538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.858430:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.858430:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12153 00000100:00100000:1.0:1746143127.858442:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858566400 00000100:00100000:1.0:1746143127.858445:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858566400 00010000:00010000:1.0:1746143127.858455:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 10 pid: 4758 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143127.858468:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6432 00000100:00100000:1.0:1746143127.858473:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858566400:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.858479:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.858487:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 10 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.858501:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 10 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.858513:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093114e00/0x25aee876ca70c961 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fcef expref: 10 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.858521:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.858533:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858566400:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 60us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.858538:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6432 00000100:00100000:1.0:1746143127.858585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.858618:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.858640:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.858652:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858566528 00000100:00100000:0.0:1746143127.858652:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858566656 00000100:00100000:1.0:1746143127.858655:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858566528 00000100:00100000:0.0:1746143127.858658:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858566656 00010000:00010000:1.0:1746143127.858667:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 9 pid: 4758 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143127.858681:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858566784 00000100:00100000:1.0:1746143127.858683:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858566784 00010000:00010000:1.0:1746143127.858690:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 13 pid: 4758 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.858701:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6433 00000100:00100000:1.0:1746143127.858705:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858566528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.858710:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.858719:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 9 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.858726:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 9 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143127.858736:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.858955:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858566528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 249us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.858960:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6433 00000100:00100000:1.0:1746143127.858968:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6434 00000100:00100000:1.0:1746143127.858972:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858566784:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.858977:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.858983:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 13 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.858990:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 13 pid: 4758 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.858999:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.859005:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858566784:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 34us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.859010:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6434 00000100:00100000:1.0:1746143127.859104:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.859117:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858566912 00000100:00100000:1.0:1746143127.859119:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858566912 00010000:00010000:1.0:1746143127.859130:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 13 pid: 8450 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.859141:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6435 00000100:00100000:1.0:1746143127.859145:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1971:x1830962858566912:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.859152:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.859159:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 13 pid: 8450 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.859166:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 13 pid: 8450 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.859176:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd1600/0x25aee876ca70c94c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fce1 expref: 13 pid: 8450 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.859190:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.859192:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.859195:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859201:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859216:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.859227:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:1971:x1830962858566912:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 81us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.859231:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6435 00010000:00010000:1.0:1746143127.859245:0:8448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859252:0:8448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859265:0:8448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859272:0:8448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859277:0:8448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859287:0:8448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d409c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143127.859290:0:8448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859295:0:8448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859303:0:8448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.859307:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70ca80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143127.859341:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858564608:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 40321us (40435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.859347:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12154 00010000:00010000:0.0:1746143127.861165:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 7 pid: 4758 timeout: 1009 lvb_type: 1 00000100:00100000:0.0:1746143127.861213:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6436 00000100:00100000:0.0:1746143127.861223:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858566656:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143127.861234:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143127.861252:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 7 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143127.861262:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 7 pid: 4758 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143127.861278:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143127.861280:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143127.861284:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.861291:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.861307:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143127.861343:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858566656:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 123us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.861350:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6436 00010000:00010000:3.0:1746143127.861546:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bdda00/0x25aee876ca70c9a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd35 expref: 8 pid: 4758 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143127.861562:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861215488:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.861573:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a524a200/0x25aee876ca70ca09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd89 expref: 6 pid: 4758 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143127.861588:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861216896:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.861598:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bdd000/0x25aee876ca70c992 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd27 expref: 11 pid: 4758 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.861607:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861217024:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143127.861629:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861637:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861644:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861666:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861673:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861680:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861687:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d408a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143127.861690:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861698:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861709:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.861715:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70ca72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143127.861753:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858564480:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 42865us (43606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.861760:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12152 00000100:00100000:3.0:1746143127.881408:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858565120:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 23375us (24421us total) trans 17179872712 rc 0/0 00000100:00100000:3.0:1746143127.881422:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1952 00002000:00100000:3.0:1746143127.881436:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1957888->2097151) req@ffff880092aec700 x1830962858565120/t17179872712(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/448 e 0 to 0 dl 1746143138 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143127.881445:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec700 with x1830962858565120 ext(1957888->2097151) 00010000:00010000:3.0:1746143127.881458:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.881473:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:3.0:1746143127.881481:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aec700 00000100:00100000:2.0:1746143127.888879:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.889001:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858567040 00000100:00100000:3.0:1746143127.889011:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858567040 00010000:00010000:3.0:1746143127.889078:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.889109:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6437 00000100:00100000:3.0:1746143127.889117:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858567040:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143127.889131:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.889156:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.889168:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.889191:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bdd400/0x25aee876ca70c9c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd58 expref: 13 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.889211:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.889214:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143127.889219:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.889228:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143127.889252:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.889305:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858567040:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 188us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.889326:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6437 00010000:00010000:1.0:1746143127.889604:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.889614:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.889637:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.889645:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.889654:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.889662:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008efa3400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143127.889665:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.889673:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.889684:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.889690:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70ca6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143127.889734:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858564224:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 71105us (71845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.889742:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12151 00000100:00100000:2.0:1746143127.893356:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858566144:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 35261us (35430us total) trans 17179872713 rc 0/0 00000100:00100000:2.0:1746143127.893371:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1953 00002000:00100000:2.0:1746143127.893384:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1871871) req@ffff88008e80c380 x1830962858566144/t17179872713(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:278/0 lens 488/448 e 0 to 0 dl 1746143138 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143127.893395:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c380 with x1830962858566144 ext(1048576->1871871) 00010000:00010000:2.0:1746143127.893405:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 12 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143127.893421:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 12 pid: 754 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143127.893428:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e80c380 00000100:00100000:0.0:1746143127.902559:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.902637:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858567168 00000100:00100000:1.0:1746143127.902647:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858567168 00010000:00010000:1.0:1746143127.902685:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 12 pid: 754 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.902728:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6438 00000100:00100000:1.0:1746143127.902736:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858567168:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.902753:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.902780:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 12 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.902794:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 12 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.902817:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bddc00/0x25aee876ca70c9d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fd66 expref: 12 pid: 754 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.902834:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.902837:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143127.902842:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.902851:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143127.902876:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.902917:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858567168:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 182us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.902924:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6438 00010000:00010000:0.0:1746143127.903108:0:20836:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.903119:0:20836:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.903142:0:20836:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.903157:0:20836:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.903164:0:20836:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.903170:0:20836:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5266c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143127.903174:0:20836:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.903181:0:20836:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.903191:0:20836:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143127.903196:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5266c00/0x25aee876ca70ca87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143127.903267:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858564352:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 84054us (84322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.903276:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12155 00000100:00100000:0.0:1746143127.908706:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143127.908811:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858567424 00000100:00100000:2.0:1746143127.908821:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858567424 00000100:00100000:2.0:1746143127.908871:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8105 00000100:00100000:2.0:1746143127.909109:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30873:x1830962858567424:12345-192.168.201.28@tcp:36:lfs.0 00010000:00010000:2.0:1746143127.909216:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746143127.909243:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70ca3a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fda5 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909282:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5a00/0x25aee876ca70c6c8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fa80 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909295:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143127.909299:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143127.909339:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.909350:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909356:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909363:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909369:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909375:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909383:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909389:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909396:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 10/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.909426:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.909438:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 10 pid: 1037 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.909450:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217152:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.913194:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.913216:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 200 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.913231:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217280:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.913303:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.913326:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 200 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.913336:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217408:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.913371:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.913379:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 10 pid: 1037 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.913386:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217536:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.913411:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.913417:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 200 pid: 14795 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.913424:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217664:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.913446:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.913453:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 10 pid: 14796 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.913460:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217792:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.913483:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143127.913494:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 10 pid: 1037 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.913500:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217920:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.913516:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a1d4600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143127.920910:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.920947:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.920984:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.921003:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.921016:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858567808 00000100:00100000:0.0:1746143127.921018:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.921026:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858567808 00000100:00100000:0.0:1746143127.921059:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858567552 00000100:00100000:0.0:1746143127.921063:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858567552 00010000:00010000:0.0:1746143127.921088:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 202 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.921090:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858568192 00000100:00100000:1.0:1746143127.921092:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858568192 00000100:00100000:1.0:1746143127.921108:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3414 00000100:00100000:0.0:1746143127.921108:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858567936 00000100:00100000:1.0:1746143127.921115:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:7717:x1830962858567808:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143127.921115:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858567936 00010000:00010000:0.0:1746143127.921123:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 12 pid: 1037 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143127.921134:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858568448 00000100:00100000:0.0:1746143127.921135:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858568448 00010000:00010000:0.0:1746143127.921142:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 13 pid: 14796 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143127.921154:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6439 00000100:00100000:0.0:1746143127.921158:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1970:x1830962858567552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143127.921217:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6440 00000100:00100000:3.0:1746143127.921224:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858567936:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143127.921232:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.921243:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 13 pid: 1037 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.921253:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 13 pid: 1037 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.921276:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143127.921283:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.921292:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.921350:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858567936:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.921356:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6440 00000100:00100000:3.0:1746143127.921372:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6441 00000100:00100000:3.0:1746143127.921377:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858568448:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143127.921384:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.921388:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 12 pid: 14796 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.921395:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 12 pid: 14796 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.921409:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143127.921413:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.921418:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.921442:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858568448:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 65us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.921443:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:7717:x1830962858567808:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 328us (495us total) trans 8589942316 rc 0/0 00000100:00100000:3.0:1746143127.921448:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6441 00000100:00100000:1.0:1746143127.921449:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3414 00000100:00100000:1.0:1746143127.921459:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3415 00000100:00100000:1.0:1746143127.921463:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f35d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:27541:x1830962858568192:12345-192.168.201.28@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746143127.921503:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143127.921508:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 202 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.921517:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 202 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143127.921528:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00000100:00100000:1.0:1746143127.921532:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f35d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:27541:x1830962858568192:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 68us (547us total) trans 8589942317 rc 0/0 00010000:00010000:0.0:1746143127.921532:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.921537:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.921538:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3415 00000100:00100000:0.0:1746143127.921550:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1970:x1830962858567552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 392us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143127.921555:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6439 00000100:00100000:0.0:1746143127.921583:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143127.921601:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858568320 00000100:00100000:1.0:1746143127.921604:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858568320 00010000:00010000:1.0:1746143127.921615:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 202 pid: 14795 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143127.921628:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6442 00000100:00100000:1.0:1746143127.921633:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1968:x1830962858568320:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.921639:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.921643:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 202 pid: 14795 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143127.921649:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143127.921650:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 202 pid: 14795 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.921660:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00000100:00100000:0.0:1746143127.921660:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858568576 00000100:00100000:0.0:1746143127.921662:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858568576 00010000:00010000:1.0:1746143127.921664:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143127.921672:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 12 pid: 1037 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.921673:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.921687:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1968:x1830962858568320:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.921693:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6442 00000100:00100000:1.0:1746143127.921702:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6443 00000100:00100000:1.0:1746143127.921707:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858568576:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143127.921713:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143127.921717:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 12 pid: 1037 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.921724:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 12 pid: 1037 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143127.921733:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:1.0:1746143127.921736:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143127.921741:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143127.921752:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858568576:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 46us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143127.921757:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6443 00010000:00010000:2.0:1746143127.922599:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc8000/0x25aee876ca70c3b8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f865 expref: 11 pid: 1037 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.922617:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217152:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.922633:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48e7800/0x25aee876ca70c38e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f857 expref: 201 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.922641:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217280:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.922649:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217408:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143127.922656:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217536:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.922663:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70c0b6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f682 expref: 200 pid: 14795 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.922669:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217664:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.922677:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b200e00/0x25aee876ca70c0af lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f67b expref: 10 pid: 14796 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.922684:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217792:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.922694:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbddc00/0x25aee876ca70c0a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f674 expref: 9 pid: 1037 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143127.922700:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861217920:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143127.922741:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143127.927729:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143127.930290:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143127.930418:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858568832 00000100:00100000:3.0:1746143127.930429:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858568832 00010000:00010000:3.0:1746143127.930475:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 9 pid: 1037 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.930504:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858568704 00000100:00100000:3.0:1746143127.930506:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858568704 00010000:00010000:3.0:1746143127.930518:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 200 pid: 17079 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143127.930537:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6444 00000100:00100000:3.0:1746143127.930545:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858568832:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143127.930560:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.930565:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 9 pid: 1037 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.930574:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 9 pid: 1037 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.930597:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b2735200/0x25aee876ca70c13b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f6e4 expref: 9 pid: 1037 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.930618:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143127.930623:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.930631:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.930671:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858568832:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 128us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.930677:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6444 00000100:00100000:3.0:1746143127.930717:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6445 00000100:00100000:3.0:1746143127.930721:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1970:x1830962858568704:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143127.930726:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143127.930730:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 200 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.930738:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 200 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.930749:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3d8800/0x25aee876ca70c196 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164f715 expref: 200 pid: 17079 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143127.930764:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143127.930767:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.932834:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.932846:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143127.932881:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143127.932915:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1970:x1830962858568704:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2189us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143127.932922:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6445 00010000:00010000:2.0:1746143127.932987:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143127.932997:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000040:00080000:2.0:1746143127.935872:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2333, 88 off198016 00000004:00080000:2.0:1746143127.935883:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909775851097ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.935934:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2356, 88 off199776 00000004:00080000:2.0:1746143127.935939:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909775907900ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143127.936799:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2357, 88 off199864 00000004:00080000:2.0:1746143127.937005:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909776973558ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143127.937016:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2334, 88 off198104 00000004:00080000:2.0:1746143127.937019:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909776987656ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.937292:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2335, 88 off198192 00000004:00080000:2.0:1746143127.937296:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909777264883ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.937304:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2358, 88 off199952 00000004:00080000:2.0:1746143127.937307:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909777275678ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143127.937325:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2359, 88 off200040 00000004:00080000:2.0:1746143127.937328:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909777296316ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143127.937335:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2360, 88 off200128 00000004:00080000:2.0:1746143127.937338:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909777306480ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143127.937345:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2336, 88 off198280 00000004:00080000:2.0:1746143127.937348:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909777316531ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.937355:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2361, 88 off200216 00000004:00080000:2.0:1746143127.937358:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909777326620ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143127.937364:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2337, 88 off198368 00000004:00080000:2.0:1746143127.937367:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909777335765ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.937374:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2362, 88 off200304 00000004:00080000:2.0:1746143127.937597:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909777565121ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143127.937606:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2338, 88 off198456 00000004:00080000:2.0:1746143127.937609:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909777577471ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.937615:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2339, 88 off198544 00000004:00080000:2.0:1746143127.937621:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909777589083ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.937627:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2340, 88 off198632 00000004:00080000:2.0:1746143127.937630:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909777598333ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.937636:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2341, 88 off198720 00000004:00080000:2.0:1746143127.937639:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909777607353ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143127.937645:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2363, 88 off200392 00000004:00080000:2.0:1746143127.937647:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909777616057ns, next at 860119223596ns, rc = 0 00000004:00010000:2.0:1746143128.008169:0:14794:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093b8a300 reply state ffff8801352e9000 transno 8589942318 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000001:00080000:0.0:1746143128.008210:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942317 is committed 00000001:00080000:0.0:1746143128.008222:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942316 is committed 00000001:00080000:0.0:1746143128.008232:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942318 is committed 00000004:00080000:0.0:1746143128.008236:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1781 committed 00000004:00080000:0.0:1746143128.008243:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1764 committed 00000100:00100000:2.0:1746143128.008375:0:14794:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746143128.008483:0:14794:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143128.008497:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30873:x1830962858567424:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 99387us (99802us total) trans 8589942318 rc 0/0 00000100:00100000:2.0:1746143128.008506:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8105 00000004:00080000:0.0:1746143128.009102:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1763 committed 00000004:00080000:0.0:1746143128.009105:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1762 committed 00000004:00080000:0.0:1746143128.009106:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1761 committed 00000004:00080000:0.0:1746143128.009108:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1780 committed 00000004:00080000:0.0:1746143128.009110:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1760 committed 00000004:00080000:0.0:1746143128.009112:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1779 committed 00000004:00080000:0.0:1746143128.009114:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1759 committed 00000004:00080000:0.0:1746143128.009115:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1778 committed 00000004:00080000:0.0:1746143128.009117:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1777 committed 00000004:00080000:0.0:1746143128.009119:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1776 committed 00000004:00080000:0.0:1746143128.009120:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1758 committed 00000004:00080000:0.0:1746143128.009122:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1757 committed 00000004:00080000:0.0:1746143128.009123:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1775 committed 00000004:00080000:0.0:1746143128.009125:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1774 committed 00000004:00080000:0.0:1746143128.009126:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1756 committed 00010000:00010000:0.0:1746143128.009151:0:3285:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143128.009160:0:3285:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143128.009166:0:3285:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143128.009171:0:3285:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a582b600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143128.009175:0:3285:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143128.009182:0:3285:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143128.009199:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143128.009202:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143128.009206:0:3285:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143128.009211:0:3285:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a582b600/0x25aee876ca70ca8e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143128.010605:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861218304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143128.010689:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143128.010783:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143128.010790:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861218432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.010836:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143128.011062:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861218304 00000100:00100000:0.0:1746143128.011070:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861218304 00000100:00100000:0.0:1746143128.011141:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861218432 00000100:00100000:0.0:1746143128.011144:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861218432 00000100:00100000:0.0:1746143128.011184:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12156 00000100:00100000:0.0:1746143128.011191:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861218304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143128.011996:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3299:x1830962861218304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 805us (1315us total) trans 17179872714 rc 0/0 00000100:00100000:0.0:1746143128.012020:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12156 00000100:00100000:0.0:1746143128.012118:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12157 00000100:00100000:0.0:1746143128.012165:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861218432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.013290:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861218176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.013357:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.013399:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861218688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.013415:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.013426:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861219200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.013436:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.013450:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746143128.013454:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861218048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.013464:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.013471:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861218560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.013481:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.013488:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861219072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143128.013497:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861218176 00000100:00100000:1.0:1746143128.013497:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143128.013502:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861218176 00000100:00100000:1.0:1746143128.013519:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861218688 00000100:00100000:1.0:1746143128.013525:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861218688 00000100:00100000:2.0:1746143128.013526:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861219200 00000100:00100000:2.0:1746143128.013528:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861219200 00000100:00100000:2.0:1746143128.013548:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861218048 00000100:00100000:1.0:1746143128.013549:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861218560 00000100:00100000:1.0:1746143128.013551:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861218560 00000100:00100000:2.0:1746143128.013557:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861218048 00000100:00100000:1.0:1746143128.013557:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861219072 00000100:00100000:1.0:1746143128.013558:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861219072 00000100:00100000:2.0:1746143128.013570:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12158 00000100:00100000:2.0:1746143128.013579:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3302:x1830962861218176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.013773:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12159 00000100:00100000:1.0:1746143128.013781:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1830962861218688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143128.013817:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3302:x1830962861218176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (460us total) trans 17179872715 rc 0/0 00000100:00100000:2.0:1746143128.013824:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12158 00000100:00100000:2.0:1746143128.013848:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12160 00000100:00100000:2.0:1746143128.013853:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3302:x1830962861219200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.013975:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1830962861218688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (558us total) trans 21474839970 rc 0/0 00000100:00100000:1.0:1746143128.013981:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12159 00000100:00100000:1.0:1746143128.013994:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12161 00000100:00100000:1.0:1746143128.013999:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1830962861218560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143128.014012:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3302:x1830962861219200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (573us total) trans 17179872716 rc 0/0 00000100:00100000:2.0:1746143128.014018:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12160 00000100:00100000:2.0:1746143128.014081:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12162 00000100:00100000:2.0:1746143128.014086:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3302:x1830962861218048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.014102:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1830962861218560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (618us total) trans 21474839971 rc 0/0 00000100:00100000:1.0:1746143128.014107:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12161 00000100:00100000:1.0:1746143128.014117:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12163 00000100:00100000:1.0:1746143128.014121:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3302:x1830962861219072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.014346:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861219584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.014633:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.014663:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143128.014670:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861219712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.014694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143128.014695:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3302:x1830962861218048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 596us (1217us total) trans 17179872717 rc 0/0 00000100:00100000:2.0:1746143128.014701:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12162 00000100:00100000:2.0:1746143128.014711:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861219584 00000100:00100000:3.0:1746143128.014718:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861219712 00000100:00100000:3.0:1746143128.014723:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861219712 00000100:00100000:2.0:1746143128.014724:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861219584 00000100:00100000:3.0:1746143128.014743:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12164 00000100:00100000:3.0:1746143128.014747:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861219712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.015117:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3301:x1830962861219712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 368us (421us total) trans 21474839972 rc 0/0 00000100:00100000:3.0:1746143128.015122:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12164 00000100:00100000:3.0:1746143128.015132:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12165 00000100:00100000:3.0:1746143128.015137:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861219584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.015217:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3301:x1830962861219584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (825us total) trans 21474839973 rc 0/0 00000100:00100000:3.0:1746143128.015222:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12165 00000004:00080000:2.0:1746143128.015628:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aece00/2, rc 0, transno 17179872717 00000100:00100000:2.0:1746143128.015634:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861218048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143128.015659:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a70b800/2, rc 0, transno 21474839971 00000100:00100000:2.0:1746143128.015666:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a70b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861218560:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143128.015773:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8aa00/2, rc 0, transno 21474839972 00000100:00100000:3.0:1746143128.015778:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861219712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143128.015785:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a709c00/2, rc 0, transno 21474839973 00000100:00100000:3.0:1746143128.015788:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861219584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143128.019019:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aefb80/2, rc 0, transno 17179872715 00000100:00100000:2.0:1746143128.019064:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861218176:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143128.019081:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a709f80/2, rc 0, transno 21474839970 00000100:00100000:2.0:1746143128.019085:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861218688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143128.019106:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aed880/2, rc 0, transno 17179872716 00000100:00100000:2.0:1746143128.019109:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861219200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.020469:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861218944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.020526:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.021000:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861218944 00000100:00100000:3.0:1746143128.021010:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861218944 00000100:00100000:3.0:1746143128.021110:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12166 00000100:00100000:3.0:1746143128.021131:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3300:x1830962861218944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.021697:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3300:x1830962861218944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 570us (1161us total) trans 17179872718 rc 0/0 00000100:00100000:3.0:1746143128.021704:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12166 00000100:00100000:3.0:1746143128.021901:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3299:x1830962861218432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 9736us (11063us total) trans 21474839974 rc 0/0 00000100:00100000:3.0:1746143128.021914:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12157 00000100:00100000:0.0:1746143128.023008:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861218816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.023131:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143128.023168:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861218816 00000100:00100000:0.0:1746143128.023172:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861218816 00000100:00100000:0.0:1746143128.023208:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12167 00000100:00100000:0.0:1746143128.023214:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3299:x1830962861218816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.023525:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3299:x1830962861218816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 311us (407us total) trans 21474839975 rc 0/0 00000100:00100000:0.0:1746143128.023531:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12167 00000004:00080000:1.0:1746143128.024408:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aef800/2, rc 0, transno 17179872718 00000100:00100000:1.0:1746143128.024419:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861218944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.024427:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861219456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.024468:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143128.025243:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3302:x1830962861219072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 11111us (11733us total) trans 17179872719 rc 0/0 00000100:00100000:2.0:1746143128.025252:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12163 00000100:00100000:3.0:1746143128.025738:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.025860:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861220096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143128.026098:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a709880/2, rc 0, transno 21474839975 00000100:00100000:0.0:1746143128.026117:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861218816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.026124:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861219328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.026353:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861219968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.026381:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143128.027496:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861219456 00000100:00100000:2.0:1746143128.027503:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861219456 00000100:00100000:2.0:1746143128.027587:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12168 00000100:00100000:2.0:1746143128.027595:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3300:x1830962861219456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143128.028189:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3300:x1830962861219456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 594us (3720us total) trans 17179872720 rc 0/0 00000100:00100000:2.0:1746143128.028195:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12168 00000100:00100000:2.0:1746143128.028358:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858568960 00000100:00100000:2.0:1746143128.028362:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858568960 00000100:00100000:2.0:1746143128.028419:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8106 00000100:00100000:2.0:1746143128.028425:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30873:x1830962858568960:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.028455:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.028482:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdc1 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.028572:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.028603:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.028621:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143128.028624:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143128.028628:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57f800, rc 0) 00000100:00100000:2.0:1746143128.028688:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858568960:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 263us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.028693:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8106 00000004:00080000:2.0:1746143128.028730:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aeea00/2, rc 0, transno 17179872719 00000100:00100000:2.0:1746143128.028735:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861219072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.029645:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1746143128.029663:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143128.029688:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861219840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.029728:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143128.029771:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a708a80/2, rc 0, transno 21474839974 00000100:00100000:1.0:1746143128.029776:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861218432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143128.029786:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aed500/2, rc 0, transno 17179872714 00000100:00100000:1.0:1746143128.029789:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861218304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.029790:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861220096 00000100:00100000:3.0:1746143128.029794:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861220096 00000100:00100000:1.0:1746143128.029815:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861219328 00000100:00100000:1.0:1746143128.029820:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861219328 00000100:00100000:3.0:1746143128.029824:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861219840 00000100:00100000:3.0:1746143128.029826:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861219840 00000100:00100000:1.0:1746143128.029849:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12169 00000100:00100000:1.0:1746143128.029856:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3301:x1830962861220096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.029862:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12170 00000100:00100000:3.0:1746143128.029868:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861219840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.030059:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861220096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (3677us total) trans 21474839976 rc 0/0 00000100:00100000:1.0:1746143128.030065:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12169 00000100:00100000:1.0:1746143128.030079:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12171 00000100:00100000:1.0:1746143128.030084:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861219328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.030190:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861219328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (549us total) trans 17179872721 rc 0/0 00000100:00100000:1.0:1746143128.030195:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12171 00000004:00080000:1.0:1746143128.030219:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aedc00/2, rc 0, transno 17179872721 00000100:00100000:1.0:1746143128.030222:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861219328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.030234:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143128.030256:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aef100/2, rc 0, transno 17179872720 00000100:00100000:1.0:1746143128.030259:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861219456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.030268:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861219968 00000100:00100000:1.0:1746143128.030271:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861219968 00000100:00100000:1.0:1746143128.030284:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12172 00000100:00100000:1.0:1746143128.030289:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3300:x1830962861219968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.030388:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3300:x1830962861219968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (152us total) trans 21474839977 rc 0/0 00000100:00100000:1.0:1746143128.030393:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12172 00000004:00080000:1.0:1746143128.030410:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8a680/2, rc 0, transno 21474839977 00000100:00100000:1.0:1746143128.030413:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861219968:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143128.030502:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143128.030513:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.030515:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.030517:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.030518:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143128.030615:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861219840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 746us (885us total) trans 21474839978 rc 0/0 00000100:00100000:3.0:1746143128.030633:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12170 00000004:00080000:3.0:1746143128.030688:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb23b80/2, rc 0, transno 21474839976 00000100:00100000:3.0:1746143128.030693:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861220096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143128.031152:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8b100/2, rc 0, transno 21474839978 00000100:00100000:1.0:1746143128.031157:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861219840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143128.032368:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.036359:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858569088 00000100:00100000:0.0:1746143128.036373:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858569088 00000100:00100000:0.0:1746143128.036620:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8107 00000100:00100000:0.0:1746143128.036630:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858569088:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143128.036650:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143128.036670:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdca00/0x25aee876ca70ca9c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdc8 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.036750:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdd600/0x25aee876ca70caa3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143128.036762:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdd600/0x25aee876ca70caa3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143128.036772:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdd600/0x25aee876ca70caa3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:0.0:1746143128.036798:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143128.036802:0:14795:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143128.036817:0:14795:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdd600/0x25aee876ca70caa3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143128.036836:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdca00/0x25aee876ca70ca9c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc8 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.036855:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdd600/0x25aee876ca70caa3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc8 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.036862:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:0.0:1746143128.036864:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143128.036867:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbdd600, rc 0) 00000100:00100000:0.0:1746143128.036919:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858569088:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 291us (4555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143128.036926:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8107 00000100:00100000:0.0:1746143128.042937:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.042984:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.043007:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.043022:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.043073:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.043135:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858569216 00000100:00100000:1.0:1746143128.043146:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858569216 00000100:00100000:0.0:1746143128.043159:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.043204:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858569472 00000100:00100000:1.0:1746143128.043208:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858569472 00000100:00100000:1.0:1746143128.043220:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858569344 00000100:00100000:1.0:1746143128.043222:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858569344 00000100:00100000:1.0:1746143128.043232:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858569600 00000100:00100000:1.0:1746143128.043235:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858569600 00000100:00100000:1.0:1746143128.043250:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858569728 00000100:00100000:1.0:1746143128.043253:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858569728 00000100:00100000:3.0:1746143128.043257:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858569856 00000100:00100000:3.0:1746143128.043265:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858569856 00000100:00100000:1.0:1746143128.043271:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12173 00000100:00100000:1.0:1746143128.043278:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858569216:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143128.043293:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143128.043298:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12174 00000100:00100000:3.0:1746143128.043305:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858569472:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143128.043323:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdcf expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.043333:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746143128.043345:0:10061:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x68140795, atime: 0x68140795, ctime: 0x68140795, blocks: 0x7cd 00010000:00010000:3.0:1746143128.043352:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fddd expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.043362:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.043364:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.043372:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 8 pid: 10061 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143128.043373:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x68140796, atime: 0x68140793, ctime: 0x68140796, blocks: 0x821 00010000:00010000:1.0:1746143128.043388:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 8 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.043390:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.043392:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.043398:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca0000, rc 0) 00010000:00010000:3.0:1746143128.043399:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.043412:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.043422:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efa3400, rc 0) 00000100:00100000:1.0:1746143128.043449:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858569216:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 170us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.043456:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858569472:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 151us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.043456:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12173 00000100:00100000:3.0:1746143128.043462:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12174 00000100:00100000:1.0:1746143128.043473:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12175 00000100:00100000:1.0:1746143128.043478:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858569344:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:3.0:1746143128.043479:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12176 00000100:00100000:3.0:1746143128.043484:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858569600:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143128.043485:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.043492:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.043494:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdd6 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.043501:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fde4 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143128.043511:0:10061:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x68140796, atime: 0x68140795, ctime: 0x68140796, blocks: 0x821 00002000:00010000:3.0:1746143128.043514:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x68140795, atime: 0x68140795, ctime: 0x68140795, blocks: 0x81f 00010000:00010000:1.0:1746143128.043520:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.043521:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.043524:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.043525:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.043525:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 8 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.043530:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.043533:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 8 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.043539:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca0200, rc 0) 00010000:00010000:3.0:1746143128.043540:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.043547:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efa3600, rc 0) 00000100:00100000:1.0:1746143128.043555:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858569344:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 78us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.043560:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12175 00000100:00100000:3.0:1746143128.043565:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858569600:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 81us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.043571:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12176 00000100:00100000:1.0:1746143128.043576:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12177 00000100:00100000:1.0:1746143128.043580:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858569728:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:3.0:1746143128.043585:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12178 00010000:00010000:1.0:1746143128.043586:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143128.043589:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858569856:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143128.043593:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdeb expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.043595:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746143128.043602:0:10061:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x68140795, atime: 0x68140795, ctime: 0x68140795, blocks: 0x180b 00010000:00010000:3.0:1746143128.043603:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdf2 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.043609:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746143128.043613:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x68140796, atime: 0x68140795, ctime: 0x68140796, blocks: 0x1029 00010000:00010000:3.0:1746143128.043620:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.043621:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.043625:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.043634:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.043640:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efa3000, rc 0) 00000100:00100000:3.0:1746143128.043653:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858569856:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 63us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.043658:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12178 00010000:00010000:1.0:1746143128.048088:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.048103:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 8 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.048129:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 8 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.048142:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca0400, rc 0) 00000100:00100000:1.0:1746143128.048211:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858569728:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4628us (5136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.048219:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12177 00000100:00080000:1.0:1746143128.048257:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143128.048262:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143128.066526:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.066665:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858570112 00000100:00100000:2.0:1746143128.066679:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858570112 00000100:00100000:2.0:1746143128.067570:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5917 00000100:00100000:2.0:1746143128.067582:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858570112:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:2.0:1746143128.067625:0:21521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.067640:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.067642:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.067648:0:21521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.067662:0:21521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.091236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.091350:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.091412:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858570368 00000100:00100000:3.0:1746143128.091421:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858570368 00000100:00100000:0.0:1746143128.091469:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858570624 00000100:00100000:3.0:1746143128.091476:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5918 00000100:00100000:0.0:1746143128.091480:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858570624 00000100:00100000:3.0:1746143128.091483:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858570368:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:3.0:1746143128.091514:0:31432:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.091526:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.091528:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.091533:0:31432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.091540:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5919 00010000:00010000:3.0:1746143128.091545:0:31432:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.091548:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858570624:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143128.091579:0:8454:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.091593:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.091594:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.091599:0:8454:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.091611:0:8454:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.094613:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.094646:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.094943:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858571008 00000100:00100000:1.0:1746143128.094952:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858571008 00000100:00100000:1.0:1746143128.094997:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858570880 00000100:00100000:1.0:1746143128.095000:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858570880 00000100:00100000:1.0:1746143128.095158:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5920 00000100:00100000:1.0:1746143128.095167:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1970:x1830962858571008:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:1.0:1746143128.095195:0:31431:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.095207:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.095208:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.095212:0:31431:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.095224:0:31431:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.095969:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5921 00000100:00100000:2.0:1746143128.095978:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1970:x1830962858570880:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:2.0:1746143128.095995:0:31806:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.096002:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.096004:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.096007:0:31806:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.096015:0:31806:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.109343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.109615:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.109638:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.109675:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858571392 00000100:00100000:3.0:1746143128.109684:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858571392 00000100:00100000:3.0:1746143128.109723:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858571648 00000100:00100000:3.0:1746143128.109725:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858571648 00000100:00100000:3.0:1746143128.109734:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858571904 00000100:00100000:3.0:1746143128.109735:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858571904 00000100:00100000:2.0:1746143128.109747:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5922 00000100:00100000:3.0:1746143128.109753:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5923 00000100:00100000:3.0:1746143128.109758:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1970:x1830962858571648:12345-192.168.201.28@tcp:3:lfs.0 00000100:00100000:2.0:1746143128.109759:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858571392:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:3.0:1746143128.109783:0:21522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.109784:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.109792:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.109792:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.109793:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.109794:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.109797:0:21522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.109797:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.109805:0:21522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.109806:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.111079:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5924 00000100:00100000:0.0:1746143128.111087:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1971:x1830962858571904:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143128.111105:0:31430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.111113:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.111115:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.111118:0:31430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.111126:0:31430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.112997:0:21521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.113009:0:21521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.113016:0:21521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.113021:0:21521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e57f400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143128.113025:0:21521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.113051:0:21521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.113071:0:21521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.113077:0:21521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e57f400/0x25aee876ca70cad4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.113125:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858570112:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 45545us (46607us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143128.113133:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5917 00010000:00010000:3.0:1746143128.128829:0:31432:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.128846:0:31432:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.128855:0:31432:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.128861:0:31432:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a317200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143128.128865:0:31432:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.128878:0:31432:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.128895:0:31432:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.128902:0:31432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a317200/0x25aee876ca70cadb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.129996:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858570368:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 38508us (38761us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143128.130007:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5918 00010000:00010000:3.0:1746143128.136663:0:31806:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.136678:0:31806:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.136684:0:31806:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.136690:0:31806:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e57e400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143128.136693:0:31806:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.136700:0:31806:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.136718:0:31806:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.136724:0:31806:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70caf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.136816:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1970:x1830962858570880:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 40835us (42163us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143128.136825:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5921 00010000:00010000:1.0:1746143128.152484:0:31431:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.152501:0:31431:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.152509:0:31431:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.152515:0:31431:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135ca0a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143128.152519:0:31431:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.152527:0:31431:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.152544:0:31431:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.152550:0:31431:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ca0a00/0x25aee876ca70cae9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.152636:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858571008:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 57465us (58023us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143128.152646:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5920 00010000:00010000:1.0:1746143128.158659:0:8454:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.158675:0:8454:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.158683:0:8454:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.158689:0:8454:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79a200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143128.158693:0:8454:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.158700:0:8454:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.158716:0:8454:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.158722:0:8454:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70cae2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.161236:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858570624:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 69678us (69875us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143128.161247:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5919 00010000:00010000:1.0:1746143128.162943:0:31430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.162957:0:31430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.162965:0:31430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.162972:0:31430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79b600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143128.162976:0:31430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.162983:0:31430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.162999:0:31430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.163005:0:31430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79b600/0x25aee876ca70cb05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.165097:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858571904:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 54000us (55447us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143128.165109:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5924 00010000:00010000:3.0:1746143128.176693:0:21522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.176708:0:21522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.176716:0:21522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.176723:0:21522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e7d6800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143128.176726:0:21522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.176733:0:21522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.176751:0:21522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.176787:0:21522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6800/0x25aee876ca70caf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.177661:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858571648:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 67898us (68040us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143128.177670:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5923 00010000:00010000:2.0:1746143128.177976:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.177985:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.177991:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.177996:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b713c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143128.177999:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.178005:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.178016:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.178021:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b713c00/0x25aee876ca70cafe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.178082:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858571392:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 68327us (70053us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143128.178089:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5922 00000100:00100000:0.0:1746143128.187805:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.188009:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858572160 00000100:00100000:2.0:1746143128.188018:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858572160 00000100:00100000:2.0:1746143128.188345:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8108 00000100:00100000:2.0:1746143128.188353:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858572160:12345-192.168.201.28@tcp:36:lfs.0 00010000:00010000:2.0:1746143128.188534:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143128.188560:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbdd600/0x25aee876ca70caa3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc8 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.188964:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143128.188969:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143128.188999:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143128.189010:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143128.189018:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00010000:2.0:1746143128.189272:0:14794:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008eb75180 reply state ffff880092ad4000 transno 8589942319 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:2.0:1746143128.189278:0:14794:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143128.189573:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30873:x1830962858572160:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 1219us (1775us total) trans 8589942319 rc 0/0 00000100:00100000:2.0:1746143128.189579:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8108 00010000:00010000:2.0:1746143128.198105:0:3285:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143128.198121:0:3285:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143128.198128:0:3285:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143128.198133:0:3285:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b712c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143128.198139:0:3285:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143128.198145:0:3285:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143128.198158:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143128.198162:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143128.198166:0:3285:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143128.198171:0:3285:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b712c00/0x25aee876ca70cb0c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143128.200256:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.200357:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858572288 00000100:00100000:1.0:1746143128.200365:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858572288 00000100:00100000:1.0:1746143128.200869:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12179 00000100:00100000:1.0:1746143128.200877:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858572288:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143128.200894:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.200908:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fdf9 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.200938:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.200945:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.200947:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.200950:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.200978:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.200989:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143128.201001:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861220224:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.201117:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143128.207447:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861220224:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.207476:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.207492:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca1800, rc 0) 00000100:00100000:1.0:1746143128.207544:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858572288:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 6666us (7293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.207552:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12179 00000100:00100000:0.0:1746143128.208912:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.209243:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858572416 00000100:00100000:3.0:1746143128.209250:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858572416 00010000:00010000:3.0:1746143128.209280:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143128.209658:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6446 00000100:00100000:3.0:1746143128.209667:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858572416:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.209678:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.209699:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.209710:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.209729:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ca0000/0x25aee876ca70caaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdcf expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.209885:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.209887:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.209895:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.209903:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.209930:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.209942:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861220352:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143128.210007:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.213666:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.213903:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861220352:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143128.213924:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143128.213965:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858572416:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4298us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.213975:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6446 00000100:00100000:1.0:1746143128.215272:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858572544 00000100:00100000:1.0:1746143128.215280:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858572544 00000100:00100000:1.0:1746143128.215762:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12180 00000100:00100000:1.0:1746143128.215771:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858572544:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143128.215789:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.215803:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe00 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.215828:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.215834:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.215836:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.215839:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.215867:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.215877:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143128.215888:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861220480:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.216253:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b428900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.221011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.221369:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858572672 00000100:00100000:3.0:1746143128.221377:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858572672 00010000:00010000:3.0:1746143128.221408:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 10 pid: 10061 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143128.221951:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861220480:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.221974:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.221991:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca0600, rc 0) 00000100:00100000:3.0:1746143128.223118:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6447 00000100:00100000:3.0:1746143128.223127:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858572672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.223138:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.223155:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 10 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.223171:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 10 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.223189:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ca0200/0x25aee876ca70cab8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdd6 expref: 10 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.223205:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.223207:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.223212:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.223219:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.223242:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.223251:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861220608:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143128.225358:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858572544:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 9581us (11690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.225368:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12180 00000100:00100000:3.0:1746143128.226185:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.228764:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861220608:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143128.228785:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143128.228857:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858572672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5730us (7864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.228867:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6447 00000100:00100000:0.0:1746143128.228920:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.229015:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858572800 00000100:00100000:2.0:1746143128.229021:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858572800 00000100:00100000:2.0:1746143128.229078:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12181 00000100:00100000:2.0:1746143128.229085:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858572800:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.229102:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.229320:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe07 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.229349:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.229357:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.229359:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.229363:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.229399:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.229411:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143128.229423:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861220736:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.229585:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.230994:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861220736:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143128.231018:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.231054:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b712c00, rc 0) 00000100:00100000:2.0:1746143128.231097:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858572800:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 2011us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.231103:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12181 00000100:00100000:0.0:1746143128.231926:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.232128:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858572928 00000100:00100000:3.0:1746143128.232135:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858572928 00010000:00010000:3.0:1746143128.232160:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143128.232269:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6448 00000100:00100000:3.0:1746143128.232278:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858572928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.232288:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.232319:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.232330:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.232349:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efa3400/0x25aee876ca70cab1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fddd expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.232587:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.232589:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.232595:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.232603:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.232630:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.232642:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861220864:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143128.233301:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.236106:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.236288:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861220864:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143128.236303:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143128.236347:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858572928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4071us (4422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.236525:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6448 00000100:00100000:2.0:1746143128.236666:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858573056 00000100:00100000:2.0:1746143128.236672:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858573056 00000100:00100000:2.0:1746143128.236714:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12182 00000100:00100000:2.0:1746143128.236721:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858573056:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.236736:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.236751:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe0e expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.236979:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.236987:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.236988:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.236991:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.237019:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.237056:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143128.237068:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861220992:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.239159:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.240175:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861220992:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143128.240199:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.240214:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093797c00, rc 0) 00000100:00100000:2.0:1746143128.240247:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858573056:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 3526us (4145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.240254:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12182 00000100:00100000:0.0:1746143128.241415:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.241495:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858573184 00000100:00100000:3.0:1746143128.241501:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858573184 00010000:00010000:3.0:1746143128.241524:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143128.241544:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6449 00000100:00100000:3.0:1746143128.241551:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858573184:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.241562:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.241580:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.241590:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.241609:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3600/0x25aee876ca70cabf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fde4 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.241623:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.241625:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.241630:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.241643:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.241671:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.241683:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861221120:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143128.243052:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.245220:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861221120:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143128.245238:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143128.245627:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858573184:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4073us (4210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.245637:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6449 00000100:00100000:1.0:1746143128.246403:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.246459:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858573312 00000100:00100000:2.0:1746143128.246466:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858573312 00000100:00100000:2.0:1746143128.246520:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12183 00000100:00100000:2.0:1746143128.246527:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858573312:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.246542:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.246558:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe15 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.246583:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.246589:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.246591:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.246594:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.246621:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.246632:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143128.246643:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861221248:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.246710:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.249170:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.249257:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858573440 00000100:00100000:3.0:1746143128.249263:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858573440 00000100:00100000:2.0:1746143128.249281:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861221248:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143128.249287:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 10 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143128.249302:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.249320:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6450 00000100:00100000:3.0:1746143128.249533:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858573440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143128.249537:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fce400, rc 0) 00010000:00010000:3.0:1746143128.249543:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.249561:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 10 pid: 10061 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143128.249580:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30873:x1830962858573312:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 3053us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.249587:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12183 00010000:00010000:3.0:1746143128.250718:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.250738:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ca0400/0x25aee876ca70cac6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdeb expref: 9 pid: 10061 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.250753:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.250754:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.250759:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.250766:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.250790:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.250798:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861221376:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143128.251657:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.254271:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.254352:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858573568 00000100:00100000:2.0:1746143128.254360:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858573568 00000100:00100000:2.0:1746143128.254399:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12184 00000100:00100000:2.0:1746143128.254406:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858573568:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.254420:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.254637:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe1c expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.254659:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.254665:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.254667:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.254670:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.254692:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.254702:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143128.254717:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861221504:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.254788:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.254868:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861221376:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143128.254883:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143128.255119:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858573440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5792us (5953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.255128:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6450 00000100:00100000:2.0:1746143128.258598:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861221504:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143128.258611:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143128.258637:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.258654:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fcea00, rc 0) 00000100:00100000:2.0:1746143128.258690:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858573568:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4284us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.258698:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12184 00000100:00100000:3.0:1746143128.258783:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858573696 00000100:00100000:3.0:1746143128.258790:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858573696 00010000:00010000:3.0:1746143128.259232:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143128.259263:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6451 00000100:00100000:3.0:1746143128.259271:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858573696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.259281:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.259300:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.259324:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.259344:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efa3000/0x25aee876ca70cacd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf2 expref: 9 pid: 21048 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143128.259366:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.259368:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.259373:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.259381:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.259545:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.259557:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861221632:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143128.259785:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.261232:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861221632:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143128.261243:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143128.261262:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858573696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1993us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.261270:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6451 00000100:00100000:0.0:1746143128.262349:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.262387:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.262415:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.262634:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.262648:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.262663:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858573824 00000100:00100000:0.0:1746143128.262668:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858573824 00000100:00100000:2.0:1746143128.263226:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858574080 00000100:00100000:0.0:1746143128.263227:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858574336 00000100:00100000:2.0:1746143128.263230:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858574080 00000100:00100000:0.0:1746143128.263230:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858574336 00000100:00100000:0.0:1746143128.263249:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858573952 00000100:00100000:0.0:1746143128.263251:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858573952 00000100:00100000:2.0:1746143128.263259:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858574208 00000100:00100000:2.0:1746143128.263260:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858574208 00000100:00100000:0.0:1746143128.263406:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12185 00000100:00100000:0.0:1746143128.263414:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858573824:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:0.0:1746143128.263585:0:8169:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143128.263589:0:8169:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143125 -> 1746143126 00002000:00010000:0.0:1746143128.263591:0:8169:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143125 -> 1746143126 00002000:00010000:0.0:1746143128.263593:0:8169:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143125 -> 1746143127 00002000:00010000:0.0:1746143128.263594:0:8169:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1997 -> 1997 00000100:00100000:0.0:1746143128.263624:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858573824:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 211us (1277us total) trans 21474839979 rc 0/0 00000100:00100000:0.0:1746143128.263630:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12185 00000100:00100000:0.0:1746143128.263736:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12186 00000100:00100000:0.0:1746143128.263741:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858574336:12345-192.168.201.28@tcp:2:lfs.0 00000100:00100000:1.0:1746143128.264256:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12187 00000100:00100000:1.0:1746143128.264265:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858574080:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:1.0:1746143128.264551:0:4756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143128.264554:0:4756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143128.264556:0:4756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143123 -> 1746143126 00002000:00010000:1.0:1746143128.264558:0:4756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143126 -> 1746143127 00002000:00010000:1.0:1746143128.264560:0:4756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143128.264581:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858574080:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 317us (2193us total) trans 17179872722 rc 0/0 00000100:00100000:1.0:1746143128.264586:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12187 00000100:00100000:1.0:1746143128.264604:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12188 00000100:00100000:1.0:1746143128.264609:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858573952:12345-192.168.201.28@tcp:2:lfs.0 00000100:00100000:2.0:1746143128.264670:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12189 00002000:00010000:1.0:1746143128.264671:0:4756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143128.264674:0:4756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143128.264675:0:4756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143125 -> 1746143126 00000100:00100000:2.0:1746143128.264677:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858574208:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:1.0:1746143128.264684:0:4756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143126 -> 1746143127 00002000:00010000:1.0:1746143128.264688:0:4756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143128.264707:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858573952:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 98us (2072us total) trans 17179872723 rc 0/0 00000100:00100000:1.0:1746143128.264715:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12188 00002000:00010000:2.0:1746143128.264753:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143128.264756:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143125 -> 1746143126 00002000:00010000:2.0:1746143128.264758:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143125 -> 1746143126 00002000:00010000:2.0:1746143128.264760:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143125 -> 1746143127 00002000:00010000:2.0:1746143128.264762:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143128.264781:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858574208:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 104us (2130us total) trans 21474839980 rc 0/0 00000100:00100000:2.0:1746143128.264786:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12189 00002000:00010000:0.0:1746143128.264874:0:8169:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:0.0:1746143128.264877:0:8169:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143125 -> 1746143126 00002000:00010000:0.0:1746143128.264878:0:8169:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143125 -> 1746143126 00002000:00010000:0.0:1746143128.264880:0:8169:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143125 -> 1746143127 00002000:00010000:0.0:1746143128.264881:0:8169:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:0.0:1746143128.264899:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858574336:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 1158us (2483us total) trans 21474839981 rc 0/0 00000100:00100000:0.0:1746143128.264903:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12186 00000100:00100000:0.0:1746143128.264955:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.265496:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858574464 00000100:00100000:2.0:1746143128.265502:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858574464 00000100:00100000:2.0:1746143128.265535:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12190 00000100:00100000:2.0:1746143128.265540:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858574464:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:2.0:1746143128.265620:0:8169:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143128.265623:0:8169:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:2.0:1746143128.265624:0:8169:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143125 -> 1746143126 00002000:00010000:2.0:1746143128.265626:0:8169:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143126 -> 1746143127 00002000:00010000:2.0:1746143128.265628:0:8169:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746143128.265648:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858574464:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 107us (692us total) trans 17179872724 rc 0/0 00000100:00100000:2.0:1746143128.265654:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12190 00000100:00100000:0.0:1746143128.267431:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.267538:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858574720 00000100:00100000:2.0:1746143128.267544:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858574720 00000100:00100000:2.0:1746143128.267569:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3416 00000100:00100000:2.0:1746143128.267573:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858574720:12345-192.168.201.28@tcp:35:lfs.0 00000004:00010000:2.0:1746143128.267615:0:14797:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x27a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409800/0x25aee876ca70ca56 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdba expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.267648:0:14797:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.267658:0:14797:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.267664:0:14797:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.267693:0:14797:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.267702:0:14797:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 9 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.267714:0:14797:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14797:1830962861221760:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.268111:0:14797:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b986300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.270503:0:14797:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14797:1830962861221760:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143128.270524:0:14797:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 00000100:00100000:2.0:1746143128.271838:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.272331:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858574848 00000100:00100000:3.0:1746143128.272339:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858574848 00010000:00010000:3.0:1746143128.272367:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 10 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.272402:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6452 00000100:00100000:3.0:1746143128.272409:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858574848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.272420:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.272425:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 10 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.272435:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 10 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.272455:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70ca95 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdc1 expref: 10 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.272655:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:3.0:1746143128.272660:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 00010000:00010000:3.0:1746143128.272668:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14797 initiator: MDT0 00010000:00010000:3.0:1746143128.273154:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14797 initiator: MDT0 00010000:00010000:3.0:1746143128.273318:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143128.273347:0:14797:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.273354:0:14797:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 00000100:00100000:3.0:1746143128.273355:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858574848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 946us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.273361:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6452 00000040:00080000:2.0:1746143128.276781:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2342, 88 off198808 00000004:00080000:2.0:1746143128.276791:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910116758909ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.276849:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2364, 88 off200480 00000004:00080000:2.0:1746143128.276855:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910116822807ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.276879:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2365, 88 off200568 00000004:00080000:2.0:1746143128.276882:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910116850281ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.276889:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2343, 88 off198896 00000004:00080000:2.0:1746143128.276891:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910116859832ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.276898:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2344, 88 off198984 00000004:00080000:2.0:1746143128.276901:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910116869794ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.276907:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2366, 88 off200656 00000004:00080000:2.0:1746143128.276910:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910116878703ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.276916:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2367, 88 off200744 00000004:00080000:2.0:1746143128.276920:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910116888804ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.279249:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2368, 88 off200832 00000004:00080000:2.0:1746143128.279256:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910119223880ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.279275:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2345, 88 off199072 00000004:00080000:2.0:1746143128.279278:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910119246155ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.279297:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2369, 88 off200920 00000004:00080000:2.0:1746143128.279302:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910119270118ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.279318:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2346, 88 off199160 00000004:00080000:2.0:1746143128.279320:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910119289075ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.279329:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2370, 88 off201008 00000004:00080000:2.0:1746143128.279331:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910119299519ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.279337:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2347, 88 off199248 00000004:00080000:2.0:1746143128.279341:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910119309560ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.279348:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2348, 88 off199336 00000004:00080000:2.0:1746143128.279351:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910119319124ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.279357:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2349, 88 off199424 00000004:00080000:2.0:1746143128.279359:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910119327941ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.279366:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2350, 88 off199512 00000004:00080000:2.0:1746143128.279368:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910119336765ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.279375:0:14797:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2371, 88 off201096 00000004:00080000:2.0:1746143128.279377:0:14797:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910119345528ns, next at 860119223596ns, rc = 0 00000004:00010000:2.0:1746143128.322693:0:14797:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fb56d80 reply state ffff88012ff06800 transno 8589942320 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14797 initiator: MDT0 00000100:00100000:2.0:1746143128.322709:0:14797:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746143128.322718:0:14797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143128.322721:0:14797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143128.322728:0:14797:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409800/0x25aee876ca70ca56 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdba expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.322818:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30873:x1830962858574720:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 55243us (55392us total) trans 8589942320 rc 0/0 00000100:00100000:2.0:1746143128.322826:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3416 00000001:00080000:0.0:1746143128.322896:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942320 is committed 00000004:00080000:0.0:1746143128.322901:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1789 committed 00000004:00080000:0.0:1746143128.322906:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1773 committed 00000004:00080000:0.0:1746143128.322917:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1772 committed 00000004:00080000:0.0:1746143128.322919:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1771 committed 00000004:00080000:0.0:1746143128.322921:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1770 committed 00000004:00080000:0.0:1746143128.322922:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1788 committed 00000004:00080000:0.0:1746143128.322924:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1769 committed 00000004:00080000:0.0:1746143128.322925:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1787 committed 00000004:00080000:0.0:1746143128.322927:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1768 committed 00000004:00080000:0.0:1746143128.322928:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1786 committed 00000004:00080000:0.0:1746143128.322930:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1785 committed 00000004:00080000:0.0:1746143128.322931:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1784 committed 00000004:00080000:0.0:1746143128.322932:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1767 committed 00000004:00080000:0.0:1746143128.322933:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1766 committed 00000004:00080000:0.0:1746143128.322935:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1783 committed 00000004:00080000:0.0:1746143128.322936:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1782 committed 00000004:00080000:0.0:1746143128.322937:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1765 committed 00000100:00100000:3.0:1746143128.323164:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861222272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.323203:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.323236:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861222784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.323246:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.323253:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861223296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.323265:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.323272:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861223808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.323283:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.323295:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746143128.323299:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861221888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.323323:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.323334:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861222400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.323678:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861222016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.323698:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.323712:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861222528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.323722:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.323731:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861223040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.323741:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.323752:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861223552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.323762:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.323774:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746143128.323778:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861222144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.323792:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.323802:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861222656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.323823:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.323839:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861223168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.323853:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.323863:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861223680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.323876:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.323896:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861222272 00000100:00100000:1.0:1746143128.323902:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861222272 00000100:00100000:1.0:1746143128.323923:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861222784 00000100:00100000:1.0:1746143128.323925:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861222784 00000100:00100000:1.0:1746143128.323931:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861223296 00000100:00100000:1.0:1746143128.323933:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861223296 00000100:00100000:1.0:1746143128.323939:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861223808 00000100:00100000:1.0:1746143128.323941:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861223808 00000100:00100000:1.0:1746143128.323946:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861221888 00000100:00100000:1.0:1746143128.323948:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861221888 00000100:00100000:1.0:1746143128.323953:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861222016 00000100:00100000:1.0:1746143128.323954:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861222016 00000100:00100000:1.0:1746143128.323959:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861222528 00000100:00100000:1.0:1746143128.323961:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861222528 00000100:00100000:1.0:1746143128.323965:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861223040 00000100:00100000:1.0:1746143128.323966:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861223040 00000100:00100000:1.0:1746143128.323972:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861223552 00000100:00100000:1.0:1746143128.323973:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861223552 00000100:00100000:1.0:1746143128.323978:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861222144 00000100:00100000:1.0:1746143128.323979:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861222144 00000100:00100000:1.0:1746143128.323984:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861222656 00000100:00100000:1.0:1746143128.323985:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861222656 00000100:00100000:1.0:1746143128.323991:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861223168 00000100:00100000:1.0:1746143128.323992:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861223168 00000100:00100000:1.0:1746143128.323999:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861223680 00000100:00100000:1.0:1746143128.324000:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861223680 00000100:00100000:1.0:1746143128.324009:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12191 00000100:00100000:1.0:1746143128.324014:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861222272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.324201:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3301:x1830962861222272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (996us total) trans 17179872725 rc 0/0 00000100:00100000:1.0:1746143128.324207:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12191 00000100:00100000:1.0:1746143128.324218:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12192 00000100:00100000:1.0:1746143128.324222:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861222784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.324316:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3301:x1830962861222784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1055us total) trans 17179872726 rc 0/0 00000100:00100000:1.0:1746143128.324321:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12192 00000100:00100000:1.0:1746143128.324336:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12193 00000100:00100000:1.0:1746143128.324340:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861223296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.324438:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3301:x1830962861223296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (1171us total) trans 21474839982 rc 0/0 00000100:00100000:1.0:1746143128.324443:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12193 00000100:00100000:1.0:1746143128.324453:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12194 00000100:00100000:1.0:1746143128.324457:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861223808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.324537:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3301:x1830962861223808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1251us total) trans 21474839983 rc 0/0 00000100:00100000:1.0:1746143128.324542:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12194 00000100:00100000:1.0:1746143128.324551:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12195 00000100:00100000:1.0:1746143128.324554:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861221888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.324667:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.324680:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861222912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.324696:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.324702:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861223424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.324711:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143128.324734:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ad59880/2, rc 0, transno 17179872725 00000100:00100000:3.0:1746143128.324739:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861222272:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143128.324746:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b89c00/2, rc 0, transno 17179872726 00000100:00100000:3.0:1746143128.324748:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861222784:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143128.324754:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb74000/2, rc 0, transno 21474839982 00000100:00100000:3.0:1746143128.324762:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861223296:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143128.324767:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe78e00/2, rc 0, transno 21474839983 00000100:00100000:3.0:1746143128.324770:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861223808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.324787:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861222400 00000100:00100000:3.0:1746143128.324790:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861222400 00000100:00100000:3.0:1746143128.325047:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861222912 00000100:00100000:3.0:1746143128.325050:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861222912 00000100:00100000:3.0:1746143128.325058:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861223424 00000100:00100000:3.0:1746143128.325060:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861223424 00000100:00100000:3.0:1746143128.325068:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12196 00000100:00100000:3.0:1746143128.325072:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861222016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143128.325151:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143128.325154:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.325156:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.325158:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.325159:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143128.325184:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861222016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (1484us total) trans 17179872728 rc 0/0 00000100:00100000:3.0:1746143128.325189:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12196 00000100:00100000:3.0:1746143128.325199:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12197 00000100:00100000:3.0:1746143128.325204:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861222528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.325279:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861222528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1554us total) trans 17179872729 rc 0/0 00000100:00100000:3.0:1746143128.325283:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12197 00000100:00100000:3.0:1746143128.325294:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12198 00000100:00100000:3.0:1746143128.325298:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861223040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143128.325379:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143128.325382:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.325383:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.325385:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.325387:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143128.325405:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861223040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (1662us total) trans 21474839984 rc 0/0 00000100:00100000:3.0:1746143128.325410:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12198 00000100:00100000:3.0:1746143128.325420:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12199 00000100:00100000:3.0:1746143128.325424:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861223552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.325494:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861223552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1730us total) trans 21474839985 rc 0/0 00000100:00100000:3.0:1746143128.325498:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12199 00000100:00100000:3.0:1746143128.325507:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12200 00000100:00100000:3.0:1746143128.325511:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861222144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143128.325580:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143128.325582:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.325584:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.325586:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.325588:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143128.325605:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861222144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1811us total) trans 17179872730 rc 0/0 00000100:00100000:3.0:1746143128.325610:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12200 00000100:00100000:3.0:1746143128.325619:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12201 00000100:00100000:3.0:1746143128.325623:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861222656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.325694:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861222656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1870us total) trans 17179872731 rc 0/0 00000100:00100000:3.0:1746143128.325699:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12201 00000100:00100000:3.0:1746143128.325712:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12202 00000100:00100000:3.0:1746143128.325716:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861223168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143128.325780:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:3.0:1746143128.325783:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.325784:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.325786:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.325788:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:3.0:1746143128.325807:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861223168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (1952us total) trans 21474839986 rc 0/0 00000100:00100000:3.0:1746143128.325811:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12202 00000100:00100000:3.0:1746143128.325821:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12203 00000100:00100000:3.0:1746143128.325825:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861223680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143128.325913:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143128.325915:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.325917:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.325918:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.325920:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143128.325939:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861223680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (2062us total) trans 21474839987 rc 0/0 00000100:00100000:3.0:1746143128.325944:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12203 00000100:00100000:3.0:1746143128.325954:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12204 00000100:00100000:3.0:1746143128.325958:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861222400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.326055:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861222400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1387us total) trans 17179872732 rc 0/0 00000100:00100000:3.0:1746143128.326060:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12204 00000100:00100000:3.0:1746143128.326070:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12205 00000100:00100000:3.0:1746143128.326075:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861222912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143128.326140:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143128.326143:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.326144:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.326146:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.326148:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1997 -> 1997 00000100:00100000:3.0:1746143128.326166:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861222912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (1469us total) trans 21474839988 rc 0/0 00000100:00100000:3.0:1746143128.326171:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12205 00000100:00100000:3.0:1746143128.326180:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12206 00000100:00100000:3.0:1746143128.326184:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861223424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.326255:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861223424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1542us total) trans 21474839989 rc 0/0 00000100:00100000:3.0:1746143128.326260:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12206 00000004:00080000:3.0:1746143128.326354:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b89f80/2, rc 0, transno 17179872732 00000100:00100000:3.0:1746143128.326359:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861222400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143128.326367:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb23480/2, rc 0, transno 21474839988 00000100:00100000:3.0:1746143128.326370:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861222912:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143128.326375:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb74700/2, rc 0, transno 21474839989 00000100:00100000:3.0:1746143128.326378:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861223424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.326381:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143128.326389:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861223936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.326411:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.326433:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861223936 00000100:00100000:3.0:1746143128.326437:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861223936 00000100:00100000:3.0:1746143128.326453:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12207 00000100:00100000:3.0:1746143128.326457:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861223936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.326715:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3301:x1830962861223936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 257us (303us total) trans 21474839990 rc 0/0 00000100:00100000:3.0:1746143128.326720:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12207 00000004:00080000:3.0:1746143128.326738:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d5f80/2, rc 0, transno 21474839990 00000100:00100000:3.0:1746143128.326741:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861223936:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143128.327388:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143128.327391:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143128.327393:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143128.327395:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:1.0:1746143128.327396:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143128.327427:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861221888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2872us (4103us total) trans 17179872727 rc 0/0 00000100:00100000:1.0:1746143128.327433:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12195 00000004:00080000:1.0:1746143128.327467:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aeca80/2, rc 0, transno 17179872730 00000100:00100000:1.0:1746143128.327470:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861222144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143128.327477:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b89880/2, rc 0, transno 17179872731 00000100:00100000:1.0:1746143128.327479:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861222656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143128.327486:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b5aa00/2, rc 0, transno 21474839986 00000100:00100000:1.0:1746143128.327489:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861223168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143128.327496:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe79500/2, rc 0, transno 21474839987 00000100:00100000:1.0:1746143128.327498:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861223680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143128.327504:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb54e00/2, rc 0, transno 17179872728 00000100:00100000:1.0:1746143128.327507:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861222016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143128.327513:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8b800/2, rc 0, transno 17179872729 00000100:00100000:1.0:1746143128.327515:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861222528:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143128.327522:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb20000/2, rc 0, transno 21474839984 00000100:00100000:1.0:1746143128.327524:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861223040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143128.327530:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7b100/2, rc 0, transno 21474839985 00000100:00100000:1.0:1746143128.327532:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861223552:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143128.327618:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.327627:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.327633:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.327638:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fcfc00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143128.327641:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.327647:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.327660:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff880090531700) 00010000:00010000:2.0:1746143128.327662:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143128.327666:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 00010000:00010000:2.0:1746143128.327670:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cb3d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14797 initiator: MDT0 00000004:00080000:3.0:1746143128.327881:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb56a00/2, rc 0, transno 17179872727 00000100:00100000:3.0:1746143128.327885:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861221888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143128.331967:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.332066:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858574976 00000100:00100000:2.0:1746143128.332073:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858574976 00000100:00100000:2.0:1746143128.332117:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8109 00000100:00100000:2.0:1746143128.332124:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:30873:x1830962858574976:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.332144:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.332161:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe23 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.332208:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.332220:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.332234:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.332237:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143128.332240:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f4a00, rc 0) 00000100:00100000:2.0:1746143128.332278:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30873:x1830962858574976:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 154us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.332284:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8109 00000100:00100000:0.0:1746143128.337651:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.337730:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858575232 00000100:00100000:2.0:1746143128.337738:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858575232 00000100:00100000:2.0:1746143128.337774:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3417 00000100:00100000:2.0:1746143128.337780:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30873:x1830962858575232:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:2.0:1746143128.339012:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30873:x1830962858575232:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 1229us (1365us total) trans 8589942321 rc 0/0 00000100:00100000:2.0:1746143128.339023:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3417 00000100:00100000:0.0:1746143128.364073:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.364257:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858575488 00000100:00100000:1.0:1746143128.364265:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858575488 00000100:00100000:1.0:1746143128.364339:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8110 00000100:00100000:1.0:1746143128.364345:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:30884:x1830962858575488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143128.364366:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.364383:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609200/0x25aee876ca70cb4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe2a expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.364700:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.364711:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.364721:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.364734:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.364740:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.364745:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.364940:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.364947:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.364953:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143128.364961:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143128.365062:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365069:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365074:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365080:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b51f1600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143128.365083:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365090:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365100:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143128.365103:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143128.365107:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365111:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cb52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365124:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365130:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365134:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365138:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b51f0600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143128.365141:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365145:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365151:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800aac68300) 00010000:00010000:1.0:1746143128.365152:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143128.365154:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365158:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cb59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.365191:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609200/0x25aee876ca70cb4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.365203:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.365208:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143128.365210:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143128.365213:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4934200, rc 0) 00000100:00100000:1.0:1746143128.365266:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30884:x1830962858575488:12345-192.168.201.28@tcp:101:cat.0 Request processed in 920us (1235us total) trans 8589942322 rc 0/0 00000100:00100000:1.0:1746143128.365273:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8110 00000100:00080000:2.0:1746143128.365361:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143128.365841:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.366199:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858575744 00000100:00100000:3.0:1746143128.366204:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858575744 00000100:00100000:3.0:1746143128.366244:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8111 00000100:00100000:3.0:1746143128.366250:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:30879:x1830962858575744:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143128.366262:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.366271:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1200/0x25aee876ca70cb6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe31 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.366334:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366544:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366551:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366560:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366566:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366570:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366628:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366634:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366639:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:3.0:1746143128.366645:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143128.366687:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366692:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366698:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366702:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135ca0400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143128.366704:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366708:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366715:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143128.366717:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143128.366719:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366724:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0400/0x25aee876ca70cb75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366735:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366739:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366743:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366746:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135ca1000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143128.366748:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366753:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366989:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531300) 00010000:00010000:3.0:1746143128.366991:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143128.366994:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.366998:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cb7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.367024:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1200/0x25aee876ca70cb6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.367053:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.367059:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143128.367061:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143128.367063:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca0800, rc 0) 00000100:00100000:3.0:1746143128.367089:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30879:x1830962858575744:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 839us (1249us total) trans 8589942323 rc 0/0 00000100:00100000:3.0:1746143128.367095:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8111 00000100:00080000:2.0:1746143128.367153:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143128.373231:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.373472:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858576000 00000100:00100000:1.0:1746143128.373481:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858576000 00000100:00100000:1.0:1746143128.373535:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8112 00000100:00100000:1.0:1746143128.373542:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30881:x1830962858576000:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143128.373562:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143128.373668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143128.373721:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cb91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe38 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.373723:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858576128 00000100:00100000:2.0:1746143128.373727:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858576128 00000100:00100000:2.0:1746143128.373798:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12208 00000100:00100000:2.0:1746143128.373805:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30884:x1830962858576128:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143128.373806:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143128.373813:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.373817:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.373821:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe3f expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.373840:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 198 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.373847:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143128.373863:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.373869:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143128.373870:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143128.373873:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 9 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.373875:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 198 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.373885:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 198 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.373887:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.373894:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.373897:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861224064:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.373901:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861224192:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.373981:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.373988:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 9 pid: 14795 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.373995:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861224320:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143128.374213:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143128.374316:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.375170:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.375613:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858576384 00000100:00100000:3.0:1746143128.375622:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858576384 00000100:00100000:3.0:1746143128.375650:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8113 00000100:00100000:3.0:1746143128.375656:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30885:x1830962858576384:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.375668:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.375676:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0200/0x25aee876ca70cba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe46 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.375949:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.375959:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143128.375968:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:3.0:1746143128.375977:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143128.376402:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0200/0x25aee876ca70cba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 202 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.376651:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 201 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.376659:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143128.376661:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143128.376664:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143128.376670:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143128.376675:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca0c00, rc 0) 00000100:00100000:3.0:1746143128.376710:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30885:x1830962858576384:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1053us (1541us total) trans 8589942324 rc 0/0 00000100:00100000:3.0:1746143128.376716:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8113 00000100:00100000:1.0:1746143128.378455:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861224064:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.378471:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861224320:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.378502:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:3.0:1746143128.378607:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861224192:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143128.378632:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 9 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.378649:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f13200, rc 0) 00000100:00100000:3.0:1746143128.378695:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30884:x1830962858576128:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4888us (5023us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.378703:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12208 00000100:00100000:0.0:1746143128.380608:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.380645:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.380671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.380700:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.380732:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858576640 00000100:00100000:0.0:1746143128.380738:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858576640 00010000:00010000:0.0:1746143128.380952:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.380961:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858576896 00000100:00100000:2.0:1746143128.380967:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858576896 00000100:00100000:0.0:1746143128.380972:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858576512 00000100:00100000:0.0:1746143128.380975:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858576512 00010000:00010000:0.0:1746143128.380984:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 202 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143128.380995:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858576768 00000100:00100000:0.0:1746143128.380997:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858576768 00010000:00010000:0.0:1746143128.381003:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.381007:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8114 00000100:00100000:0.0:1746143128.381014:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6453 00000100:00100000:2.0:1746143128.381017:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:30885:x1830962858576896:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:0.0:1746143128.381019:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1970:x1830962858576640:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143128.381050:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143128.381066:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143128.381068:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.381077:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.381084:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cbbb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe4d expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.381094:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ca1800/0x25aee876ca70cb13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fdf9 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.381108:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.381110:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.381115:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 8 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.381122:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 8 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.381155:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 8 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.381160:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.381172:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:0.0:1746143128.381172:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861224448:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.381177:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.381190:0:14796:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143128.381201:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143128.381224:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ec09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.381239:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6454 00000100:00100000:0.0:1746143128.381245:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:1968:x1830962858576512:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143128.381247:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6455 00010000:00010000:0.0:1746143128.381251:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143128.381255:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 203 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.381262:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 203 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.381267:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858576768:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143128.381273:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0800/0x25aee876ca70cb83 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe31 expref: 203 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.381279:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143128.381282:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.381285:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.381286:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143128.381292:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143128.381297:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143128.381331:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143128.381335:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143128.381354:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1968:x1830962858576512:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 109us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143128.381359:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6454 00010000:00010000:2.0:1746143128.382670:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.382687:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cb60 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe2a expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.382708:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.382711:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143128.382717:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143128.382722:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143128.382727:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.382731:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.382736:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.382785:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.382791:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143128.382806:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143128.383108:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cb91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe38 expref: 11 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.383112:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143128.383136:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe38 expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.383139:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858576768:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1885us (2467us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143128.383143:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe38 expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.383149:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b609000, rc 0) 00000100:00100000:1.0:1746143128.383171:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30881:x1830962858576000:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9630us (9948us total) trans 8589942325 rc 0/0 00000100:00100000:1.0:1746143128.383177:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8112 00000100:00100000:2.0:1746143128.385397:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6455 00000100:00100000:1.0:1746143128.385494:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861224448:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143128.385560:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143128.385600:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858576640:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4578us (5197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.385606:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6453 00000100:00100000:0.0:1746143128.385649:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.385726:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858577024 00000100:00100000:1.0:1746143128.385732:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858577024 00000100:00100000:1.0:1746143128.385781:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8115 00000100:00100000:1.0:1746143128.385787:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30884:x1830962858577024:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143128.385804:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.386023:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094154600/0x25aee876ca70cbd0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe54 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.386083:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094154600/0x25aee876ca70cbd0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe54 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.386094:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094154600/0x25aee876ca70cbd0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe54 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.386107:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143128.386110:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143128.386113:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094154600, rc 0) 00000100:00100000:1.0:1746143128.386142:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30884:x1830962858577024:12345-192.168.201.28@tcp:101:cat.0 Request processed in 354us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.386147:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8115 00000100:00100000:0.0:1746143128.386785:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.386894:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858577152 00000100:00100000:1.0:1746143128.386899:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858577152 00010000:00010000:1.0:1746143128.386922:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe38 expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.387188:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6456 00000100:00100000:1.0:1746143128.387197:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858577152:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143128.387209:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143128.387215:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe38 expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.387225:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe38 expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.387773:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cb98 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe38 expref: 10 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.387790:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143128.387796:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.387804:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.387809:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.388281:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143128.388323:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858577152:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1127us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.388330:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6456 00010000:00010000:2.0:1746143128.388588:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.388597:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:2.0:1746143128.388637:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143128.388640:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143128.388654:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.388681:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f1600/0x25aee876ca70cbbb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 202 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.388694:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.388700:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.388703:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143128.388705:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fcfc00, rc 0) 00000100:00100000:2.0:1746143128.388939:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30885:x1830962858576896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7920us (8232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.388945:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8114 00000100:00100000:0.0:1746143128.394349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.394574:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858577280 00000100:00100000:3.0:1746143128.394583:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858577280 00000100:00100000:0.0:1746143128.394590:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:2.0:1746143128.394673:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143128.394681:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12209 00000100:00100000:2.0:1746143128.394685:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858577408 00000100:00100000:2.0:1746143128.394688:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858577408 00000100:00100000:3.0:1746143128.394689:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+11:30885:x1830962858577280:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.394704:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143128.394711:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8116 00000100:00100000:2.0:1746143128.394715:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30881:x1830962858577408:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143128.394718:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe5b expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.394723:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.394733:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cbde lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe62 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.394740:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.394742:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.394748:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 12 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.394759:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 12 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.394767:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca1c00, rc 0) 00000100:00100000:3.0:1746143128.395360:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:30885:x1830962858577280:12345-192.168.201.28@tcp:101:cat.0 Request processed in 669us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.395367:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12209 00010000:00010000:2.0:1746143128.395383:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cbde lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe62 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.395403:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cbde lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe62 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.395421:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.395424:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143128.395426:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51f0600, rc 0) 00000100:00100000:2.0:1746143128.395452:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30881:x1830962858577408:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 735us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.395639:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8116 00000100:00100000:0.0:1746143128.397694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.397762:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858577664 00000100:00100000:2.0:1746143128.397768:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858577664 00002000:00100000:2.0:1746143128.398000:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009a24b480 x1830962858577664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143128.398010:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24b480 with x1830962858577664 ext(0->1048575) 00002000:00010000:2.0:1746143128.398014:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a24b480 00000100:00100000:2.0:1746143128.398276:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5925 00000100:00100000:2.0:1746143128.398285:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858577664:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143128.399771:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.399823:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858577920 00000100:00100000:3.0:1746143128.399828:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858577920 00000100:00100000:3.0:1746143128.399865:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8117 00000100:00100000:3.0:1746143128.399871:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30881:x1830962858577920:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143128.399884:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.399886:0:14796:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746143128.399909:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51f0600/0x25aee876ca70cbde lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe62 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.399949:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094154600/0x25aee876ca70cbd0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe54 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.399959:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143128.399963:0:14796:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143128.399973:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0e00/0x25aee876ca70cbe5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe69 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.400010:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.400021:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.400045:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.400052:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.400058:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 6/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.400094:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.400105:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 200 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.400117:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861224576:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143128.400190:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.400198:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 200 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.400206:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861224704:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143128.400231:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.400239:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 7 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.400247:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861224832:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143128.400263:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.404359:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861224704:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143128.404375:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861224832:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143128.405799:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.405847:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.405907:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.406369:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861224576:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143128.406398:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:1.0:1746143128.406434:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858578176 00000100:00100000:1.0:1746143128.406441:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858578176 00010000:00010000:1.0:1746143128.406472:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 201 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.406499:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858578304 00000100:00100000:1.0:1746143128.406504:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858578304 00010000:00010000:1.0:1746143128.406518:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 8 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.406536:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858578048 00000100:00100000:1.0:1746143128.406540:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858578048 00010000:00010000:1.0:1746143128.406552:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 202 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.406601:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6457 00000100:00100000:1.0:1746143128.406611:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1968:x1830962858578176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143128.406625:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143128.406633:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 202 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.406643:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 202 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.406664:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70cbc2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe4d expref: 202 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.406685:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143128.406690:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.406698:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.406703:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143128.406747:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1968:x1830962858578176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 138us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.406754:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6457 00000100:00100000:1.0:1746143128.406768:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6458 00000100:00100000:1.0:1746143128.406773:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858578304:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143128.406980:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143128.406985:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 8 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.406987:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6459 00010000:00010000:1.0:1746143128.406993:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 8 pid: 14794 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.406997:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1970:x1830962858578048:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143128.407005:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143128.407008:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70cb44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe23 expref: 8 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.407011:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 200 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.407018:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143128.407021:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:3.0:1746143128.407465:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.407495:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858578560 00000100:00100000:3.0:1746143128.407501:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858578560 00002000:00100000:3.0:1746143128.407534:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009314d500 x1830962858578560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.407544:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314d500 with x1830962858578560 ext(0->1048575) 00002000:00010000:3.0:1746143128.407548:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314d500 00000100:00100000:3.0:1746143128.407570:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5926 00000100:00100000:3.0:1746143128.407577:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:1969:x1830962858578560:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:1.0:1746143128.408166:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.408171:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143128.408178:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 200 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.408193:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0c00/0x25aee876ca70cbad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe46 expref: 200 pid: 14794 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.408207:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.408211:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.408218:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.408224:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.408240:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143128.408259:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1970:x1830962858578048:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1264us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.408265:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6459 00000100:00100000:1.0:1746143128.408627:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858578304:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1852us (2778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.408634:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6458 00000100:00100000:0.0:1746143128.409399:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858577664:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 11114us (11708us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143128.409406:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5925 00002000:00100000:0.0:1746143128.409412:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009a24b480 x1830962858577664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.409420:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24b480 with x1830962858577664 ext(0->1048575) 00010000:00010000:2.0:1746143128.409555:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.409563:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000040:00080000:2.0:1746143128.410159:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2351, 88 off199600 00000004:00080000:2.0:1746143128.410165:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250133243ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410214:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2372, 88 off201184 00000004:00080000:2.0:1746143128.410217:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910250185499ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.410230:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2373, 88 off201272 00000004:00080000:2.0:1746143128.410233:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910250201622ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.410243:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2352, 88 off199688 00000004:00080000:2.0:1746143128.410245:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250213925ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410259:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2353, 88 off199776 00000004:00080000:2.0:1746143128.410262:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250230960ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410270:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2374, 88 off201360 00000004:00080000:2.0:1746143128.410272:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910250240528ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.410278:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2375, 88 off201448 00000004:00080000:2.0:1746143128.410280:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910250248743ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.410286:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2376, 88 off201536 00000004:00080000:2.0:1746143128.410288:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910250257033ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.410295:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2354, 88 off199864 00000004:00080000:2.0:1746143128.410297:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250265602ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410314:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2377, 88 off201624 00000004:00080000:2.0:1746143128.410317:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910250285809ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.410324:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2355, 88 off199952 00000004:00080000:2.0:1746143128.410326:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250294849ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410332:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2378, 88 off201712 00000004:00080000:2.0:1746143128.410334:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910250302764ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143128.410339:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2356, 88 off200040 00000004:00080000:2.0:1746143128.410341:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250310020ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410347:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2357, 88 off200128 00000004:00080000:2.0:1746143128.410349:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250317832ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410355:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2358, 88 off200216 00000004:00080000:2.0:1746143128.410358:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250326785ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410364:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2359, 88 off200304 00000004:00080000:2.0:1746143128.410366:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910250334867ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143128.410373:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2379, 88 off201800 00000004:00080000:2.0:1746143128.410376:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910250344265ns, next at 860119223596ns, rc = 0 00002000:00010000:0.0:1746143128.410500:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a24b480 00000100:00100000:1.0:1746143128.431767:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:1969:x1830962858578560:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24181us (24297us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143128.431779:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5926 00002000:00100000:1.0:1746143128.431790:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009314d500 x1830962858578560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.431800:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314d500 with x1830962858578560 ext(0->1048575) 00002000:00010000:1.0:1746143128.431805:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314d500 00000100:00100000:3.0:1746143128.446071:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.446104:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858578688 00000100:00100000:3.0:1746143128.446111:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858578688 00000100:00100000:3.0:1746143128.446460:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12210 00000100:00100000:3.0:1746143128.446468:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30885:x1830962858578688:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.446484:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143128.446487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143128.446499:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe70 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.446504:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858578816 00000100:00100000:1.0:1746143128.446508:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858578816 00010000:00010000:3.0:1746143128.446525:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.446525:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12211 00010000:00010000:3.0:1746143128.446531:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746143128.446531:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30884:x1830962858578816:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.446533:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.446535:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 21 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.446541:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.446548:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe77 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.446560:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143128.446564:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.446574:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.446722:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.446735:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861224960:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.446735:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.446747:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca0c00, rc 0) 00000100:00100000:1.0:1746143128.446789:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30884:x1830962858578816:12345-192.168.201.28@tcp:101:cat.0 Request processed in 255us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.446795:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12211 00000100:00080000:2.0:1746143128.448162:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143128.448595:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143128.450864:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861224960:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.450888:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 21 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.450902:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a582b600, rc 0) 00000100:00100000:1.0:1746143128.450937:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30885:x1830962858578688:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4470us (4873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.450944:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12210 00000100:00100000:0.0:1746143128.453687:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.453716:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858578944 00000100:00100000:0.0:1746143128.453722:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858578944 00010000:00010000:0.0:1746143128.453752:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143128.453792:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6460 00000100:00100000:0.0:1746143128.453799:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858578944:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143128.453811:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143128.453829:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.453841:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.453862:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ca0600/0x25aee876ca70cb1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe00 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.453876:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.453878:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.453884:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.453891:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.453899:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.453900:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.453903:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.453914:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.453951:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.453963:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e39880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861225088:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143128.454320:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.454331:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e39500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861225216:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143128.454352:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143128.459668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.459700:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858579072 00000100:00100000:1.0:1746143128.459708:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858579072 00000100:00100000:1.0:1746143128.459747:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8118 00000100:00100000:1.0:1746143128.459755:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30884:x1830962858579072:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143128.459952:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.460666:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe7e expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.460720:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.460729:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.460744:0:14794:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143128.460756:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.460768:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143128.460771:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143128.460774:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.460780:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca1000, rc 0) 00000100:00100000:2.0:1746143128.460798:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e39880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861225088:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143128.460821:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30884:x1830962858579072:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1066us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.460828:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8118 00000001:00080000:1.0:1746143128.461993:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942325 is committed 00000001:00080000:1.0:1746143128.462006:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942326 is committed 00000004:00080000:1.0:1746143128.462011:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1797 committed 00000004:00080000:1.0:1746143128.462019:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1782 committed 00000004:00080000:1.0:1746143128.462026:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1781 committed 00000004:00080000:1.0:1746143128.462028:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1780 committed 00000004:00080000:1.0:1746143128.462043:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1779 committed 00000004:00080000:1.0:1746143128.462044:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1796 committed 00000004:00080000:1.0:1746143128.462046:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1778 committed 00000004:00080000:1.0:1746143128.462047:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1795 committed 00000004:00080000:1.0:1746143128.462048:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1777 committed 00000004:00080000:1.0:1746143128.462050:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1794 committed 00000004:00080000:1.0:1746143128.462051:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1793 committed 00000004:00080000:1.0:1746143128.462052:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1792 committed 00000004:00080000:1.0:1746143128.462054:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1776 committed 00000004:00080000:1.0:1746143128.462056:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1775 committed 00000004:00080000:1.0:1746143128.462057:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1791 committed 00000004:00080000:1.0:1746143128.462059:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1790 committed 00000004:00080000:1.0:1746143128.462060:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1774 committed 00000001:00080000:1.0:1746143128.462065:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942321 is committed 00000001:00080000:1.0:1746143128.462072:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942324 is committed 00000100:00100000:0.0:1746143128.462137:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861225344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.462171:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861225472:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143128.462715:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.462725:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.462727:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143128.462732:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.462742:0:14796:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.462748:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.462831:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.462856:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861225984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.462908:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861225600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.463491:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.463506:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.463507:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861226112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.463523:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.463529:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861226496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.463533:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861226624:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143128.463636:0:14796:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.463668:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.463684:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861227136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.463700:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.463713:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746143128.463718:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861225728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.463731:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.463742:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861226240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.463753:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.463762:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861226752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.463775:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143128.463992:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143128.464012:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861225856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143128.464044:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.464084:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861227264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.464154:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861226368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.464172:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143128.464701:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861226880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.464716:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143128.464759:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143128.465645:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861227392:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143128.465699:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.466405:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861225472 00000100:00100000:3.0:1746143128.466412:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861225472 00000100:00100000:3.0:1746143128.466438:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861225600 00000100:00100000:3.0:1746143128.466440:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861225600 00000100:00100000:3.0:1746143128.466447:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861225984 00000100:00100000:3.0:1746143128.466448:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861225984 00000100:00100000:3.0:1746143128.466454:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861226112 00000100:00100000:3.0:1746143128.466456:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861226112 00000100:00100000:3.0:1746143128.466460:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861226624 00000100:00100000:3.0:1746143128.466462:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861226624 00000100:00100000:3.0:1746143128.466467:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861227136 00000100:00100000:3.0:1746143128.466469:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861227136 00000100:00100000:3.0:1746143128.466474:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861225728 00000100:00100000:3.0:1746143128.466476:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861225728 00000100:00100000:3.0:1746143128.466482:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861226240 00000100:00100000:3.0:1746143128.466483:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861226240 00000100:00100000:3.0:1746143128.466489:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861226752 00000100:00100000:3.0:1746143128.466491:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861226752 00000100:00100000:3.0:1746143128.466496:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861225344 00000100:00100000:3.0:1746143128.466498:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861225344 00000100:00100000:3.0:1746143128.466503:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861225856 00000100:00100000:3.0:1746143128.466505:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861225856 00000100:00100000:3.0:1746143128.466510:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861226368 00000100:00100000:3.0:1746143128.466511:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861226368 00000100:00100000:3.0:1746143128.466518:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861226880 00000100:00100000:3.0:1746143128.466519:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861226880 00000100:00100000:3.0:1746143128.466528:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12212 00000100:00100000:3.0:1746143128.466534:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3300:x1830962861225472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143128.466703:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143128.466706:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.466708:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.466711:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.466713:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143128.466743:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3300:x1830962861225472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (4536us total) trans 17179872733 rc 0/0 00000100:00100000:3.0:1746143128.466750:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12212 00000100:00100000:3.0:1746143128.466764:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12213 00000100:00100000:3.0:1746143128.466792:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830962861225600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143128.466861:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143128.466864:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.466866:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.466868:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.466870:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143128.466889:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3301:x1830962861225600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (3400us total) trans 17179872734 rc 0/0 00000100:00100000:3.0:1746143128.466894:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12213 00000100:00100000:3.0:1746143128.466904:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12214 00000100:00100000:3.0:1746143128.466908:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3300:x1830962861225984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.466980:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3300:x1830962861225984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (3474us total) trans 17179872735 rc 0/0 00000100:00100000:3.0:1746143128.466985:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12214 00000100:00100000:3.0:1746143128.466996:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12215 00000100:00100000:3.0:1746143128.467000:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830962861226112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.467095:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3301:x1830962861226112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (3570us total) trans 17179872736 rc 0/0 00000100:00100000:3.0:1746143128.467099:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12215 00000100:00100000:3.0:1746143128.467109:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12216 00000100:00100000:3.0:1746143128.467113:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3301:x1830962861226624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143128.467200:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:3.0:1746143128.467202:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.467204:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.467206:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.467208:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:3.0:1746143128.467226:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830962861226624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (3557us total) trans 21474839991 rc 0/0 00000100:00100000:3.0:1746143128.467231:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12216 00000100:00100000:3.0:1746143128.467240:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12217 00000100:00100000:3.0:1746143128.467245:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3301:x1830962861227136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143128.467315:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143128.467318:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.467319:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.467321:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143128.467323:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143128.467342:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830962861227136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (3641us total) trans 21474839992 rc 0/0 00000100:00100000:3.0:1746143128.467347:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12217 00000100:00100000:3.0:1746143128.467357:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12218 00000100:00100000:3.0:1746143128.467361:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830962861225728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.467643:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3301:x1830962861225728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 281us (3910us total) trans 17179872737 rc 0/0 00000100:00100000:3.0:1746143128.467648:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12218 00000100:00100000:3.0:1746143128.467658:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12219 00000100:00100000:3.0:1746143128.467662:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830962861226240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143128.467733:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3301:x1830962861226240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (3978us total) trans 17179872738 rc 0/0 00000100:00100000:3.0:1746143128.467738:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12219 00000100:00100000:3.0:1746143128.467748:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12220 00000100:00100000:3.0:1746143128.467752:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3301:x1830962861226752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.467822:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830962861226752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (4046us total) trans 21474839993 rc 0/0 00000100:00100000:3.0:1746143128.467827:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12220 00000100:00100000:3.0:1746143128.467836:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12221 00000100:00100000:3.0:1746143128.467840:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3299:x1830962861225344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143128.467904:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143128.467907:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.467908:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.467910:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.467912:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143128.467931:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e39500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861225216:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143128.467935:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3299:x1830962861225344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (3943us total) trans 17179872739 rc 0/0 00000100:00100000:3.0:1746143128.467939:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12221 00000100:00100000:3.0:1746143128.467948:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12222 00010000:00010000:2.0:1746143128.467949:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143128.467952:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3299:x1830962861225856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143128.467973:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858578944:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 14175us (14842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.467980:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6460 00000100:00100000:3.0:1746143128.468018:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3299:x1830962861225856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (3987us total) trans 17179872740 rc 0/0 00000100:00100000:3.0:1746143128.468024:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12222 00000100:00100000:3.0:1746143128.468054:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12223 00000100:00100000:3.0:1746143128.468059:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3299:x1830962861226368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143128.468065:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12224 00000100:00100000:2.0:1746143128.468072:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3299:x1830962861226880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143128.468125:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143128.468128:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.468130:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143128.468132:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143128.468133:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1997 -> 1997 00000100:00100000:3.0:1746143128.468149:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3299:x1830962861226368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (3975us total) trans 21474839994 rc 0/0 00000100:00100000:2.0:1746143128.468149:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3299:x1830962861226880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (3432us total) trans 21474839995 rc 0/0 00000100:00100000:3.0:1746143128.468154:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12223 00000100:00100000:2.0:1746143128.468156:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12224 00000100:00100000:2.0:1746143128.468173:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.468178:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861227264 00000100:00100000:3.0:1746143128.468181:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861227264 00000004:00080000:2.0:1746143128.468204:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b80d880/2, rc 0, transno 17179872734 00000100:00100000:2.0:1746143128.468209:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861225600:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143128.468216:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b80e680/2, rc 0, transno 17179872736 00000100:00100000:2.0:1746143128.468219:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861226112:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143128.468225:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314f100/2, rc 0, transno 21474839991 00000100:00100000:1.0:1746143128.468236:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861227008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.468260:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143128.468279:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b80d500/2, rc 0, transno 17179872733 00000100:00100000:1.0:1746143128.468283:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861225472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143128.468290:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b80e300/2, rc 0, transno 17179872735 00000100:00100000:1.0:1746143128.468293:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861225984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143128.468322:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861226496 00000100:00100000:1.0:1746143128.468325:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861226496 00000100:00100000:1.0:1746143128.468341:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861227008 00000100:00100000:1.0:1746143128.468343:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861227008 00000100:00100000:1.0:1746143128.468528:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12225 00000100:00100000:1.0:1746143128.468533:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3300:x1830962861226496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143128.468617:0:8169:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143128.468620:0:8169:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143128.468622:0:8169:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143128.468624:0:8169:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:1.0:1746143128.468626:0:8169:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143128.468651:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3300:x1830962861226496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (3892us total) trans 21474839996 rc 0/0 00000100:00100000:1.0:1746143128.468657:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12225 00000100:00100000:1.0:1746143128.468750:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12226 00000100:00100000:1.0:1746143128.468755:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3300:x1830962861227008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.468831:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3300:x1830962861227008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (569us total) trans 21474839997 rc 0/0 00000100:00100000:1.0:1746143128.468836:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12226 00000004:00080000:1.0:1746143128.468868:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314df80/2, rc 0, transno 21474839996 00000100:00100000:1.0:1746143128.468873:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861226496:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143128.468879:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e680/2, rc 0, transno 21474839997 00000100:00100000:1.0:1746143128.468882:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861227008:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143128.473813:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b80df80/2, rc 0, transno 17179872740 00000100:00100000:0.0:1746143128.473825:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861225856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143128.473837:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314d180/2, rc 0, transno 21474839994 00000100:00100000:0.0:1746143128.473843:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861226368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143128.473992:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861226624:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143128.474015:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e300/2, rc 0, transno 21474839992 00000100:00100000:2.0:1746143128.474020:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861227136:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143128.474026:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314c380/2, rc 0, transno 21474839995 00000004:00080000:2.0:1746143128.474132:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b80dc00/2, rc 0, transno 17179872737 00000100:00100000:2.0:1746143128.474136:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861225728:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143128.474145:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b80ea00/2, rc 0, transno 17179872738 00000100:00100000:2.0:1746143128.474148:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861226240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143128.474156:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314fb80/2, rc 0, transno 21474839993 00000100:00100000:2.0:1746143128.474159:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861226752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.474998:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861226880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143128.475015:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b80d180/2, rc 0, transno 17179872739 00000100:00100000:0.0:1746143128.475018:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861225344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143128.475046:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861227520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.475100:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143128.475143:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861227520 00000100:00100000:3.0:1746143128.475150:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861227520 00000100:00100000:1.0:1746143128.475156:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12227 00000100:00100000:1.0:1746143128.475165:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3301:x1830962861227264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143128.475171:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12228 00000100:00100000:3.0:1746143128.475177:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3299:x1830962861227520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143128.475229:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.475248:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858579200 00000100:00100000:0.0:1746143128.475252:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858579200 00000100:00100000:0.0:1746143128.475295:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8119 00000100:00100000:0.0:1746143128.475311:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:30885:x1830962858579200:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143128.475324:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143128.475341:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe85 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.475384:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 198 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.475396:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 198 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.475412:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143128.475414:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143128.475417:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f390000, rc 0) 00000100:00100000:0.0:1746143128.475463:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:30885:x1830962858579200:12345-192.168.201.28@tcp:101:cat.0 Request processed in 161us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143128.475472:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8119 00000100:00100000:1.0:1746143128.475785:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3301:x1830962861227264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 621us (7610us total) trans 21474839998 rc 0/0 00000100:00100000:1.0:1746143128.475792:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12227 00000004:00080000:2.0:1746143128.476175:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ccbb80/2, rc 0, transno 21474839998 00000100:00100000:2.0:1746143128.476180:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861227264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143128.476563:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3299:x1830962861227520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1385us (1462us total) trans 21474839999 rc 0/0 00000100:00100000:1.0:1746143128.476570:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12228 00000004:00080000:0.0:1746143128.476650:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b11500/2, rc 0, transno 21474839999 00000100:00100000:0.0:1746143128.476655:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861227520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143128.477498:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.477518:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858579328 00000100:00100000:1.0:1746143128.477523:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858579328 00000100:00100000:1.0:1746143128.477638:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8120 00000100:00100000:1.0:1746143128.477645:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:30886:x1830962858579328:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143128.477661:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.477673:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70cc0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe8c expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.477720:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477731:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477740:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477750:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477756:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477761:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477842:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477849:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477855:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143128.477879:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143128.477882:0:14795:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143128.477895:0:14795:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477902:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477908:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477913:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477918:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477923:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4934200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143128.477926:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477932:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477940:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143128.477942:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143128.477946:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477950:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4934200/0x25aee876ca70cc16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477962:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477966:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477971:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477974:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b609000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143128.477977:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477981:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477987:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800953bd000) 00010000:00010000:1.0:1746143128.477988:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143128.477990:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.477994:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b609000/0x25aee876ca70cc1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143128.478017:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x25aee876ca70cc0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.478027:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 7 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.478054:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143128.478056:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143128.478058:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b608a00, rc 0) 00000100:00100000:1.0:1746143128.478495:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30886:x1830962858579328:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 850us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.478501:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8120 00000100:00100000:2.0:1746143128.490094:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.490202:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.490223:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858579712 00000100:00100000:2.0:1746143128.490230:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858579712 00000100:00100000:2.0:1746143128.490279:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3418 00000100:00100000:2.0:1746143128.490286:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30884:x1830962858579712:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143128.490582:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30884:x1830962858579712:12345-192.168.201.28@tcp:49:cat.0 Request processed in 100us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.490589:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3418 00000100:00100000:1.0:1746143128.490652:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858579584 00000100:00100000:1.0:1746143128.490656:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858579584 00002000:00100000:1.0:1746143128.490678:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800a5e39880 x1830962858579584/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.490687:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39880 with x1830962858579584 ext(1048576->2097151) 00002000:00010000:1.0:1746143128.490691:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e39880 00000100:00100000:1.0:1746143128.490703:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5927 00000100:00100000:1.0:1746143128.490707:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858579584:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143128.491444:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861227392:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143128.491474:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0e00/0x25aee876ca70cbe5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 9 pid: 14796 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143128.491493:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.491510:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ca0000, rc 0) 00000100:00100000:3.0:1746143128.491528:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30881:x1830962858577920:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 91657us (91761us total) trans 8589942326 rc 0/0 00000100:00100000:3.0:1746143128.491534:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8117 00000100:00100000:2.0:1746143128.496646:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.496690:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.496754:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858579840 00000100:00100000:3.0:1746143128.496761:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858579840 00000100:00100000:3.0:1746143128.496794:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858579968 00000100:00100000:3.0:1746143128.496796:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858579968 00000100:00100000:3.0:1746143128.496809:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12229 00000100:00100000:3.0:1746143128.496816:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858579840:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143128.496830:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.496844:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe93 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.496863:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.496865:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.496872:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 11 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.496891:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 11 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.496900:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1600, rc 0) 00000100:00100000:3.0:1746143128.496934:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858579840:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 119us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.496940:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12229 00000100:00100000:3.0:1746143128.496952:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12230 00000100:00100000:3.0:1746143128.496956:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858579968:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143128.496961:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.496968:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fe9a expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.496981:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.496982:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143128.496986:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 11 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.496994:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 11 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.497000:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc0a00, rc 0) 00000100:00100000:3.0:1746143128.497010:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1970:x1830962858579968:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 54us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.497014:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12230 00000100:00100000:3.0:1746143128.497953:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.498005:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858580096 00000100:00100000:0.0:1746143128.498009:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858580096 00000100:00100000:0.0:1746143128.498066:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3419 00000100:00100000:0.0:1746143128.498072:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30881:x1830962858580096:12345-192.168.201.28@tcp:49:multiop.0 00000100:00100000:0.0:1746143128.498164:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30881:x1830962858580096:12345-192.168.201.28@tcp:49:multiop.0 Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143128.498170:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3419 00010000:00010000:1.0:1746143128.513220:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143128.513255:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.513371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.513456:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858580352 00000100:00100000:3.0:1746143128.513457:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858580736 00000100:00100000:3.0:1746143128.513465:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858580736 00000100:00100000:2.0:1746143128.513465:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858580352 00002000:00100000:2.0:1746143128.513499:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012b80c000 x1830962858580352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143128.513500:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12231 00000100:00100000:3.0:1746143128.513507:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30881:x1830962858580736:12345-192.168.201.28@tcp:101:multiop.0 00002000:00100000:2.0:1746143128.513508:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b80c000 with x1830962858580352 ext(1048576->2097151) 00002000:00010000:2.0:1746143128.513513:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b80c000 00010000:00010000:3.0:1746143128.513518:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143128.513525:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5928 00000100:00100000:2.0:1746143128.513530:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858580352:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:3.0:1746143128.513532:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fea8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.513556:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.513564:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.513565:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.513569:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1400832->1507327] (req 1400832->1507327) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.513596:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.513607:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.513618:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861227648:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143128.513686:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.517697:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858579584:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26981us (27602us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143128.517707:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5927 00002000:00100000:0.0:1746143128.517717:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800a5e39880 x1830962858579584/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.517726:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39880 with x1830962858579584 ext(1048576->2097151) 00002000:00010000:0.0:1746143128.517730:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e39880 00000100:00100000:3.0:1746143128.518876:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861227648:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143128.518899:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1400832->1507327] (req 1400832->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.518913:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1200, rc 0) 00000100:00100000:3.0:1746143128.518946:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30881:x1830962858580736:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5439us (5574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.518953:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12231 00000100:00100000:1.0:1746143128.519160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.520025:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.521234:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858580608 00000100:00100000:3.0:1746143128.521242:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858580608 00000100:00100000:3.0:1746143128.521291:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8121 00000100:00100000:3.0:1746143128.521298:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30886:x1830962858580608:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:2.0:1746143128.521394:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858580864 00000100:00100000:2.0:1746143128.521400:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858580864 00010000:00010000:2.0:1746143128.521425:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.521456:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6461 00000100:00100000:2.0:1746143128.521462:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858580864:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143128.521474:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143128.521493:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.521504:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.521523:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b712c00/0x25aee876ca70cb21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe07 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.521550:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.521552:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.521559:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.521566:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.521597:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.521609:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861227776:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143128.521679:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a840 going to sleep for 11 seconds 00010000:00010000:3.0:1746143128.521738:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.521751:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9000/0x25aee876ca70cc40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fea1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.522025:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.522060:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.522066:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.522084:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.522092:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 8 pid: 14795 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.522101:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861227904:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143128.522145:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143128.528502:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.528662:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858580992 00000100:00100000:3.0:1746143128.528672:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858580992 00000100:00100000:3.0:1746143128.528721:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12232 00000100:00100000:3.0:1746143128.528734:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30885:x1830962858580992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.528749:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.528763:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164feaf expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.528787:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.528798:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.528800:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.528802:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.528828:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.528849:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 14 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.528860:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861228032:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143128.528950:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.530171:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861227776:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.530187:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143128.530211:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858580864:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8749us (10187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.530220:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6461 00000100:00100000:0.0:1746143128.535359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.538830:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858581248 00000100:00100000:2.0:1746143128.538842:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858581248 00002000:00100000:2.0:1746143128.538902:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1400832->1404927) req@ffff8800913dca80 x1830962858581248/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143128.538912:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dca80 with x1830962858581248 ext(1400832->1404927) 00010000:00010000:2.0:1746143128.538921:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 15 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.538932:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 15 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143128.538939:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913dca80 00000100:00100000:1.0:1746143128.539326:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861228032:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.539348:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.539361:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc0200, rc 0) 00000100:00100000:1.0:1746143128.539605:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30885:x1830962858580992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10668us (10905us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.539613:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12232 00000100:00100000:2.0:1746143128.539783:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1954 00000100:00100000:2.0:1746143128.539792:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858581248:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143128.539914:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858581248:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 123us (4886us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143128.539919:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1954 00002000:00100000:2.0:1746143128.539925:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1400832->1404927) req@ffff8800913dca80 x1830962858581248/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/4536 e 0 to 0 dl 1746143139 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143128.539932:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dca80 with x1830962858581248 ext(1400832->1404927) 00010000:00010000:2.0:1746143128.539937:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 15 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.539944:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 15 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143128.539955:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913dca80 00000100:00100000:2.0:1746143128.540070:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861227904:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143128.540081:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:3.0:1746143128.540235:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858580352:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 26703us (26984us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143128.540243:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5928 00002000:00100000:3.0:1746143128.540249:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012b80c000 x1830962858580352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.540257:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b80c000 with x1830962858580352 ext(1048576->2097151) 00002000:00010000:3.0:1746143128.540260:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b80c000 00000100:00100000:1.0:1746143128.547431:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.547459:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858581376 00000100:00100000:2.0:1746143128.547468:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858581376 00010000:00010000:2.0:1746143128.547502:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 9 pid: 14795 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.547536:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6462 00000100:00100000:2.0:1746143128.547545:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858581376:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143128.547557:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143128.547562:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 9 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.547573:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 9 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.547590:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b608a00/0x25aee876ca70cc24 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe8c expref: 9 pid: 14795 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.547607:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.547612:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.547620:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.547627:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.547648:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143128.549743:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858581376:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2194us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.549754:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6462 00010000:00010000:2.0:1746143128.549785:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.549791:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:2.0:1746143128.549808:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:3.0:1746143128.549815:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.549838:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858581632 00000100:00100000:3.0:1746143128.549842:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858581632 00002000:00100000:3.0:1746143128.549886:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1503232->1507327) req@ffff8800a5cc8a80 x1830962858581632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.549901:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc8a80 with x1830962858581632 ext(1503232->1507327) 00010000:00010000:3.0:1746143128.549908:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 13 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.549926:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 13 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:3.0:1746143128.549933:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5cc8a80 00000100:00100000:3.0:1746143128.549960:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1955 00000100:00100000:3.0:1746143128.549966:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858581632:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:2.0:1746143128.549988:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9000/0x25aee876ca70cc40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.550002:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.550009:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143128.550012:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143128.550014:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dc9600, rc 0) 00000100:00100000:2.0:1746143128.550068:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30886:x1830962858580608:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 28749us (30888us total) trans 8589942327 rc 0/0 00000100:00100000:2.0:1746143128.550075:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8121 00000100:00100000:3.0:1746143128.550094:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858581632:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 127us (279us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143128.550100:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1955 00002000:00100000:3.0:1746143128.550105:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1503232->1507327) req@ffff8800a5cc8a80 x1830962858581632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/4536 e 0 to 0 dl 1746143139 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.550113:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc8a80 with x1830962858581632 ext(1503232->1507327) 00010000:00010000:3.0:1746143128.550118:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 13 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.550128:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 13 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:3.0:1746143128.550134:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5cc8a80 00000100:00100000:3.0:1746143128.555694:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.555777:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858581888 00000100:00100000:1.0:1746143128.555785:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858581888 00002000:00100000:1.0:1746143128.555826:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1400831) req@ffff8800a5ccb100 x1830962858581888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.555837:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccb100 with x1830962858581888 ext(1048576->1400831) 00010000:00010000:1.0:1746143128.555846:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 13 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.555859:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 13 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143128.555867:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ccb100 00000100:00100000:1.0:1746143128.555885:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1956 00000100:00100000:1.0:1746143128.555893:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858581888:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143128.557105:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.557552:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858582016 00000100:00100000:2.0:1746143128.557558:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858582016 00000100:00100000:2.0:1746143128.557591:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8122 00000100:00100000:2.0:1746143128.557598:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30886:x1830962858582016:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.557614:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.557631:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cc5c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164feb6 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.557693:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.557704:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.557710:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143128.557738:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.557746:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 9 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.557758:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861228160:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.557811:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.562017:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.562084:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858582272 00000100:00100000:3.0:1746143128.562091:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858582272 00000100:00100000:0.0:1746143128.562093:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:3.0:1746143128.562127:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1507328->2097151) req@ffff8800913dd180 x1830962858582272/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.562136:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dd180 with x1830962858582272 ext(1507328->2097151) 00000100:00100000:0.0:1746143128.562140:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143128.562144:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 15 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.562157:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 15 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:3.0:1746143128.562164:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913dd180 00000100:00100000:3.0:1746143128.562186:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858582784 00000100:00100000:3.0:1746143128.562188:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858582784 00002000:00100000:3.0:1746143128.562200:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1400832->1507327) req@ffff8800913dd500 x1830962858582784/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.562207:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dd500 with x1830962858582784 ext(1400832->1507327) 00010000:00010000:3.0:1746143128.562212:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.562220:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:3.0:1746143128.562225:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913dd500 00000100:00100000:3.0:1746143128.562249:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1957 00000100:00100000:3.0:1746143128.562257:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858582272:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143128.562764:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1958 00000100:00100000:1.0:1746143128.562772:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858582784:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:2.0:1746143128.563189:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858582656 00000100:00100000:2.0:1746143128.563194:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858582656 00000100:00100000:2.0:1746143128.563232:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3420 00000100:00100000:2.0:1746143128.563237:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f35c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30881:x1830962858582656:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143128.563407:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f35c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30881:x1830962858582656:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 168us (1313us total) trans 8589942328 rc 0/0 00000100:00100000:2.0:1746143128.563418:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3420 00000100:00100000:2.0:1746143128.571054:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.571186:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861228160:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143128.571210:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143128.571234:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858582912 00000100:00100000:0.0:1746143128.571240:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858582912 00000100:00100000:0.0:1746143128.571280:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12233 00000100:00100000:0.0:1746143128.571288:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30884:x1830962858582912:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143128.571312:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143128.571326:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164febd expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.571348:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143128.571353:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.571363:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.571372:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f390200, rc 0) 00000100:00100000:0.0:1746143128.571422:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30884:x1830962858582912:12345-192.168.201.28@tcp:101:cat.0 Request processed in 134us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143128.571428:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12233 00000100:00100000:1.0:1746143128.575562:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858581888:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 19658us (19864us total) trans 0 rc 352256/352256 00000100:00100000:1.0:1746143128.575579:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1956 00002000:00100000:1.0:1746143128.575590:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1400831) req@ffff8800a5ccb100 x1830962858581888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:H/200/0 rc 352256/352256 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.575599:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccb100 with x1830962858581888 ext(1048576->1400831) 00010000:00010000:1.0:1746143128.575610:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 18 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.575621:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 18 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143128.575628:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ccb100 00000100:00100000:0.0:1746143128.578143:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.579298:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858582784:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 16524us (17154us total) trans 17179872741 rc 0/0 00000100:00100000:1.0:1746143128.579321:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1958 00002000:00100000:1.0:1746143128.579331:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (1400832->1507327) req@ffff8800913dd500 x1830962858582784/t17179872741(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/448 e 0 to 0 dl 1746143139 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.579340:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dd500 with x1830962858582784 ext(1400832->1507327) 00010000:00010000:1.0:1746143128.579350:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 18 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.579362:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 18 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143128.579369:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913dd500 00000100:00100000:3.0:1746143128.580599:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858583040 00000100:00100000:3.0:1746143128.580608:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858583040 00010000:00010000:3.0:1746143128.580636:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 10 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.581333:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6463 00000100:00100000:3.0:1746143128.581341:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858583040:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.581353:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.581359:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 10 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.581368:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 10 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.581386:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dc9600/0x25aee876ca70cc47 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea1 expref: 10 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.581506:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143128.581512:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.581521:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.581527:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.581550:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143128.581658:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143128.581665:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:0.0:1746143128.581698:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143128.581702:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143128.581715:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143128.581742:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cc5c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.581767:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.581774:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143128.581776:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143128.581778:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093462c00, rc 0) 00000100:00100000:3.0:1746143128.581924:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858583040:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 582us (3787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.581932:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6463 00000100:00100000:0.0:1746143128.582272:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30886:x1830962858582016:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 24673us (25168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143128.582279:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8122 00000100:00100000:3.0:1746143128.583401:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858582272:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 21143us (21391us total) trans 0 rc 589824/589824 00000100:00100000:3.0:1746143128.583409:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1957 00002000:00100000:3.0:1746143128.583417:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1507328->2097151) req@ffff8800913dd180 x1830962858582272/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:H/200/0 rc 589824/589824 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.583426:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dd180 with x1830962858582272 ext(1507328->2097151) 00010000:00010000:3.0:1746143128.583435:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.583446:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:3.0:1746143128.583453:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913dd180 00000100:00100000:0.0:1746143128.585990:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.586097:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858583168 00000100:00100000:2.0:1746143128.586105:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858583168 00000100:00100000:2.0:1746143128.586239:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12234 00000100:00100000:2.0:1746143128.586252:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858583168:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.586265:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.586295:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5502600/0x25aee876ca70cc71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fec4 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.586355:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861228288:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143128.587438:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.594493:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.594631:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858583296 00000100:00100000:1.0:1746143128.594639:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858583296 00000100:00100000:1.0:1746143128.594683:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12235 00000100:00100000:1.0:1746143128.594691:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:30879:x1830962858583296:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143128.594706:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.594719:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fecb expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.594744:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.594751:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143128.594752:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143128.594755:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4091904->4194303] (req 4091904->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.594785:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.594794:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.594806:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861228416:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.594880:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.596821:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:2.0:1746143128.597076:0:26949:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143126 -> 1746143127 00002000:00010000:2.0:1746143128.597080:0:26949:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143126 -> 1746143127 00000100:00100000:2.0:1746143128.597099:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861228288:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143128.597132:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5502600/0x25aee876ca70cc71 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fec4 expref: 11 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.597156:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5502600/0x25aee876ca70cc71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fec4 expref: 11 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.597327:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5502600, rc 0) 00000100:00100000:2.0:1746143128.597359:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858583168:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 11113us (11379us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143128.597366:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12234 00000100:00100000:0.0:1746143128.597465:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858583424 00000100:00100000:0.0:1746143128.597470:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858583424 00010000:00010000:0.0:1746143128.597489:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143128.597515:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6464 00000100:00100000:0.0:1746143128.597521:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858583424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143128.597530:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143128.597548:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.597561:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.597576:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1200/0x25aee876ca70cc39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1507327) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fea8 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.597593:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.597595:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.597601:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.597608:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.597614:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.597615:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.597617:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.597623:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.597644:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.597654:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861228544:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143128.597704:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.597711:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861228672:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143128.597725:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.600230:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861228544:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143128.600259:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861228672:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143128.600272:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143128.600317:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858583424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2780us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143128.600325:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6464 00000100:00100000:0.0:1746143128.600382:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.600420:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858583680 00000100:00100000:0.0:1746143128.600425:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858583680 00010000:00010000:0.0:1746143128.600641:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143128.600661:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6465 00000100:00100000:0.0:1746143128.600667:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858583680:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143128.600677:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143128.600693:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.600702:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.600723:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.600725:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.600730:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.600738:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.600761:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.600772:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861228800:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143128.600831:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df7d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746143128.601207:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093fce400/0x25aee876ca70cb2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe15 expref: 11 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.601231:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861228416:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.601249:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.601258:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093914600, rc 0) 00000100:00100000:1.0:1746143128.601280:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:30879:x1830962858583296:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6590us (6795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.601286:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12235 00000100:00100000:0.0:1746143128.602861:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.602919:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858583936 00000100:00100000:2.0:1746143128.602930:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858583936 00000100:00100000:2.0:1746143128.602977:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8123 00000100:00100000:2.0:1746143128.602983:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30886:x1830962858583936:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143128.602998:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.603013:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70cc7f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fed2 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.603176:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603189:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603198:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603208:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603213:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603219:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603223:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dc0400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143128.603227:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603232:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603240:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143128.603243:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143128.603246:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603251:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70cc86 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.603277:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70cc7f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed2 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.603285:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcf800/0x25aee876ca70cc7f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed2 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.603291:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fcf800, rc 0) 00000100:00100000:3.0:1746143128.603361:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30886:x1830962858583936:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 377us (502us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143128.603367:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8123 00000100:00100000:0.0:1746143128.603880:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.603893:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861228800:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.603906:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143128.603924:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858583680:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3257us (3543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.603932:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6465 00000100:00100000:3.0:1746143128.604063:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858584192 00000100:00100000:3.0:1746143128.604067:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858584192 00002000:00100000:3.0:1746143128.604092:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4091904->4095999) req@ffff8800913ded80 x1830962858584192/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.604102:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913ded80 with x1830962858584192 ext(4091904->4095999) 00002000:00010000:3.0:1746143128.604105:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913ded80 00000100:00100000:3.0:1746143128.604234:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5929 00000100:00100000:3.0:1746143128.604241:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858584192:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143128.604610:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858584192:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 370us (730us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143128.604616:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5929 00002000:00100000:3.0:1746143128.604621:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4091904->4095999) req@ffff8800913ded80 x1830962858584192/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/4536 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.604627:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913ded80 with x1830962858584192 ext(4091904->4095999) 00002000:00010000:3.0:1746143128.604629:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913ded80 00000100:00100000:0.0:1746143128.605748:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.605777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.606217:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858584448 00000100:00100000:3.0:1746143128.606222:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858584448 00002000:00100000:3.0:1746143128.606242:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800913df100 x1830962858584448/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.606250:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913df100 with x1830962858584448 ext(1048576->2097151) 00002000:00010000:3.0:1746143128.606253:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913df100 00000100:00100000:3.0:1746143128.606277:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5930 00000100:00100000:3.0:1746143128.606283:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858584448:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143128.606406:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.606538:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858584704 00000100:00100000:2.0:1746143128.606542:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858584704 00000100:00100000:2.0:1746143128.606571:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3421 00000100:00100000:2.0:1746143128.606576:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30886:x1830962858584704:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:2.0:1746143128.606709:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30886:x1830962858584704:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 133us (931us total) trans 8589942329 rc 0/0 00000100:00100000:2.0:1746143128.606715:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3421 00000100:00100000:1.0:1746143128.607091:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858584960 00000100:00100000:1.0:1746143128.607095:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858584960 00002000:00100000:1.0:1746143128.607113:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800913df800 x1830962858584960/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.607120:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913df800 with x1830962858584960 ext(1048576->2097151) 00002000:00010000:1.0:1746143128.607123:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913df800 00000100:00100000:1.0:1746143128.607135:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5931 00000100:00100000:1.0:1746143128.607139:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858584960:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143128.612425:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.612517:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858585088 00000100:00100000:1.0:1746143128.612526:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858585088 00000100:00100000:1.0:1746143128.614161:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12236 00000100:00100000:1.0:1746143128.614171:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30879:x1830962858585088:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143128.614187:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.614202:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fed9 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.614227:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.614240:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143128.614241:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143128.614244:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->3792895] (req 3145728->3792895) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.614271:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.614281:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 9 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.614293:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861228928:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.619153:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.629760:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858584448:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 23466us (24002us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143128.629772:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5930 00002000:00100000:3.0:1746143128.629784:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800913df100 x1830962858584448/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.629793:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913df100 with x1830962858584448 ext(1048576->2097151) 00002000:00010000:3.0:1746143128.629799:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913df100 00000100:00100000:1.0:1746143128.629897:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861228928:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.629921:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->3792895] (req 3145728->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.629935:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093914a00, rc 0) 00000100:00100000:1.0:1746143128.629955:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30879:x1830962858585088:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 15787us (17538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.629960:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12236 00000100:00100000:0.0:1746143128.632191:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.632247:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858585216 00000100:00100000:2.0:1746143128.632254:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858585216 00010000:00010000:2.0:1746143128.632283:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.632326:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6466 00000100:00100000:2.0:1746143128.632333:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858585216:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143128.632345:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143128.632363:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.632373:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.632390:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fcea00/0x25aee876ca70cb36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe1c expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.632415:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.632417:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.632423:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.632431:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.632457:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.632468:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861229056:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143128.632550:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.640135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.640462:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858585344 00000100:00100000:2.0:1746143128.640470:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858585344 00000100:00100000:2.0:1746143128.640522:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12237 00000100:00100000:2.0:1746143128.640531:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:30885:x1830962858585344:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143128.640547:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.640562:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fee0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.640588:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.640594:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143128.640595:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143128.640598:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.640623:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.640633:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 9 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.640644:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861229184:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.640656:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858584960:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 33513us (34247us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143128.640666:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5931 00002000:00100000:1.0:1746143128.640675:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800913df800 x1830962858584960/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.640684:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913df800 with x1830962858584960 ext(1048576->2097151) 00002000:00010000:1.0:1746143128.640688:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913df800 00000100:00100000:2.0:1746143128.640694:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.645623:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861229056:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.645645:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143128.645698:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858585216:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13365us (13509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.645708:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6466 00000100:00100000:2.0:1746143128.654436:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861229184:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143128.654467:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.654482:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bce000, rc 0) 00000100:00100000:2.0:1746143128.654521:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:30885:x1830962858585344:12345-192.168.201.28@tcp:101:cat.0 Request processed in 13990us (14394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.654529:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12237 00000100:00100000:0.0:1746143128.659794:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.660020:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.660088:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858585600 00000100:00100000:3.0:1746143128.660096:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858585600 00000100:00100000:0.0:1746143128.660112:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.660140:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12238 00000100:00100000:3.0:1746143128.660149:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30884:x1830962858585600:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:2.0:1746143128.660162:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858585472 00010000:00010000:3.0:1746143128.660166:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143128.660166:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858585472 00010000:00010000:3.0:1746143128.660182:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fee7 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.660185:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.660204:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.660210:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 10 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.660214:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6467 00000100:00100000:2.0:1746143128.660220:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858585472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.660221:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 10 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.660229:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1200, rc 0) 00010000:00010000:2.0:1746143128.660229:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143128.660246:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.660256:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.660270:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30884:x1830962858585600:12345-192.168.201.28@tcp:101:cat.0 Request processed in 122us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.660276:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12238 00000100:00100000:1.0:1746143128.660808:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858585856 00000100:00100000:1.0:1746143128.660813:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858585856 00010000:00010000:2.0:1746143128.660835:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093797c00/0x25aee876ca70cb28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe0e expref: 10 pid: 4758 timeout: 1010 lvb_type: 0 00002000:00100000:1.0:1746143128.660838:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3788800->3792895) req@ffff88009f730000 x1830962858585856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746143128.660848:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:1.0:1746143128.660848:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730000 with x1830962858585856 ext(3788800->3792895) 00010000:00010000:2.0:1746143128.660850:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746143128.660852:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f730000 00010000:00010000:2.0:1746143128.660855:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.660861:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.660867:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.660868:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.660871:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 9 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.660874:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5932 00010000:00010000:2.0:1746143128.660877:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 9 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143128.660880:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858585856:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:2.0:1746143128.660900:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 9 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.660912:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861229312:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.660982:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.660991:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861229440:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143128.660999:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858585856:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 118us (886us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143128.661004:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5932 00002000:00100000:1.0:1746143128.661009:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3788800->3792895) req@ffff88009f730000 x1830962858585856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/4536 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.661016:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730000 with x1830962858585856 ext(3788800->3792895) 00000100:00100000:2.0:1746143128.661017:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c540 going to sleep for 11 seconds 00002000:00010000:1.0:1746143128.661019:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f730000 00000100:00100000:0.0:1746143128.664212:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.664324:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861229312:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143128.664333:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861229440:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.664349:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143128.664565:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858585472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4344us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.664574:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6467 00000100:00100000:1.0:1746143128.665174:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858586112 00000100:00100000:1.0:1746143128.665180:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858586112 00000100:00100000:1.0:1746143128.665208:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3422 00000100:00100000:1.0:1746143128.665214:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:30879:x1830962858586112:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143128.665376:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30879:x1830962858586112:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 162us (1170us total) trans 8589942330 rc 0/0 00000100:00100000:1.0:1746143128.665382:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3422 00000100:00100000:0.0:1746143128.668774:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.669227:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858586368 00000100:00100000:1.0:1746143128.669235:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858586368 00002000:00100000:1.0:1746143128.669273:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f730700 x1830962858586368/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.669283:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730700 with x1830962858586368 ext(1048576->2097151) 00002000:00010000:1.0:1746143128.669289:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f730700 00000100:00100000:1.0:1746143128.669454:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5933 00000100:00100000:1.0:1746143128.669463:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858586368:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143128.684073:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.687161:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858586624 00000100:00100000:3.0:1746143128.687172:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858586624 00002000:00100000:3.0:1746143128.687210:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f730a80 x1830962858586624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.687227:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730a80 with x1830962858586624 ext(1048576->2097151) 00002000:00010000:3.0:1746143128.687231:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f730a80 00000100:00100000:1.0:1746143128.690596:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858586368:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 21123us (21818us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143128.690608:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5933 00002000:00100000:1.0:1746143128.690620:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f730700 x1830962858586368/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.690628:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730700 with x1830962858586368 ext(1048576->2097151) 00002000:00010000:1.0:1746143128.690633:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f730700 00000100:00100000:1.0:1746143128.690663:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5934 00000100:00100000:1.0:1746143128.690673:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858586624:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143128.720090:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858586624:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 29412us (36055us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143128.720100:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5934 00002000:00100000:1.0:1746143128.720111:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009f730a80 x1830962858586624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.720125:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730a80 with x1830962858586624 ext(1048576->2097151) 00002000:00010000:1.0:1746143128.720130:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f730a80 00000100:00100000:0.0:1746143128.722208:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.722270:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858586880 00000100:00100000:3.0:1746143128.722278:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858586880 00000100:00100000:3.0:1746143128.722330:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8124 00000100:00100000:3.0:1746143128.722337:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30892:x1830962858586880:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143128.722354:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.722369:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0000/0x25aee876ca70cca2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164feee expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.722458:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722470:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722480:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722490:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722496:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722501:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722586:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722594:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722599:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143128.722606:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143128.722671:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722677:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722681:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722687:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dc1400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143128.722689:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722695:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722703:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143128.722706:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143128.722709:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722714:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1400/0x25aee876ca70cca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722965:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722974:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722978:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722982:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dc0600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143128.722984:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722988:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.722994:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531700) 00010000:00010000:3.0:1746143128.722996:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143128.722998:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.723002:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70ccb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.723648:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0000/0x25aee876ca70cca2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 12 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.723661:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.723668:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143128.723670:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143128.723672:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1a00, rc 0) 00000100:00100000:3.0:1746143128.723714:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30892:x1830962858586880:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1378us (1509us total) trans 8589942331 rc 0/0 00000100:00100000:3.0:1746143128.723721:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8124 00000100:00100000:0.0:1746143128.732794:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.732887:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858587136 00000100:00100000:1.0:1746143128.732896:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858587136 00002000:00100000:1.0:1746143128.732938:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009f731180 x1830962858587136/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.732947:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830962858587136 ext(2097152->3145727) 00002000:00010000:1.0:1746143128.732951:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f731180 00000100:00100000:1.0:1746143128.732987:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5935 00000100:00100000:1.0:1746143128.732995:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1971:x1830962858587136:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143128.741448:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.741483:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.741503:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858587648 00000100:00100000:2.0:1746143128.741510:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858587648 00000100:00100000:3.0:1746143128.741512:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858587392 00000100:00100000:3.0:1746143128.741516:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858587392 00002000:00100000:2.0:1746143128.741547:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4091903) req@ffff880094d7d180 x1830962858587648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143128.741551:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12239 00002000:00100000:2.0:1746143128.741557:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7d180 with x1830962858587648 ext(3145728->4091903) 00000100:00100000:3.0:1746143128.741559:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858587392:12345-192.168.201.28@tcp:101:cat.0 00002000:00010000:2.0:1746143128.741561:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7d180 00000100:00100000:2.0:1746143128.741576:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5936 00000100:00100000:2.0:1746143128.741581:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858587648:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:3.0:1746143128.742246:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.742261:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc0c00/0x25aee876ca70ccc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fefc expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.742318:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861229568:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143128.742394:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143128.742944:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.743213:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858587904 00000100:00100000:3.0:1746143128.743217:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858587904 00002000:00100000:3.0:1746143128.743238:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88012b80f100 x1830962858587904/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.743245:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b80f100 with x1830962858587904 ext(2097152->3145727) 00002000:00010000:3.0:1746143128.743249:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b80f100 00000100:00100000:3.0:1746143128.743262:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5937 00000100:00100000:3.0:1746143128.743266:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858587904:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143128.747687:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.747723:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.747786:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858588160 00000100:00100000:1.0:1746143128.747793:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858588160 00002000:00100000:1.0:1746143128.747827:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3792896->4194303) req@ffff88009f731500 x1830962858588160/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.747836:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731500 with x1830962858588160 ext(3792896->4194303) 00002000:00010000:1.0:1746143128.747841:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f731500 00000100:00100000:1.0:1746143128.747861:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5938 00000100:00100000:1.0:1746143128.747867:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858588160:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143128.750171:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858587264 00000100:00100000:2.0:1746143128.750180:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858587264 00000100:00100000:2.0:1746143128.750228:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12240 00000100:00100000:2.0:1746143128.750235:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858587264:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143128.750248:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.750274:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bcfe00/0x25aee876ca70cccc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fef5 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.750331:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861229696:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143128.750381:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.751489:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858587136:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18491us (18699us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143128.751498:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5935 00002000:00100000:2.0:1746143128.751507:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009f731180 x1830962858587136/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143128.751516:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830962858587136 ext(2097152->3145727) 00002000:00010000:2.0:1746143128.751520:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f731180 00002000:00010000:3.0:1746143128.751705:0:26949:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143126 -> 1746143127 00002000:00010000:3.0:1746143128.751709:0:26949:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143126 -> 1746143127 00000100:00100000:3.0:1746143128.751722:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861229568:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143128.751746:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc0c00/0x25aee876ca70ccc5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fefc expref: 16 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.751761:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc0c00/0x25aee876ca70ccc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fefc expref: 16 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143128.751774:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc0c00, rc 0) 00000100:00100000:3.0:1746143128.751792:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858587392:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10234us (10352us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143128.751797:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12239 00002000:00010000:2.0:1746143128.756083:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143126 -> 1746143127 00002000:00010000:2.0:1746143128.756090:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143126 -> 1746143127 00000100:00100000:2.0:1746143128.756110:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861229696:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143128.756141:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bcfe00/0x25aee876ca70cccc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fef5 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.756154:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bcfe00/0x25aee876ca70cccc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fef5 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.756351:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bcfe00, rc 0) 00000100:00100000:2.0:1746143128.756567:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858587264:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6331us (8841us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143128.756576:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12240 00000100:00100000:2.0:1746143128.761668:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1970:x1830962858587648:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20079us (20176us total) trans 0 rc 946176/946176 00000100:00100000:2.0:1746143128.761679:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5936 00002000:00100000:2.0:1746143128.761690:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4091903) req@ffff880094d7d180 x1830962858587648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143128.761698:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d7d180 with x1830962858587648 ext(3145728->4091903) 00002000:00010000:2.0:1746143128.761703:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d7d180 00000100:00100000:0.0:1746143128.766978:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.767270:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858588288 00000100:00100000:2.0:1746143128.767280:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858588288 00000100:00100000:2.0:1746143128.767347:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12241 00000100:00100000:2.0:1746143128.767361:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30884:x1830962858588288:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143128.767379:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.767430:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff03 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.767459:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.767467:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143128.767468:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143128.767472:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.767501:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.767513:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 13 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.767526:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861229824:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.768828:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.770208:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858587904:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26934us (27258us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143128.770219:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5937 00002000:00100000:3.0:1746143128.770229:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88012b80f100 x1830962858587904/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.770238:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b80f100 with x1830962858587904 ext(2097152->3145727) 00002000:00010000:3.0:1746143128.770243:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b80f100 00000100:00100000:1.0:1746143128.772144:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858588160:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24269us (24457us total) trans 0 rc 401408/401408 00000100:00100000:1.0:1746143128.772155:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5938 00002000:00100000:1.0:1746143128.772163:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3792896->4194303) req@ffff88009f731500 x1830962858588160/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.772172:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731500 with x1830962858588160 ext(3792896->4194303) 00002000:00010000:1.0:1746143128.772177:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f731500 00000100:00100000:1.0:1746143128.772988:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.773099:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861229824:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143128.773125:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.773140:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bcea00, rc 0) 00000100:00100000:0.0:1746143128.773932:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858588416 00000100:00100000:0.0:1746143128.773939:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858588416 00002000:00100000:0.0:1746143128.773973:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4091904->4194303) req@ffff88012b80f800 x1830962858588416/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.773981:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b80f800 with x1830962858588416 ext(4091904->4194303) 00010000:00010000:0.0:1746143128.773987:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 14 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.774174:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30884:x1830962858588288:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6814us (7202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.774183:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12241 00010000:00010000:0.0:1746143128.774512:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 14 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:0.0:1746143128.774520:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b80f800 00000100:00100000:0.0:1746143128.774537:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1959 00000100:00100000:0.0:1746143128.774545:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858588416:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143128.777846:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.778065:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858588544 00000100:00100000:3.0:1746143128.778072:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858588544 00000100:00100000:3.0:1746143128.778108:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12242 00000100:00100000:3.0:1746143128.778114:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30885:x1830962858588544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.778128:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.778142:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff0a expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.778163:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.778165:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.778170:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.778179:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.778189:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1e00, rc 0) 00000100:00100000:3.0:1746143128.778223:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:30885:x1830962858588544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 110us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.778230:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12242 00000100:00100000:1.0:1746143128.780124:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858588416:12345-192.168.201.28@tcp:4:cat.0 Request processed in 5576us (7133us total) trans 21474840000 rc 0/0 00000100:00100000:1.0:1746143128.780134:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1959 00002000:00100000:1.0:1746143128.780142:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4091904->4194303) req@ffff88012b80f800 x1830962858588416/t21474840000(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/448 e 0 to 0 dl 1746143139 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.780152:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b80f800 with x1830962858588416 ext(4091904->4194303) 00010000:00010000:1.0:1746143128.780160:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 17 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.780173:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 17 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143128.780180:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b80f800 00000100:00100000:0.0:1746143128.788077:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.788277:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858588672 00000100:00100000:2.0:1746143128.788287:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858588672 00010000:00010000:2.0:1746143128.788336:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 17 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.788381:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6468 00000100:00100000:2.0:1746143128.788390:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1971:x1830962858588672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143128.788403:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143128.788422:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 17 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.788434:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 17 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.788454:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093914600/0x25aee876ca70cc78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fecb expref: 17 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.788482:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.788483:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.788490:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.788498:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.788506:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.788507:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.788510:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.788517:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.788548:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.788561:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861229952:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.788644:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.788653:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861230080:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143128.788673:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.803464:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861229952:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143128.803479:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861230080:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.803499:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143128.803550:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858588672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 15159us (15478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.803559:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6468 00000100:00100000:0.0:1746143128.812654:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.813023:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.813136:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858588928 00000100:00100000:3.0:1746143128.813146:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858588928 00002000:00100000:3.0:1746143128.813183:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009f732680 x1830962858588928/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.813193:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732680 with x1830962858588928 ext(2097152->3145727) 00002000:00010000:3.0:1746143128.813198:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732680 00000100:00100000:3.0:1746143128.813223:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858589184 00000100:00100000:3.0:1746143128.813225:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858589184 00002000:00100000:3.0:1746143128.813235:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009f732a00 x1830962858589184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.813242:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732a00 with x1830962858589184 ext(3145728->4194303) 00002000:00010000:3.0:1746143128.813245:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732a00 00000100:00100000:3.0:1746143128.813256:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5939 00000100:00100000:3.0:1746143128.813263:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858588928:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143128.813698:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5940 00000100:00100000:2.0:1746143128.813708:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858589184:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143128.835240:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858588928:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21968us (22584us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143128.835251:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5939 00002000:00100000:1.0:1746143128.835261:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009f732680 x1830962858588928/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.835270:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732680 with x1830962858588928 ext(2097152->3145727) 00002000:00010000:1.0:1746143128.835275:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732680 00000100:00100000:3.0:1746143128.835411:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858589184:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21705us (22387us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143128.835418:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5940 00002000:00100000:3.0:1746143128.835424:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009f732a00 x1830962858589184/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.835431:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732a00 with x1830962858589184 ext(3145728->4194303) 00002000:00010000:3.0:1746143128.835434:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732a00 00000100:00100000:0.0:1746143128.835439:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.835463:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858589440 00000100:00100000:3.0:1746143128.835470:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858589440 00000100:00100000:3.0:1746143128.835498:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8125 00000100:00100000:3.0:1746143128.835505:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30894:x1830962858589440:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143128.835522:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.835536:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70cce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff11 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.835618:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.835630:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.835638:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.835648:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.835653:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.835657:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.835740:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.835748:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.835753:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143128.835760:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143128.836247:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836255:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836260:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836264:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dc1000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143128.836266:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836271:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836281:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143128.836283:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143128.836287:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836292:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1000/0x25aee876ca70cce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836323:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836328:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836331:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836335:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dc0e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143128.836337:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836341:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836347:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531300) 00010000:00010000:3.0:1746143128.836349:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143128.836351:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836355:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0e00/0x25aee876ca70ccef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143128.836385:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0600/0x25aee876ca70cce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 202 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.836396:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.836401:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143128.836403:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143128.836405:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc0400, rc 0) 00000100:00100000:3.0:1746143128.836433:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30894:x1830962858589440:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 928us (994us total) trans 8589942332 rc 0/0 00000100:00100000:3.0:1746143128.836438:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8125 00000100:00100000:0.0:1746143128.841209:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.841585:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858589568 00000100:00100000:3.0:1746143128.841594:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858589568 00000100:00100000:3.0:1746143128.841635:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12243 00000100:00100000:3.0:1746143128.841642:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30884:x1830962858589568:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.841657:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.841671:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff18 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.841695:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.841702:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.841704:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143128.841707:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.841733:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143128.841743:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 22 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.841755:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861230208:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143128.841828:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.846107:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.846147:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.846175:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858589824 00000100:00100000:3.0:1746143128.846184:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858589824 00002000:00100000:3.0:1746143128.846231:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009f733480 x1830962858589824/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.846240:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733480 with x1830962858589824 ext(4194304->5210111) 00002000:00010000:3.0:1746143128.846245:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f733480 00000100:00100000:3.0:1746143128.846265:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5941 00000100:00100000:3.0:1746143128.846272:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858589824:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143128.846342:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858589952 00000100:00100000:1.0:1746143128.846347:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858589952 00000100:00100000:1.0:1746143128.846377:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12244 00000100:00100000:1.0:1746143128.846383:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30892:x1830962858589952:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143128.846391:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143128.846405:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff1f expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.846426:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.846433:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 8 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143128.846435:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861230208:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.846440:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.846445:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.846447:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143128.846450:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1302528->1912831] (req 1302528->1912831) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 18 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.846457:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.846468:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1c00, rc 0) 00010000:00010000:1.0:1746143128.846474:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.846484:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 18 pid: 8449 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.846495:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861230336:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.846506:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30884:x1830962858589568:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4864us (6483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.846513:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12243 00010000:00010000:1.0:1746143128.846545:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143128.846554:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 8 pid: 754 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143128.846561:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861230464:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.846584:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.846592:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 22 pid: 8169 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143128.846600:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861230592:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.846614:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.848873:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.849013:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861230336:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.849023:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861230464:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143128.849045:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861230592:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143128.849069:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1302528->1912831] (req 1302528->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143128.849080:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497000, rc 0) 00000100:00100000:1.0:1746143128.849109:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30892:x1830962858589952:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 2725us (2960us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.849118:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12244 00000100:00100000:1.0:1746143128.849140:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858590080 00000100:00100000:1.0:1746143128.849144:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858590080 00002000:00100000:1.0:1746143128.849165:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3792895) req@ffff88009f733b80 x1830962858590080/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.849173:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733b80 with x1830962858590080 ext(3145728->3792895) 00010000:00010000:1.0:1746143128.849180:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 23 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.849190:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 23 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143128.849196:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f733b80 00000100:00100000:1.0:1746143128.849210:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1960 00000100:00100000:1.0:1746143128.849216:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858590080:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143128.853357:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.855276:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858590208 00000100:00100000:2.0:1746143128.855288:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858590208 00010000:00010000:2.0:1746143128.855331:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 9 pid: 754 timeout: 1010 lvb_type: 1 00000100:00100000:0.0:1746143128.855668:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.863590:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858590336 00000100:00100000:3.0:1746143128.863601:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858590336 00010000:00010000:3.0:1746143128.863639:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 25 pid: 8169 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.863668:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6469 00000100:00100000:3.0:1746143128.863676:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858590208:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143128.863689:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143128.863708:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 9 pid: 754 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143128.863719:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6470 00010000:00010000:3.0:1746143128.863724:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 9 pid: 754 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143128.863728:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858590336:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143128.863737:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143128.863748:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 25 pid: 8169 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143128.863759:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc0a00/0x25aee876ca70cc32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe9a expref: 9 pid: 754 timeout: 1010 lvb_type: 1 00010000:00010000:1.0:1746143128.864055:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 25 pid: 8169 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.864069:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a582b600/0x25aee876ca70cbf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe70 expref: 25 pid: 8169 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.864084:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143128.864111:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143128.864123:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858590336:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 397us (8456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143128.864129:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6470 00000100:00100000:3.0:1746143128.864133:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858590208:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 458us (10784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143128.864140:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6469 00000100:00100000:1.0:1746143128.864190:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.865187:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858590464 00000100:00100000:0.0:1746143128.865191:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858590464 00010000:00010000:0.0:1746143128.865209:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 17 pid: 8449 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143128.865227:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6471 00000100:00100000:0.0:1746143128.865232:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858590464:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143128.865239:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143128.865249:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 17 pid: 8449 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.865257:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 17 pid: 8449 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.865270:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ca0c00/0x25aee876ca70cbfa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe77 expref: 17 pid: 8449 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143128.865282:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.865285:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143128.865290:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.865310:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143128.865345:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143128.865357:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135180700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861230720:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143128.865603:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df7900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.872700:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135180700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861230720:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143128.872719:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143128.872754:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858590464:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7521us (8564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143128.872764:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6471 00000100:00100000:1.0:1746143128.872943:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.873202:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858590720 00000100:00100000:0.0:1746143128.873208:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858590720 00002000:00100000:0.0:1746143128.873241:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x303:0x0] (1302528->1306623) req@ffff88012b802300 x1830962858590720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.873250:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802300 with x1830962858590720 ext(1302528->1306623) 00002000:00010000:0.0:1746143128.873255:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b802300 00000100:00100000:0.0:1746143128.873276:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5942 00000100:00100000:0.0:1746143128.873284:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858590720:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143128.873650:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858590720:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 366us (708us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143128.873656:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5942 00002000:00100000:0.0:1746143128.873661:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x303:0x0] (1302528->1306623) req@ffff88012b802300 x1830962858590720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/4536 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.873674:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802300 with x1830962858590720 ext(1302528->1306623) 00002000:00010000:0.0:1746143128.873677:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b802300 00000100:00100000:3.0:1746143128.875103:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858589824:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28827us (29001us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143128.875111:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5941 00002000:00100000:3.0:1746143128.875118:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009f733480 x1830962858589824/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143128.875127:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733480 with x1830962858589824 ext(4194304->5210111) 00002000:00010000:3.0:1746143128.875131:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f733480 00000100:00100000:1.0:1746143128.877699:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858590080:12345-192.168.201.28@tcp:4:cat.0 Request processed in 28475us (28823us total) trans 17179872742 rc 0/0 00000100:00100000:1.0:1746143128.877709:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1960 00002000:00100000:1.0:1746143128.877717:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3792895) req@ffff88009f733b80 x1830962858590080/t17179872742(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:279/0 lens 488/448 e 0 to 0 dl 1746143139 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.877726:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733b80 with x1830962858590080 ext(3145728->3792895) 00010000:00010000:1.0:1746143128.877734:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 24 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143128.877748:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 24 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143128.877755:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f733b80 00000100:00100000:0.0:1746143128.890663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143128.890940:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858590976 00000100:00100000:1.0:1746143128.890949:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858590976 00002000:00100000:1.0:1746143128.890990:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1908736->1912831) req@ffff880135180700 x1830962858590976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.890999:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180700 with x1830962858590976 ext(1908736->1912831) 00002000:00010000:1.0:1746143128.891005:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135180700 00000100:00100000:1.0:1746143128.891061:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5943 00000100:00100000:1.0:1746143128.891069:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858590976:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143128.891239:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858590976:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 170us (584us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143128.891246:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5943 00002000:00100000:1.0:1746143128.891252:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1908736->1912831) req@ffff880135180700 x1830962858590976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/4536 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143128.891259:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180700 with x1830962858590976 ext(1908736->1912831) 00002000:00010000:1.0:1746143128.891262:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135180700 00000100:00100000:0.0:1746143128.894023:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.894079:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.894148:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858591104 00000100:00100000:3.0:1746143128.894155:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858591104 00000100:00100000:3.0:1746143128.894193:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858591232 00000100:00100000:3.0:1746143128.894195:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858591232 00000100:00100000:3.0:1746143128.894211:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12245 00000100:00100000:3.0:1746143128.894217:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858591104:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.894240:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.894255:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc1000/0x25aee876ca70cd12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff26 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.894311:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861230848:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143128.894585:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.894607:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12246 00000100:00100000:3.0:1746143128.894612:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858591232:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143128.894619:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143128.894625:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc1400/0x25aee876ca70cd19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff2d expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143128.894647:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861230976:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143128.894668:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143128.895667:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.896044:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.896226:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858591360 00000100:00100000:2.0:1746143128.896232:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858591360 00010000:00010000:2.0:1746143128.896255:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 28 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143128.896479:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858591616 00000100:00100000:3.0:1746143128.896483:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858591616 00000100:00100000:2.0:1746143128.897095:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6472 00000100:00100000:2.0:1746143128.897102:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858591360:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143128.897112:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143128.897129:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 28 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.897140:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 28 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.897159:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.897161:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.897168:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.897175:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.897201:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.897211:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861231104:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143128.897266:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143128.897872:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3423 00000100:00100000:3.0:1746143128.897879:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30892:x1830962858591616:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143128.898049:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30892:x1830962858591616:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 169us (2018us total) trans 8589942333 rc 0/0 00000100:00100000:3.0:1746143128.898056:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3423 00010000:00010000:2.0:1746143128.899675:0:754:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.201.28@tcp) returned -22 from glimpse AST (req@ffff8800a5cc9880 x1830962861230976) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 28 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143128.899697:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093914a00/0x25aee876ca70cc8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fed9 expref: 28 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.899725:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861230976:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143128.899750:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1400/0x25aee876ca70cd19 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff2d expref: 27 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.899759:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1400/0x25aee876ca70cd19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff2d expref: 27 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.899766:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1400, rc 0) 00000100:00100000:2.0:1746143128.899802:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858591232:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5189us (5721us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143128.899809:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12246 00002000:00010000:2.0:1746143128.899847:0:10061:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143126 -> 1746143127 00002000:00010000:2.0:1746143128.899850:0:10061:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143126 -> 1746143127 00000100:00100000:2.0:1746143128.899859:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861230848:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143128.899873:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1000/0x25aee876ca70cd12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff26 expref: 25 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.899882:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1000/0x25aee876ca70cd12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff26 expref: 25 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.899889:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1000, rc 0) 00000100:00100000:2.0:1746143128.899905:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858591104:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5688us (5888us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143128.899910:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12245 00000100:00100000:2.0:1746143128.908880:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861231104:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143128.908901:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143128.908949:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858591360:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11846us (13281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.908959:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6472 00000100:00100000:0.0:1746143128.916824:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.918725:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.919120:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858591744 00000100:00100000:2.0:1746143128.919129:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858591744 00000100:00100000:2.0:1746143128.919169:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858591872 00000100:00100000:2.0:1746143128.919171:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858591872 00000100:00100000:2.0:1746143128.919188:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12247 00000100:00100000:2.0:1746143128.919195:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858591744:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143128.919212:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.919225:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bcfe00/0x25aee876ca70cd20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff34 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143128.919273:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861231232:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143128.919350:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.919368:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12248 00000100:00100000:2.0:1746143128.919373:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858591872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143128.919378:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.919386:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff3b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.919396:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.919398:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.919404:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.919417:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.919425:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bcfa00, rc 0) 00000100:00100000:2.0:1746143128.919447:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858591872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 74us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.919453:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12248 00000100:00100000:0.0:1746143128.930483:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.930515:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.930544:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143128.930575:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858592256 00000100:00100000:0.0:1746143128.930582:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858592256 00002000:00100000:0.0:1746143128.930617:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880135181c00 x1830962858592256/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.930627:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135181c00 with x1830962858592256 ext(2097152->3145727) 00002000:00010000:0.0:1746143128.930632:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135181c00 00000100:00100000:0.0:1746143128.930643:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858592384 00000100:00100000:0.0:1746143128.930645:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858592384 00002000:00100000:0.0:1746143128.930652:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880135181f80 x1830962858592384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.930658:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135181f80 with x1830962858592384 ext(3145728->4194303) 00002000:00010000:0.0:1746143128.930660:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135181f80 00000100:00100000:0.0:1746143128.930677:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858592640 00000100:00100000:0.0:1746143128.930679:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858592640 00002000:00100000:0.0:1746143128.930690:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880135182300 x1830962858592640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/0 e 0 to 0 dl 1746143139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.930696:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135182300 with x1830962858592640 ext(3145728->4194303) 00002000:00010000:0.0:1746143128.930698:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135182300 00000100:00100000:0.0:1746143128.930706:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5944 00000100:00100000:0.0:1746143128.930712:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858592256:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143128.932027:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5945 00000100:00100000:0.0:1746143128.932053:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858592384:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143128.934354:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5946 00000100:00100000:1.0:1746143128.934362:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858592640:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143128.936266:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861231232:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143128.936303:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bcfe00/0x25aee876ca70cd20 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff34 expref: 25 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.936317:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bcfe00/0x25aee876ca70cd20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff34 expref: 25 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143128.936335:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bcfe00, rc 0) 00000100:00100000:2.0:1746143128.936364:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858591744:12345-192.168.201.28@tcp:101:cat.0 Request processed in 17168us (19548us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143128.936371:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12247 00000100:00100000:0.0:1746143128.954539:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143128.957368:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858592896 00000100:00100000:3.0:1746143128.957380:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858592896 00000100:00100000:3.0:1746143128.957649:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3424 00000100:00100000:3.0:1746143128.957658:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30885:x1830962858592896:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:3.0:1746143128.957864:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:30885:x1830962858592896:12345-192.168.201.28@tcp:35:cat.0 Request processed in 206us (3331us total) trans 8589942334 rc 0/0 00000100:00100000:3.0:1746143128.957876:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3424 00000100:00100000:0.0:1746143128.963685:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858592256:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 32965us (33200us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143128.963695:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5944 00002000:00100000:0.0:1746143128.963704:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880135181c00 x1830962858592256/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143128.963712:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135181c00 with x1830962858592256 ext(2097152->3145727) 00002000:00010000:0.0:1746143128.963717:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135181c00 00000100:00100000:0.0:1746143128.981315:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143128.981448:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858593024 00000100:00100000:2.0:1746143128.981778:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858593024 00000100:00100000:2.0:1746143128.982335:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12249 00000100:00100000:2.0:1746143128.982347:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30894:x1830962858593024:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143128.982365:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143128.982381:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff42 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.982405:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.982415:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.982421:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.982423:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143128.982432:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 17 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.982459:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.982475:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.982489:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861231360:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143128.982971:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.982981:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 12 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143128.982990:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861231488:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.983008:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143128.994107:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858592384:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 62047us (63581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143128.994117:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5945 00002000:00100000:2.0:1746143128.994128:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880135181f80 x1830962858592384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143128.994135:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135181f80 with x1830962858592384 ext(3145728->4194303) 00002000:00010000:2.0:1746143128.994140:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135181f80 00000100:00100000:2.0:1746143128.996186:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861231360:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143128.996196:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861231488:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143128.996222:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 17 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143128.996239:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bcec00, rc 0) 00000100:00100000:2.0:1746143128.996279:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:30894:x1830962858593024:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 13935us (14972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143128.996287:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12249 00000100:00100000:0.0:1746143129.003814:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143129.004008:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858592640:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 69644us (73459us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143129.004019:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5946 00002000:00100000:1.0:1746143129.004047:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880135182300 x1830962858592640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:279/0 lens 488/440 e 0 to 0 dl 1746143139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143129.004056:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135182300 with x1830962858592640 ext(3145728->4194303) 00010000:00010000:1.0:1746143129.004065:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 11 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143129.004077:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 11 pid: 8450 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143129.004088:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135182300 00000100:00100000:2.0:1746143129.004530:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858593152 00000100:00100000:2.0:1746143129.004538:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858593152 00010000:00010000:2.0:1746143129.004571:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143129.004603:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6473 00000100:00100000:2.0:1746143129.004610:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858593152:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.004622:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.004646:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143129.004657:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143129.004676:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1e00/0x25aee876ca70ccda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff0a expref: 17 pid: 26949 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143129.004707:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143129.004743:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858593152:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 133us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.004749:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6473 00000100:00100000:1.0:1746143129.020283:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.021158:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858593280 00000100:00100000:0.0:1746143129.021166:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858593280 00010000:00010000:0.0:1746143129.021212:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 11 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143129.021243:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6474 00000100:00100000:0.0:1746143129.021251:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858593280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.021263:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.021280:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 11 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.021300:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 11 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.021322:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bcea00/0x25aee876ca70ccd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff03 expref: 11 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.021337:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.021339:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.021345:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.021352:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.021378:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143129.021388:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861231616:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143129.021448:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.021529:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.021588:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858593408 00000100:00100000:0.0:1746143129.021592:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858593408 00000100:00100000:0.0:1746143129.021614:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12250 00000100:00100000:0.0:1746143129.021619:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858593408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143129.021631:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143129.021640:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e30cc00/0x25aee876ca70cd35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff49 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143129.021665:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861231744:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143129.021690:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df7e40 going to sleep for 11 seconds 00000100:00080000:2.0:1746143129.021940:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143129.028709:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861231744:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143129.028740:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e30cc00/0x25aee876ca70cd35 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff49 expref: 12 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.028753:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e30cc00/0x25aee876ca70cd35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff49 expref: 12 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.028776:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e30cc00, rc 0) 00000100:00100000:2.0:1746143129.028817:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858593408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7196us (7287us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143129.028824:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12250 00000100:00100000:0.0:1746143129.030683:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861231616:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143129.030699:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.030742:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858593280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9492us (10468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.030750:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6474 00000100:00100000:2.0:1746143129.036090:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.038282:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858593664 00000100:00100000:0.0:1746143129.038302:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858593664 00002000:00100000:0.0:1746143129.038358:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2707456->2711551) req@ffff88009535ce00 x1830962858593664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143129.038368:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ce00 with x1830962858593664 ext(2707456->2711551) 00002000:00010000:0.0:1746143129.038373:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535ce00 00000100:00100000:0.0:1746143129.038403:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5947 00000100:00100000:0.0:1746143129.038411:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858593664:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143129.038566:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858593664:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 155us (2484us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143129.038573:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5947 00002000:00100000:0.0:1746143129.038578:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2707456->2711551) req@ffff88009535ce00 x1830962858593664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:280/0 lens 488/4536 e 0 to 0 dl 1746143140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143129.038586:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ce00 with x1830962858593664 ext(2707456->2711551) 00002000:00010000:0.0:1746143129.038589:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535ce00 00000100:00100000:0.0:1746143129.039570:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.039730:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858593792 00000100:00100000:2.0:1746143129.039736:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858593792 00000100:00100000:2.0:1746143129.039764:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12251 00000100:00100000:2.0:1746143129.039771:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30884:x1830962858593792:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143129.039781:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143129.039795:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff50 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.039816:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.039823:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143129.039824:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143129.039827:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 11 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.039852:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 15 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.039863:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 15 pid: 10061 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143129.039874:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861231872:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143129.039946:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.065394:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.065414:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.065518:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858594048 00000100:00100000:2.0:1746143129.065527:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858594048 00000100:00100000:0.0:1746143129.066383:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.066408:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858594304 00000100:00100000:0.0:1746143129.066411:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858594304 00002000:00100000:0.0:1746143129.066440:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2707456->3145727) req@ffff880135180380 x1830962858594304/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143129.066451:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180380 with x1830962858594304 ext(2707456->3145727) 00010000:00010000:0.0:1746143129.066460:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 16 pid: 10061 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.066473:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 16 pid: 10061 timeout: 1010 lvb_type: 0 00002000:00010000:0.0:1746143129.066480:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135180380 00000100:00100000:0.0:1746143129.066497:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1961 00000100:00100000:0.0:1746143129.066504:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858594304:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:3.0:1746143129.067342:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861231872:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143129.067370:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 11 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.067386:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bcf000, rc 0) 00000100:00100000:1.0:1746143129.067616:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858594432 00000100:00100000:1.0:1746143129.067621:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858594432 00000100:00100000:1.0:1746143129.067652:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12252 00000100:00100000:1.0:1746143129.067658:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30894:x1830962858594432:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143129.067669:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143129.067684:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff5e expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.067706:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.067714:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.067721:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.067723:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.067726:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->2392063] (req 2097152->2392063) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 25 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.067758:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.067769:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 25 pid: 8450 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143129.067786:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861232000:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143129.068061:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8126 00000100:00100000:2.0:1746143129.068071:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30898:x1830962858594048:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143129.068084:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143129.068096:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcee00/0x25aee876ca70cd4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff57 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.068165:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.068178:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.068185:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 13 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.068192:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.068199:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.068215:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.068224:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 201 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143129.068232:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861232128:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143129.070778:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30884:x1830962858593792:12345-192.168.201.28@tcp:101:cat.0 Request processed in 30997us (31199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143129.070788:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12251 00010000:00010000:1.0:1746143129.071319:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.071338:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 15 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143129.071351:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861232256:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143129.071598:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3a300 going to sleep for 11 seconds 00010000:00010000:2.0:1746143129.072083:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 13 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.072093:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 13 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143129.072103:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861232384:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143129.072797:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.072807:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 8 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143129.072815:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861232512:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143129.072836:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.089059:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143129.089139:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861232000:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143129.089153:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861232256:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.089187:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->2392063] (req 2097152->2392063) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 25 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.089205:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdef200, rc 0) 00000100:00100000:1.0:1746143129.089248:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30894:x1830962858594432:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 21589us (23831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143129.089256:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12252 00000100:00100000:1.0:1746143129.089319:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858594560 00000100:00100000:1.0:1746143129.089325:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858594560 00010000:00010000:1.0:1746143129.089348:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 25 pid: 8450 timeout: 1010 lvb_type: 1 00000100:00100000:0.0:1746143129.089404:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.091072:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143129.091105:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858594688 00000100:00100000:1.0:1746143129.091110:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858594688 00010000:00010000:1.0:1746143129.091137:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143129.091193:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6475 00000100:00080000:2.0:1746143129.091204:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143129.091229:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861232128:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143129.091242:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858594560:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.091254:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.091271:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 25 pid: 8450 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143129.091281:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 25 pid: 8450 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143129.091312:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bcfa00/0x25aee876ca70cd27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff3b expref: 25 pid: 8450 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143129.091325:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143129.091698:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6476 00000100:00100000:3.0:1746143129.091705:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858594688:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143129.091713:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143129.091722:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143129.091729:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143129.091741:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1c00/0x25aee876ca70cd04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff18 expref: 16 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143129.091759:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.091761:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.091768:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.091781:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.091810:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 24 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143129.091821:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861232640:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143129.092167:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858594560:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 964us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.092174:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6475 00000100:00100000:3.0:1746143129.093139:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143129.093499:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858594816 00000100:00100000:3.0:1746143129.093504:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858594816 00010000:00010000:3.0:1746143129.093524:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 202 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143129.093543:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6477 00000100:00100000:3.0:1746143129.093549:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1969:x1830962858594816:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143129.093559:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143129.093563:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 202 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143129.093571:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 202 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143129.093584:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc0400/0x25aee876ca70ccf6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff11 expref: 202 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143129.093597:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.093601:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.093609:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.093613:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143129.093633:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858594816:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 84us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143129.093638:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6477 00000100:00100000:0.0:1746143129.095123:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.095155:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.095195:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861232384:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143129.095204:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861232512:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143129.095230:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:1.0:1746143129.095287:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858594944 00000100:00100000:1.0:1746143129.095301:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858594944 00010000:00010000:1.0:1746143129.095320:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 14 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143129.095337:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858595072 00000100:00100000:1.0:1746143129.095340:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858595072 00010000:00010000:1.0:1746143129.095348:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 9 pid: 14796 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143129.095361:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6478 00000100:00100000:1.0:1746143129.095366:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858594944:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143129.095374:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143129.095377:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 14 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143129.095385:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 14 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143129.095398:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70ccb7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feee expref: 14 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143129.095421:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143129.095425:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143129.095435:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143129.095439:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143129.095464:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858594944:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 97us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143129.095470:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6478 00000100:00100000:1.0:1746143129.095485:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6479 00000100:00100000:1.0:1746143129.095489:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858595072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143129.095496:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143129.095499:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 9 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143129.095506:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 9 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143129.095516:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cc63 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feb6 expref: 9 pid: 14796 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143129.095524:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143129.095527:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143129.095533:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143129.095539:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143129.095556:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143129.095574:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858595072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 84us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143129.095579:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6479 00010000:00010000:3.0:1746143129.095717:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.095724:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143129.095935:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143129.096897:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcee00/0x25aee876ca70cd4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 14 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.096911:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 13 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.096918:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.096920:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143129.096922:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bcf400, rc 0) 00000100:00100000:3.0:1746143129.097211:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30898:x1830962858594048:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 29141us (31823us total) trans 8589942335 rc 0/0 00000100:00100000:3.0:1746143129.097218:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8126 00000100:00100000:1.0:1746143129.097611:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861232640:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143129.097627:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143129.097648:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858594688:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5944us (8244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143129.097654:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6476 00000100:00100000:2.0:1746143129.100127:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858594304:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 33618us (33739us total) trans 21474840001 rc 0/0 00000100:00100000:2.0:1746143129.100136:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1961 00002000:00100000:2.0:1746143129.100144:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2707456->3145727) req@ffff880135180380 x1830962858594304/t21474840001(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:280/0 lens 488/448 e 0 to 0 dl 1746143140 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143129.100152:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180380 with x1830962858594304 ext(2707456->3145727) 00010000:00010000:2.0:1746143129.100160:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 18 pid: 10061 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143129.100176:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 18 pid: 10061 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143129.100183:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135180380 00000100:00100000:0.0:1746143129.101416:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143129.103109:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858595200 00000100:00100000:1.0:1746143129.103119:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858595200 00000100:00100000:1.0:1746143129.103169:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12253 00000100:00100000:1.0:1746143129.103176:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30898:x1830962858595200:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143129.103189:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143129.103205:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff65 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.103227:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.103234:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 12 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.103240:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.103242:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.103245:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1576960->1638399] (req 1576960->1638399) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.103272:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 12 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.103280:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 12 pid: 26949 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143129.103305:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861232768:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.103378:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.103386:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 17 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143129.103394:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861232896:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143129.103412:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.104424:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.104722:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858595456 00000100:00100000:3.0:1746143129.104727:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858595456 00002000:00100000:3.0:1746143129.104755:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2387968->2392063) req@ffff880093914e00 x1830962858595456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.104763:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093914e00 with x1830962858595456 ext(2387968->2392063) 00002000:00010000:3.0:1746143129.104767:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093914e00 00000100:00100000:3.0:1746143129.104787:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5948 00000100:00100000:3.0:1746143129.104792:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858595456:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143129.105193:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858595456:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 399us (770us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143129.105199:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5948 00002000:00100000:3.0:1746143129.105205:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2387968->2392063) req@ffff880093914e00 x1830962858595456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:280/0 lens 488/4536 e 0 to 0 dl 1746143140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.105211:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093914e00 with x1830962858595456 ext(2387968->2392063) 00002000:00010000:3.0:1746143129.105214:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093914e00 00000100:00100000:0.0:1746143129.110180:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.110251:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.110264:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.110285:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858595584 00000100:00100000:0.0:1746143129.110305:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858595584 00010000:00010000:0.0:1746143129.110336:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 18 pid: 10061 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143129.110398:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861232768:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143129.110409:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861232896:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143129.110438:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1576960->1638399] (req 1576960->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.110453:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdeea00, rc 0) 00000100:00100000:1.0:1746143129.110478:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858595968 00000100:00100000:1.0:1746143129.110482:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858595968 00000100:00100000:2.0:1746143129.110493:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30898:x1830962858595200:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7318us (9081us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.110500:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12253 00000100:00100000:2.0:1746143129.110586:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.112065:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858595712 00000100:00100000:0.0:1746143129.112072:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858595712 00010000:00010000:0.0:1746143129.112093:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 12 pid: 26949 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143129.112113:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858596096 00000100:00100000:0.0:1746143129.112115:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858596096 00010000:00010000:0.0:1746143129.112124:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 19 pid: 8450 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143129.112514:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6480 00000100:00100000:2.0:1746143129.112525:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858595584:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.112538:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.112559:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 19 pid: 10061 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143129.112570:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 19 pid: 10061 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143129.112590:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bcec00/0x25aee876ca70cd2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff42 expref: 19 pid: 10061 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143129.112966:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3425 00000100:00100000:1.0:1746143129.112976:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30894:x1830962858595968:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143129.113216:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:30894:x1830962858595968:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 242us (2963us total) trans 8589942336 rc 0/0 00000100:00100000:1.0:1746143129.113221:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3425 00000100:00100000:0.0:1746143129.113325:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6481 00000100:00100000:0.0:1746143129.113332:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858595712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.113341:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.113352:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 12 pid: 26949 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.113360:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 12 pid: 26949 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.113372:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1200/0x25aee876ca70cc9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee7 expref: 12 pid: 26949 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.113387:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.113404:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858595712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 73us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.113410:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6481 00000100:00100000:0.0:1746143129.113420:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6482 00000100:00100000:0.0:1746143129.113425:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858596096:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.113430:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.113437:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 18 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.113445:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 18 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.113454:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bce000/0x25aee876ca70cc94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fee0 expref: 18 pid: 8450 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143129.113463:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.113464:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.113470:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 10 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.113477:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 10 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.113504:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 10 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143129.113516:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093915c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861233024:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143129.113557:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df7f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143129.113821:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143129.113824:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143129.113830:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.113839:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.113859:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143129.113867:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861233152:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143129.113889:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143129.118934:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093915c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861233024:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143129.118955:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143129.118996:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1971:x1830962858596096:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5569us (8408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.119006:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6482 00000100:00100000:0.0:1746143129.119446:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.119477:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.119547:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858596352 00000100:00100000:3.0:1746143129.119554:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858596352 00002000:00100000:3.0:1746143129.119589:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1576960->1581055) req@ffff880093915f80 x1830962858596352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.119598:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915f80 with x1830962858596352 ext(1576960->1581055) 00002000:00010000:3.0:1746143129.119602:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093915f80 00000100:00100000:3.0:1746143129.119614:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858596608 00000100:00100000:3.0:1746143129.119617:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858596608 00002000:00100000:3.0:1746143129.119627:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093916300 x1830962858596608/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.119633:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093916300 with x1830962858596608 ext(4194304->5210111) 00002000:00010000:3.0:1746143129.119636:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093916300 00000100:00100000:3.0:1746143129.119654:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5949 00000100:00100000:3.0:1746143129.119661:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858596352:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143129.120010:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858596352:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 349us (565us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143129.120017:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5949 00002000:00100000:3.0:1746143129.120022:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1576960->1581055) req@ffff880093915f80 x1830962858596352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/4536 e 0 to 0 dl 1746143140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.120028:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915f80 with x1830962858596352 ext(1576960->1581055) 00002000:00010000:3.0:1746143129.120050:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093915f80 00000100:00100000:3.0:1746143129.120062:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5950 00000100:00100000:3.0:1746143129.120067:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858596608:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143129.121995:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861233152:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143129.122010:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143129.122046:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858595584:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9523us (11873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.122054:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6480 00000100:00100000:0.0:1746143129.132416:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.132487:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858596864 00000100:00100000:2.0:1746143129.132496:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858596864 00002000:00100000:2.0:1746143129.132535:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1634304->1638399) req@ffff880093916680 x1830962858596864/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143129.132544:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093916680 with x1830962858596864 ext(1634304->1638399) 00002000:00010000:2.0:1746143129.132548:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093916680 00000100:00100000:2.0:1746143129.132580:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5951 00000100:00100000:2.0:1746143129.132587:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858596864:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143129.132987:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858596864:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 399us (578us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143129.132993:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5951 00002000:00100000:2.0:1746143129.132999:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1634304->1638399) req@ffff880093916680 x1830962858596864/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/4536 e 0 to 0 dl 1746143140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143129.133006:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093916680 with x1830962858596864 ext(1634304->1638399) 00002000:00010000:2.0:1746143129.133009:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093916680 00000100:00100000:3.0:1746143129.142218:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858596608:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 22140us (22730us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143129.142230:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5950 00002000:00100000:3.0:1746143129.142242:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093916300 x1830962858596608/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/440 e 0 to 0 dl 1746143140 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.142252:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093916300 with x1830962858596608 ext(4194304->5210111) 00002000:00010000:3.0:1746143129.142257:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093916300 00000100:00100000:0.0:1746143129.149167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.149245:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858596992 00000100:00100000:2.0:1746143129.149254:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858596992 00000100:00100000:2.0:1746143129.149419:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12254 00000100:00100000:2.0:1746143129.149428:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858596992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143129.149443:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143129.149458:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7600/0x25aee876ca70cd66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff6c expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143129.149505:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861233280:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143129.149579:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c3c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746143129.154573:0:754:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143127 -> 1746143128 00002000:00010000:2.0:1746143129.154580:0:754:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143127 -> 1746143128 00000100:00100000:2.0:1746143129.154601:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861233280:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143129.154632:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7600/0x25aee876ca70cd66 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff6c expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.154646:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7600/0x25aee876ca70cd66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff6c expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.154675:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c7600, rc 0) 00000100:00100000:2.0:1746143129.154975:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858596992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5542us (5810us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143129.154983:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12254 00000100:00100000:0.0:1746143129.162555:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.163412:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858597120 00000100:00100000:2.0:1746143129.163421:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858597120 00000100:00100000:2.0:1746143129.165204:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12255 00000100:00100000:2.0:1746143129.165219:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858597120:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143129.165237:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143129.167956:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70cd6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff73 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143129.168043:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861233408:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143129.168143:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143129.173014:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861233408:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143129.173079:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70cd6d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff73 expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.173100:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70cd6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff73 expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.174760:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c7200, rc 0) 00000100:00100000:2.0:1746143129.174829:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858597120:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9612us (12279us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143129.174838:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12255 00000100:00100000:0.0:1746143129.185115:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.185588:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858597376 00000100:00100000:3.0:1746143129.185597:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858597376 00000100:00100000:3.0:1746143129.185644:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3426 00000100:00100000:3.0:1746143129.185652:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30884:x1830962858597376:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:3.0:1746143129.187333:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30884:x1830962858597376:12345-192.168.201.28@tcp:35:cat.0 Request processed in 1675us (2218us total) trans 8589942337 rc 0/0 00000100:00100000:3.0:1746143129.187342:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3426 00000100:00100000:0.0:1746143129.208437:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.209360:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858597504 00000100:00100000:3.0:1746143129.209369:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858597504 00000100:00100000:3.0:1746143129.209417:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8127 00000100:00100000:3.0:1746143129.209425:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30902:x1830962858597504:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.209449:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.209464:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cd74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff7a expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.209517:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.209529:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.209540:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.209552:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.209558:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.209563:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.209649:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.209661:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 13 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.209667:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.209693:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 13 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.209703:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 13 pid: 14796 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143129.209714:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861233536:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143129.211212:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.216082:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.216217:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861233536:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143129.216240:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:2.0:1746143129.217822:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858597760 00000100:00100000:2.0:1746143129.217831:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858597760 00000100:00100000:2.0:1746143129.219335:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3427 00000100:00100000:2.0:1746143129.219346:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:27541:x1830962858597760:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143129.221762:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:27541:x1830962858597760:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 2409us (5677us total) trans 8589942338 rc 0/0 00000100:00100000:2.0:1746143129.221774:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3427 00000100:00100000:0.0:1746143129.225215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.225333:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858597888 00000100:00100000:2.0:1746143129.225341:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858597888 00010000:00010000:2.0:1746143129.225547:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 15 pid: 14796 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143129.225571:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6483 00000100:00100000:2.0:1746143129.225578:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858597888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.225588:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.225593:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 15 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.225609:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 15 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.225629:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bcf400/0x25aee876ca70cd51 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff57 expref: 15 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.225641:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143129.225646:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.225654:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.225660:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.225775:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143129.226320:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.226327:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143129.226362:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143129.226366:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1746143129.228727:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858597888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3139us (3512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.228736:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6483 00000004:00010000:3.0:1746143129.229637:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229656:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229667:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229672:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229677:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229682:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093462200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143129.229685:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229692:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229703:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143129.229706:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143129.229710:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229714:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cd7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229745:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229750:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229754:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229758:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093462600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143129.229760:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229765:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229771:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531300) 00010000:00010000:3.0:1746143129.229774:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143129.229776:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229780:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093462600/0x25aee876ca70cd82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.229814:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093462c00/0x25aee876ca70cd74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.229824:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.229829:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.229831:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143129.229833:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1200, rc 0) 00000100:00100000:3.0:1746143129.229884:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30902:x1830962858597504:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 20459us (21457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143129.229890:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8127 00000100:00100000:0.0:1746143129.235356:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.235605:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858598016 00000100:00100000:2.0:1746143129.235613:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858598016 00000100:00100000:2.0:1746143129.235664:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12256 00000100:00100000:2.0:1746143129.235673:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858598016:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143129.235690:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143129.235704:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0c6000/0x25aee876ca70cd90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff81 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143129.235758:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861233664:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143129.235826:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.236141:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.236224:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.236247:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143129.236319:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858598144 00000100:00100000:1.0:1746143129.236324:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858598144 00000100:00100000:1.0:1746143129.236342:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858598272 00000100:00100000:1.0:1746143129.236344:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858598272 00000100:00100000:1.0:1746143129.236354:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858598400 00000100:00100000:1.0:1746143129.236355:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858598400 00000100:00100000:1.0:1746143129.236368:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12257 00000100:00100000:1.0:1746143129.236372:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858598144:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143129.236380:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143129.236387:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff88 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.236399:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.236400:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.236408:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.236423:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.236433:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c65a00, rc 0) 00000100:00100000:1.0:1746143129.236642:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858598144:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 268us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143129.236648:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12257 00000100:00100000:3.0:1746143129.236663:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12258 00000100:00100000:3.0:1746143129.237373:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858598272:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.237382:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.237392:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dc0400/0x25aee876ca70cd9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff8f expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143129.237697:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12259 00000100:00100000:1.0:1746143129.237705:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858598400:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143129.237712:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143129.237719:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff96 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.237735:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.237737:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.237966:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.237979:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.237987:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c65600, rc 0) 00000100:00100000:3.0:1746143129.238005:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861233792:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143129.238007:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858598400:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 304us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143129.238013:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12259 00000100:00100000:3.0:1746143129.238047:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.240601:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.240906:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858598528 00000100:00100000:3.0:1746143129.240913:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858598528 00000100:00100000:3.0:1746143129.240957:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12260 00000100:00100000:3.0:1746143129.240964:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858598528:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.240979:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.240991:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093462600/0x25aee876ca70cdac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ff9d expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143129.241047:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861233920:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143129.241106:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3480 going to sleep for 11 seconds 00002000:00010000:2.0:1746143129.251900:0:754:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143127 -> 1746143128 00002000:00010000:2.0:1746143129.251908:0:754:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143127 -> 1746143128 00002000:00010000:2.0:1746143129.251910:0:754:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143127 -> 1746143128 00000100:00100000:2.0:1746143129.251935:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861233664:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143129.251969:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0c6000/0x25aee876ca70cd90 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff81 expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.251983:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0c6000/0x25aee876ca70cd90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff81 expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.252282:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c6000, rc 0) 00002000:00010000:3.0:1746143129.252315:0:21048:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143126 -> 1746143128 00002000:00010000:3.0:1746143129.252318:0:21048:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143126 -> 1746143128 00002000:00010000:3.0:1746143129.252320:0:21048:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143127 -> 1746143128 00000100:00100000:3.0:1746143129.252334:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861233792:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143129.252341:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858598016:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 16670us (16993us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143129.252350:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12256 00010000:00010000:3.0:1746143129.252353:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dc0400/0x25aee876ca70cd9e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff8f expref: 11 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.252362:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dc0400/0x25aee876ca70cd9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff8f expref: 11 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.252381:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc0400, rc 0) 00000100:00100000:3.0:1746143129.252400:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858598272:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 15731us (16175us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143129.252406:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12258 00000100:00100000:3.0:1746143129.252636:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861233920:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143129.252651:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093462600/0x25aee876ca70cdac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff9d expref: 10 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.252660:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093462600/0x25aee876ca70cdac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff9d expref: 10 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.252667:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093462600, rc 0) 00000100:00100000:3.0:1746143129.252696:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858598528:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 11733us (12100us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143129.252775:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12260 00000100:00100000:0.0:1746143129.258567:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.258684:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858598784 00000100:00100000:3.0:1746143129.258697:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858598784 00000100:00100000:3.0:1746143129.258756:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8128 00000100:00100000:3.0:1746143129.258766:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30902:x1830962858598784:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.258788:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.258808:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cdb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffa4 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.258917:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.258932:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.258945:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.259344:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.259358:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 10 pid: 14796 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143129.259371:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861234048:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143129.259613:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143129.272403:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.272780:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861234048:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143129.272808:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:2.0:1746143129.272880:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858598912 00000100:00100000:2.0:1746143129.273105:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858598912 00010000:00010000:2.0:1746143129.273139:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 11 pid: 14796 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143129.273166:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6484 00000100:00100000:2.0:1746143129.273173:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858598912:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.273186:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.273193:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 11 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.273204:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 11 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.273227:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1200/0x25aee876ca70cd89 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff7a expref: 11 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.274404:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143129.274410:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.274420:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.274427:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.274455:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143129.274511:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858598912:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1336us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.274520:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6484 00010000:00010000:3.0:1746143129.274885:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.274893:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143129.274913:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143129.275457:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093462200/0x25aee876ca70cdb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffa4 expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.275558:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffa4 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.275566:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.275569:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143129.275572:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093463000, rc 0) 00000100:00100000:3.0:1746143129.275602:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30902:x1830962858598784:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 16838us (17042us total) trans 8589942339 rc 0/0 00000100:00100000:3.0:1746143129.275609:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8128 00000100:00100000:0.0:1746143129.277942:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.278024:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858599168 00000100:00100000:3.0:1746143129.279204:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858599168 00000100:00100000:3.0:1746143129.279263:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8129 00000100:00100000:3.0:1746143129.279271:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30902:x1830962858599168:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.279306:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.279310:0:14796:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143129.279335:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093463000/0x25aee876ca70cdba lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffa4 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.279352:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.279355:0:14796:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143129.279367:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1c00/0x25aee876ca70cdc8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffab expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.279455:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70cdcf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.279467:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70cdcf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.279476:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70cdcf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143129.279487:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143129.279594:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1c00/0x25aee876ca70cdc8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffab expref: 12 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.279608:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70cdcf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffab expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.279614:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.279617:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143129.279619:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1a00, rc 0) 00000100:00100000:3.0:1746143129.279682:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30902:x1830962858599168:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 411us (1747us total) trans 8589942340 rc 0/0 00000100:00100000:3.0:1746143129.279688:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8129 00000100:00100000:0.0:1746143129.285646:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.285736:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858599296 00000100:00100000:2.0:1746143129.285746:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858599296 00000100:00100000:2.0:1746143129.285800:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8130 00000100:00100000:2.0:1746143129.285807:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30902:x1830962858599296:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143129.285832:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143129.285850:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7a00/0x25aee876ca70cddd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffb2 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.285913:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7a00/0x25aee876ca70cddd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb2 expref: 12 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.285926:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7a00/0x25aee876ca70cddd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb2 expref: 12 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.285943:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143129.285945:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143129.285948:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c7a00, rc 0) 00000100:00100000:2.0:1746143129.285988:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30902:x1830962858599296:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 181us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.285994:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8130 00000100:00100000:0.0:1746143129.295185:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.296158:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.297062:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.297081:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.297104:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.297187:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.297227:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858599552 00000100:00100000:0.0:1746143129.297237:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858599552 00000100:00100000:0.0:1746143129.297276:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858599808 00000100:00100000:0.0:1746143129.297278:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858599808 00000100:00100000:0.0:1746143129.297306:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858600064 00000100:00100000:0.0:1746143129.297309:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858600064 00000100:00100000:0.0:1746143129.297320:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858599424 00000100:00100000:0.0:1746143129.297322:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858599424 00000100:00100000:0.0:1746143129.297332:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858599680 00000100:00100000:0.0:1746143129.297334:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858599680 00000100:00100000:0.0:1746143129.297345:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858599936 00000100:00100000:0.0:1746143129.297347:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858599936 00000100:00100000:0.0:1746143129.297359:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12261 00000100:00100000:0.0:1746143129.297368:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1970:x1830962858599552:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143129.297418:0:4756:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297438:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 14 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297446:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143129.297448:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143129.297451:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297489:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 14 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297503:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 14 pid: 26949 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143129.297516:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861234176:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143129.297588:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.297610:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12262 00000100:00100000:0.0:1746143129.297617:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1970:x1830962858599808:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143129.297638:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297648:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 10 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297654:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143129.297656:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143129.297658:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297673:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 10 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297682:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 10 pid: 754 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143129.297692:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861234304:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143129.297712:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.297728:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12263 00000100:00100000:0.0:1746143129.297733:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1970:x1830962858600064:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143129.297749:0:8449:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297759:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297764:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143129.297766:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143129.297768:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297783:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 23 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.297793:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 23 pid: 754 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143129.297800:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861234432:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143129.297820:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5df79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143129.298078:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12264 00000100:00100000:1.0:1746143129.298087:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1970:x1830962858599424:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143129.298106:0:8448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298117:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 10 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298124:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.298132:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 15 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298138:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.298140:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.298142:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298158:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 15 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298166:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 15 pid: 8169 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143129.298175:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861234560:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.298212:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.298220:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 12 pid: 754 timeout: 1011 lvb_type: 1 00000100:00100000:1.0:1746143129.298228:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861234688:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.298251:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 10 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298258:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 10 pid: 8169 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143129.298272:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861234816:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143129.298302:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143129.298320:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12265 00000100:00100000:1.0:1746143129.298326:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1970:x1830962858599680:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143129.298342:0:22204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298352:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298359:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.298367:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298372:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.298373:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143129.298375:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298389:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.298396:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 14 pid: 8450 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143129.298570:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12266 00000100:00100000:2.0:1746143129.298580:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1970:x1830962858599936:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143129.298598:0:26949:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.298608:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.298616:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.298621:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143129.298623:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143129.298625:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.298642:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143129.298650:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 12 pid: 8450 timeout: 1011 lvb_type: 1 00000100:00100000:2.0:1746143129.298658:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861235072:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143129.298690:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.298698:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 10 pid: 10061 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143129.298706:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861235200:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143129.298721:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143129.299028:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861234944:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.299082:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143129.299090:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 11 pid: 8450 timeout: 1011 lvb_type: 1 00000100:00100000:1.0:1746143129.299098:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861235328:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.299121:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.299129:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 23 pid: 8450 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143129.299136:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861235456:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143129.299150:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.329460:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861234432:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143129.329739:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143129.329800:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.329899:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861234176:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143129.329915:0:4756:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143129.329959:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861234560:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143129.330071:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861234304:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.330086:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143129.332181:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143129.332235:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861234944:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143129.332353:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861234688:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143129.332448:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861234816:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143129.332691:0:8448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143129.332743:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861235072:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143129.332752:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861235200:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.332766:0:26949:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143129.334128:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858600192 00000100:00100000:3.0:1746143129.334137:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858600192 00002000:00100000:3.0:1746143129.334186:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1302528->1912831) req@ffff88008fde9c00 x1830962858600192/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.334197:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fde9c00 with x1830962858600192 ext(1302528->1912831) 00010000:00010000:3.0:1746143129.334205:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 15 pid: 26949 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143129.334221:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 15 pid: 26949 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143129.334228:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fde9c00 00000100:00100000:3.0:1746143129.334247:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858600320 00000100:00100000:3.0:1746143129.334249:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858600320 00002000:00100000:3.0:1746143129.334264:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1576960->1638399) req@ffff88008fde9f80 x1830962858600320/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.334279:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fde9f80 with x1830962858600320 ext(1576960->1638399) 00010000:00010000:3.0:1746143129.334284:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 11 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143129.334305:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 11 pid: 754 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143129.334311:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fde9f80 00000100:00100000:3.0:1746143129.334326:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1962 00000100:00100000:3.0:1746143129.334334:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858600192:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143129.334967:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1963 00000100:00100000:3.0:1746143129.334973:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858600320:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143129.335392:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.335447:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.335468:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.335483:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858600704 00000100:00100000:0.0:1746143129.335486:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858600704 00010000:00010000:0.0:1746143129.335508:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 13 pid: 754 timeout: 1011 lvb_type: 1 00000100:00100000:0.0:1746143129.335524:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858600960 00000100:00100000:0.0:1746143129.335526:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858600960 00010000:00010000:0.0:1746143129.335534:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 14 pid: 8450 timeout: 1011 lvb_type: 1 00000100:00100000:0.0:1746143129.335546:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6485 00000100:00100000:0.0:1746143129.335551:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858600704:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.335559:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.335575:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 14 pid: 754 timeout: 1011 lvb_type: 1 00010000:00010000:0.0:1746143129.335586:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 14 pid: 754 timeout: 1011 lvb_type: 1 00010000:00010000:0.0:1746143129.335611:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1600/0x25aee876ca70cc2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe93 expref: 14 pid: 754 timeout: 1011 lvb_type: 1 00010000:00010000:0.0:1746143129.335630:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.335652:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858600704:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 100us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.335658:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6485 00000100:00100000:0.0:1746143129.335696:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6486 00000100:00100000:0.0:1746143129.335702:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858600960:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.335709:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.335720:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 12 pid: 8450 timeout: 1011 lvb_type: 1 00010000:00010000:0.0:1746143129.335729:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 12 pid: 8450 timeout: 1011 lvb_type: 1 00010000:00010000:0.0:1746143129.335740:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70cda5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff96 expref: 12 pid: 8450 timeout: 1011 lvb_type: 1 00010000:00010000:0.0:1746143129.335959:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.335976:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858600960:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 274us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.335982:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6486 00000100:00100000:0.0:1746143129.336059:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.336068:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858601216 00000100:00100000:0.0:1746143129.336071:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858601216 00010000:00010000:0.0:1746143129.336082:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 24 pid: 8450 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143129.336098:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6487 00000100:00100000:0.0:1746143129.336103:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858601216:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.336110:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.336121:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 24 pid: 8450 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336130:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 24 pid: 8450 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336143:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.336159:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858601216:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 56us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.336164:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6487 00000100:00100000:0.0:1746143129.336190:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.336200:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858600576 00000100:00100000:0.0:1746143129.336203:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858600576 00010000:00010000:0.0:1746143129.336214:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 16 pid: 8169 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143129.336229:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6488 00000100:00100000:0.0:1746143129.336233:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858600576:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.336238:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.336246:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 16 pid: 8169 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336255:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 16 pid: 8169 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336268:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ca1c00/0x25aee876ca70cbd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe5b expref: 16 pid: 8169 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336277:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.336307:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858600576:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 72us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.336313:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6488 00000100:00100000:0.0:1746143129.336338:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.336348:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858600832 00000100:00100000:0.0:1746143129.336350:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858600832 00010000:00010000:0.0:1746143129.336360:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 13 pid: 8169 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143129.336372:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6489 00000100:00100000:0.0:1746143129.336376:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858600832:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.336383:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.336390:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 13 pid: 8169 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336398:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 13 pid: 8169 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336411:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70cb9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe3f expref: 13 pid: 8169 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336420:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.336422:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.336426:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336434:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336453:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.336470:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858600832:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 93us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.336476:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6489 00000100:00100000:0.0:1746143129.336502:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.336510:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858601088 00000100:00100000:0.0:1746143129.336513:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858601088 00010000:00010000:0.0:1746143129.336522:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 12 pid: 10061 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143129.336533:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6490 00000100:00100000:0.0:1746143129.336538:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858601088:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.336543:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.336551:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 12 pid: 10061 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336558:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 12 pid: 10061 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336575:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bcf000/0x25aee876ca70cd3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff50 expref: 12 pid: 10061 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336584:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.336586:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.336588:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336595:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336610:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.336625:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858601088:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 87us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.336631:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6490 00000100:00100000:0.0:1746143129.336656:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.336666:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858601344 00000100:00100000:0.0:1746143129.336669:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858601344 00010000:00010000:0.0:1746143129.336679:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 12 pid: 8450 timeout: 1011 lvb_type: 1 00000100:00100000:0.0:1746143129.336690:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6491 00000100:00100000:0.0:1746143129.336694:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858601344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.336701:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.336708:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 12 pid: 8450 timeout: 1011 lvb_type: 1 00010000:00010000:0.0:1746143129.336721:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 12 pid: 8450 timeout: 1011 lvb_type: 1 00010000:00010000:0.0:1746143129.336733:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.336744:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858601344:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.336749:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6491 00000100:00100000:0.0:1746143129.336791:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.336802:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858601472 00000100:00100000:0.0:1746143129.336805:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858601472 00010000:00010000:0.0:1746143129.336816:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 17 pid: 8450 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143129.336827:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6492 00000100:00100000:0.0:1746143129.336831:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858601472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143129.336839:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143129.336846:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 17 pid: 8450 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336855:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 17 pid: 8450 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336866:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70cc6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164febd expref: 17 pid: 8450 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143129.336880:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.336881:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.336884:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336890:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336900:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143129.336911:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858601472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 79us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.336916:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6492 00010000:00010000:0.0:1746143129.336950:0:26949:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336958:0:26949:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336977:0:26949:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336985:0:26949:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.336992:0:26949:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337005:0:26949:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a0c6a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143129.337009:0:26949:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337016:0:26949:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337026:0:26949:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337055:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0c6a00/0x25aee876ca70ce07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143129.337091:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858599936:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 38513us (39904us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.337097:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12266 00010000:00010000:0.0:1746143129.337143:0:8448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337149:0:8448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337163:0:8448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337169:0:8448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337175:0:8448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337180:0:8448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135c64000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143129.337183:0:8448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337188:0:8448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337197:0:8448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.337202:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135c64000/0x25aee876ca70cdf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143129.337227:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858599424:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 39142us (40145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.337280:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858600448 00000100:00100000:2.0:1746143129.337285:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858600448 00002000:00100000:2.0:1746143129.337320:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2392063) req@ffff88008fdea300 x1830962858600448/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:280/0 lens 488/0 e 0 to 0 dl 1746143140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143129.337328:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fdea300 with x1830962858600448 ext(2097152->2392063) 00010000:00010000:2.0:1746143129.337334:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 24 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.337343:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 24 pid: 754 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143129.337349:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fdea300 00000100:00100000:2.0:1746143129.337363:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1964 00000100:00100000:2.0:1746143129.337367:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858600448:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143129.337643:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12264 00010000:00010000:1.0:1746143129.337756:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70cd97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff88 expref: 11 pid: 8450 timeout: 1011 lvb_type: 1 00000100:00100000:1.0:1746143129.337984:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861235328:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.337997:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc0200/0x25aee876ca70cc4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164feaf expref: 25 pid: 8450 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143129.338007:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861235456:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143129.338070:0:22204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338078:0:22204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338085:0:22204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338099:0:22204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338105:0:22204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338112:0:22204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338117:0:22204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135c64a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143129.338120:0:22204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338127:0:22204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338138:0:22204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.338145:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135c64a00/0x25aee876ca70ce00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143129.338188:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858599680:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 39862us (41082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143129.338194:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12265 00000100:00100000:2.0:1746143129.359824:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858600320:12345-192.168.201.28@tcp:4:cat.0 Request processed in 24838us (27635us total) trans 21474840002 rc 0/0 00000100:00100000:2.0:1746143129.359837:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1963 00002000:00100000:2.0:1746143129.359848:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1576960->1638399) req@ffff88008fde9f80 x1830962858600320/t21474840002(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/448 e 0 to 0 dl 1746143140 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143129.359858:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fde9f80 with x1830962858600320 ext(1576960->1638399) 00010000:00010000:2.0:1746143129.359869:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 11 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.359889:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 11 pid: 754 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143129.359896:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fde9f80 00000100:00100000:3.0:1746143129.364261:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858600192:12345-192.168.201.28@tcp:4:cat.0 Request processed in 29916us (34451us total) trans 17179872743 rc 0/0 00000100:00100000:3.0:1746143129.364274:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1962 00002000:00100000:3.0:1746143129.364284:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1302528->1912831) req@ffff88008fde9c00 x1830962858600192/t17179872743(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:280/0 lens 488/448 e 0 to 0 dl 1746143140 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143129.364306:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fde9c00 with x1830962858600192 ext(1302528->1912831) 00010000:00010000:3.0:1746143129.364318:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143129.364332:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143129.364345:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fde9c00 00000100:00100000:2.0:1746143129.371865:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858600448:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 34484us (36461us total) trans 17179872744 rc 0/0 00000100:00100000:2.0:1746143129.371882:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1964 00000100:00100000:0.0:1746143129.371884:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143129.371894:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2392063) req@ffff88008fdea300 x1830962858600448/t17179872744(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:280/0 lens 488/448 e 0 to 0 dl 1746143140 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143129.371904:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fdea300 with x1830962858600448 ext(2097152->2392063) 00010000:00010000:2.0:1746143129.371916:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 25 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.371930:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 25 pid: 754 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143129.371938:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fdea300 00000100:00100000:3.0:1746143129.372001:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858601600 00000100:00100000:3.0:1746143129.372010:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858601600 00010000:00010000:3.0:1746143129.372056:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 11 pid: 754 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143129.372087:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6493 00000100:00100000:3.0:1746143129.372098:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858601600:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143129.372111:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143129.372132:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 11 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143129.372141:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 11 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143129.372164:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70cd5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1638399) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff65 expref: 11 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143129.372183:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.372185:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.372190:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.372199:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.372227:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143129.372249:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858601600:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 152us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143129.372255:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6493 00010000:00010000:1.0:1746143129.373215:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.373225:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.373246:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.373253:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.373260:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.373267:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fdee400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143129.373270:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.373277:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.373299:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143129.373306:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdee400/0x25aee876ca70cdeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143129.373362:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858599808:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 75745us (77204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143129.373370:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12262 00000100:00100000:0.0:1746143129.374935:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.375665:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858601728 00000100:00100000:2.0:1746143129.375673:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858601728 00010000:00010000:2.0:1746143129.375807:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143129.375833:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6494 00000100:00100000:2.0:1746143129.375839:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858601728:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.375856:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.375885:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.375895:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.375914:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497000/0x25aee876ca70cd0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1912831) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff1f expref: 16 pid: 26949 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.375941:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143129.375943:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143129.375948:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.375956:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.375973:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143129.375988:0:4756:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.375994:0:4756:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.376013:0:4756:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.376026:0:4756:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.376050:0:4756:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.376057:0:4756:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b4c200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143129.376061:0:4756:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.376067:0:4756:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.376075:0:4756:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.376081:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b4c200/0x25aee876ca70cde4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143129.376140:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858599552:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 78773us (80968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.376149:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12261 00000100:00100000:2.0:1746143129.376178:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858601728:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 339us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.376184:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6494 00000100:00100000:0.0:1746143129.383638:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.383722:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858601856 00000100:00100000:2.0:1746143129.383731:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858601856 00010000:00010000:2.0:1746143129.383777:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 25 pid: 754 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143129.383818:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6495 00000100:00100000:2.0:1746143129.383825:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858601856:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.383840:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.383867:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 25 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.383885:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 25 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.383908:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdef200/0x25aee876ca70cd43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ff5e expref: 25 pid: 754 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.383931:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143129.383933:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143129.383938:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.383951:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143129.383980:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143129.384028:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858601856:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 198us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.384058:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6495 00010000:00010000:0.0:1746143129.384242:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.384251:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.384273:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.384294:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.384302:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.384309:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fdee200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143129.384313:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.384326:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.384336:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.384343:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdee200/0x25aee876ca70cdf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143129.384406:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858600064:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 86672us (87344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.384414:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12263 00000100:00100000:1.0:1746143129.390246:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.390347:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858602112 00000100:00100000:3.0:1746143129.390358:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858602112 00000100:00100000:3.0:1746143129.390417:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8131 00000100:00100000:3.0:1746143129.390426:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30902:x1830962858602112:12345-192.168.201.28@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143129.390479:0:14796:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143129.390507:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0c7a00/0x25aee876ca70cddd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb2 expref: 12 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.390539:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.390544:0:14796:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143129.390573:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.390585:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 13 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.390593:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.390599:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.390606:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 6/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.390637:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.390650:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 201 pid: 14795 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143129.390663:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861235584:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143129.390751:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.390759:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 13 pid: 14794 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143129.390766:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861235712:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143129.390791:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 13 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.390797:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 13 pid: 14796 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143129.390803:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861235840:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143129.390819:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143129.394496:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861235584:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143129.394512:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861235712:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143129.394520:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861235840:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143129.394544:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143129.402839:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.402883:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.402914:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858602240 00000100:00100000:3.0:1746143129.402924:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858602240 00010000:00010000:3.0:1746143129.402961:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 202 pid: 14795 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143129.403001:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858602496 00000100:00100000:0.0:1746143129.403001:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.403003:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858602496 00010000:00010000:3.0:1746143129.403131:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 14 pid: 14796 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143129.404004:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858602368 00000100:00100000:2.0:1746143129.404009:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858602368 00010000:00010000:2.0:1746143129.404050:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 15 pid: 14794 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143129.404068:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6496 00000100:00100000:2.0:1746143129.404079:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:1969:x1830962858602240:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.404094:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.404101:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 202 pid: 14795 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404111:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 202 pid: 14795 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404137:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390000/0x25aee876ca70cc08 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe85 expref: 202 pid: 14795 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404158:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143129.404165:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.404172:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143129.404209:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858602240:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 135us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.404215:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6496 00000100:00100000:2.0:1746143129.404228:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6497 00000100:00100000:2.0:1746143129.404232:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858602496:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.404237:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.404241:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 15 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404248:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 15 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404256:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca0000/0x25aee876ca70cbec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe69 expref: 15 pid: 14796 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404263:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143129.404265:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.404269:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143129.404278:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858602496:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 46us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.404282:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6497 00000100:00100000:2.0:1746143129.404301:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6498 00000100:00100000:2.0:1746143129.404306:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858602368:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143129.404311:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143129.404315:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 13 pid: 14794 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404323:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 13 pid: 14794 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404333:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ca1000/0x25aee876ca70cc01 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fe7e expref: 13 pid: 14794 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143129.404346:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143129.404349:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.404355:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.404361:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.404379:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143129.404584:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858602368:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 277us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143129.404590:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6498 00010000:00010000:0.0:1746143129.404657:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143129.404665:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000040:00080000:3.0:1746143129.406266:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2360, 88 off200392 00000004:00080000:3.0:1746143129.406278:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246245872ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406333:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2380, 88 off201888 00000004:00080000:3.0:1746143129.406338:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 911246306538ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143129.406417:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2381, 88 off201976 00000004:00080000:3.0:1746143129.406422:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 911246390005ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143129.406644:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2361, 88 off200480 00000004:00080000:3.0:1746143129.406648:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246616905ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406668:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2362, 88 off200568 00000004:00080000:3.0:1746143129.406671:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246639745ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406678:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2382, 88 off202064 00000004:00080000:3.0:1746143129.406681:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 911246649642ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143129.406702:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2383, 88 off202152 00000004:00080000:3.0:1746143129.406705:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 911246673688ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143129.406711:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2384, 88 off202240 00000004:00080000:3.0:1746143129.406714:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 911246682280ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143129.406721:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2363, 88 off200656 00000004:00080000:3.0:1746143129.406723:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246691672ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406731:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2385, 88 off202328 00000004:00080000:3.0:1746143129.406735:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 911246703328ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143129.406744:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2364, 88 off200744 00000004:00080000:3.0:1746143129.406747:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246716000ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406753:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2386, 88 off202416 00000004:00080000:3.0:1746143129.406756:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 911246724185ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143129.406763:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2365, 88 off200832 00000004:00080000:3.0:1746143129.406767:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246735872ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406773:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2366, 88 off200920 00000004:00080000:3.0:1746143129.406776:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246744207ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406781:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2367, 88 off201008 00000004:00080000:3.0:1746143129.406783:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246752045ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406789:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2368, 88 off201096 00000004:00080000:3.0:1746143129.406791:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 911246759865ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143129.406796:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2387, 88 off202504 00000004:00080000:3.0:1746143129.406798:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 911246766745ns, next at 860119223596ns, rc = 0 00000001:00080000:1.0:1746143129.460103:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942341 is committed 00000004:00080000:1.0:1746143129.460115:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1805 committed 00000004:00080000:1.0:1746143129.460121:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1791 committed 00000004:00080000:1.0:1746143129.460127:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1790 committed 00000004:00080000:1.0:1746143129.460129:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1789 committed 00000004:00080000:1.0:1746143129.460131:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1788 committed 00000004:00080000:1.0:1746143129.460133:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1804 committed 00000004:00080000:1.0:1746143129.460135:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1787 committed 00000004:00080000:1.0:1746143129.460136:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1803 committed 00000004:00080000:1.0:1746143129.460138:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1786 committed 00000004:00080000:1.0:1746143129.460140:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1802 committed 00000004:00080000:1.0:1746143129.460141:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1801 committed 00000004:00080000:1.0:1746143129.460142:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1800 committed 00000004:00080000:1.0:1746143129.460144:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1785 committed 00000004:00080000:1.0:1746143129.460145:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1784 committed 00000004:00080000:1.0:1746143129.460147:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1799 committed 00000004:00080000:1.0:1746143129.460149:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1798 committed 00000004:00080000:1.0:1746143129.460150:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1783 committed 00000001:00080000:1.0:1746143129.460158:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942336 is committed 00000001:00080000:1.0:1746143129.460168:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942338 is committed 00000100:00100000:1.0:1746143129.460352:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861235968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.460424:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143129.460467:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861236480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.460482:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143129.460498:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143129.460503:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861236352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.460515:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143129.460522:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861236864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.460534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143129.460553:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861235968 00000100:00100000:1.0:1746143129.460560:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861235968 00000100:00100000:1.0:1746143129.460595:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861236480 00000100:00100000:1.0:1746143129.460598:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861236480 00000100:00100000:1.0:1746143129.460606:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861236352 00000100:00100000:1.0:1746143129.460607:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861236352 00000100:00100000:1.0:1746143129.460614:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861236864 00000100:00100000:1.0:1746143129.460615:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861236864 00000100:00100000:1.0:1746143129.460626:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12267 00000100:00100000:1.0:1746143129.460632:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3300:x1830962861235968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.460840:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3300:x1830962861235968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (417us total) trans 21474840003 rc 0/0 00000100:00100000:1.0:1746143129.460847:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12267 00000100:00100000:1.0:1746143129.460860:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12268 00000100:00100000:1.0:1746143129.460865:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3300:x1830962861236480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.460945:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3300:x1830962861236480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (461us total) trans 21474840004 rc 0/0 00000100:00100000:1.0:1746143129.460950:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12268 00000100:00100000:1.0:1746143129.460958:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12269 00000100:00100000:1.0:1746143129.460962:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3300:x1830962861236352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.461065:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3300:x1830962861236352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (548us total) trans 21474840005 rc 0/0 00000100:00100000:1.0:1746143129.461071:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12269 00000100:00100000:1.0:1746143129.461080:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12270 00000100:00100000:1.0:1746143129.461084:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3300:x1830962861236864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.461166:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3300:x1830962861236864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (629us total) trans 21474840006 rc 0/0 00000100:00100000:1.0:1746143129.461171:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12270 00000004:00080000:1.0:1746143129.461213:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135180a80/2, rc 0, transno 21474840005 00000100:00100000:1.0:1746143129.461221:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861236352:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143129.461228:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135183480/2, rc 0, transno 21474840006 00000100:00100000:1.0:1746143129.461230:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861236864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143129.461236:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135182d80/2, rc 0, transno 21474840003 00000100:00100000:1.0:1746143129.461239:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861235968:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143129.461244:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135181880/2, rc 0, transno 21474840004 00000100:00100000:1.0:1746143129.461247:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861236480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.461272:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861236992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.461305:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143129.461329:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861236992 00000100:00100000:1.0:1746143129.461332:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861236992 00000004:00010000:2.0:1746143129.461789:0:14796:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880135180000 reply state ffff8800905b5c00 transno 8589942341 ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:2.0:1746143129.461801:0:14796:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746143129.461890:0:14796:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143129.461904:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30902:x1830962858602112:12345-192.168.201.28@tcp:36:mirror_io.0 Request processed in 71477us (71668us total) trans 8589942341 rc 0/0 00000100:00100000:2.0:1746143129.461911:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8131 00000100:00100000:2.0:1746143129.462009:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861236224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143129.462052:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143129.462067:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861236736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143129.462083:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143129.462095:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143129.462100:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861236096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143129.462114:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143129.462123:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861236608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143129.462137:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1746143129.462153:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746143129.462164:0:3285:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.462172:0:3285:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.462179:0:3285:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.462185:0:3285:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093244c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143129.462189:0:3285:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.462196:0:3285:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.462211:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143129.462214:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143129.462218:0:3285:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143129.462223:0:3285:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70ce0e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00000100:00100000:2.0:1746143129.462241:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861236224 00000100:00100000:3.0:1746143129.462412:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861236736 00000100:00100000:3.0:1746143129.462416:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861236736 00000100:00100000:3.0:1746143129.462436:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861236096 00000100:00100000:3.0:1746143129.462438:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861236096 00000100:00100000:3.0:1746143129.462448:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861236608 00000100:00100000:3.0:1746143129.462449:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861236608 00000100:00100000:3.0:1746143129.462462:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12271 00000100:00100000:3.0:1746143129.462467:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3302:x1830962861236736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143129.462557:0:8448:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143129.462560:0:8448:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143129.462562:0:8448:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143129.462564:0:8448:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143129.462565:0:8448:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143129.462592:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3302:x1830962861236736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (507us total) trans 21474840007 rc 0/0 00000100:00100000:3.0:1746143129.462601:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12271 00000100:00100000:3.0:1746143129.462611:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12272 00000100:00100000:3.0:1746143129.462615:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3302:x1830962861236096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143129.462698:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3302:x1830962861236096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (583us total) trans 21474840008 rc 0/0 00000100:00100000:3.0:1746143129.462703:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12272 00000100:00100000:3.0:1746143129.462713:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12273 00000100:00100000:3.0:1746143129.462718:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3302:x1830962861236608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143129.462794:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3302:x1830962861236608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (656us total) trans 21474840009 rc 0/0 00000100:00100000:3.0:1746143129.462800:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12273 00000100:00100000:2.0:1746143129.463433:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861236224 00000100:00100000:2.0:1746143129.463459:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12274 00000100:00100000:2.0:1746143129.463465:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3302:x1830962861236224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143129.463582:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3302:x1830962861236224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (1530us total) trans 21474840010 rc 0/0 00000100:00100000:2.0:1746143129.463589:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12274 00000004:00080000:2.0:1746143129.463635:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135182680/2, rc 0, transno 21474840008 00000100:00100000:2.0:1746143129.463640:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861236096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143129.463649:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135181500/2, rc 0, transno 21474840009 00000100:00100000:2.0:1746143129.463652:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861236608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143129.463658:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135180e00/2, rc 0, transno 21474840010 00000100:00100000:2.0:1746143129.463661:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861236224:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143129.463667:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135182a00/2, rc 0, transno 21474840007 00000100:00100000:2.0:1746143129.463670:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861236736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143129.464176:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861237376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143129.464209:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143129.464237:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861237888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143129.464254:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143129.464266:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143129.464270:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fdeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861237504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143129.464283:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143129.464302:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861238016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143129.464318:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143129.464336:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861237376 00000100:00100000:0.0:1746143129.464339:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861237376 00000100:00100000:0.0:1746143129.464361:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861237888 00000100:00100000:0.0:1746143129.464362:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861237888 00000100:00100000:0.0:1746143129.464371:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861237504 00000100:00100000:0.0:1746143129.464373:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861237504 00000100:00100000:0.0:1746143129.464379:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861238016 00000100:00100000:0.0:1746143129.464381:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861238016 00000100:00100000:0.0:1746143129.464387:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12275 00000100:00100000:0.0:1746143129.464391:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830962861237376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143129.464510:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3299:x1830962861237376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (300us total) trans 17179872745 rc 0/0 00000100:00100000:0.0:1746143129.464515:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12275 00000100:00100000:0.0:1746143129.464523:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12276 00000100:00100000:0.0:1746143129.464527:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830962861237888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143129.464588:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3299:x1830962861237888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (332us total) trans 17179872746 rc 0/0 00000100:00100000:0.0:1746143129.464592:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12276 00000100:00100000:0.0:1746143129.464599:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12277 00000100:00100000:0.0:1746143129.464602:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830962861237504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143129.464667:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3299:x1830962861237504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (383us total) trans 17179872747 rc 0/0 00000100:00100000:0.0:1746143129.464672:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12277 00000100:00100000:0.0:1746143129.464679:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12278 00000100:00100000:0.0:1746143129.464682:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830962861238016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143129.464966:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3299:x1830962861238016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 282us (647us total) trans 17179872748 rc 0/0 00000100:00100000:0.0:1746143129.464971:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12278 00000004:00080000:0.0:1746143129.464995:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fdeb100/2, rc 0, transno 17179872747 00000100:00100000:0.0:1746143129.464999:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fdeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861237504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143129.465007:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fde9500/2, rc 0, transno 17179872748 00000100:00100000:0.0:1746143129.465010:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861238016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143129.465016:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fdead80/2, rc 0, transno 17179872745 00000100:00100000:0.0:1746143129.465019:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861237376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143129.465024:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fde9880/2, rc 0, transno 17179872746 00000100:00100000:0.0:1746143129.465026:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861237888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.465587:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861237120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.465619:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143129.465644:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861237632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.465661:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143129.465674:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143129.465678:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fdeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861237248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.465694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143129.465705:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861237760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.465718:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143129.465737:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861237120 00000100:00100000:3.0:1746143129.465741:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861237120 00000100:00100000:3.0:1746143129.465758:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861237632 00000100:00100000:3.0:1746143129.465760:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861237632 00000100:00100000:3.0:1746143129.465766:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861237248 00000100:00100000:3.0:1746143129.465768:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861237248 00000100:00100000:3.0:1746143129.465775:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861237760 00000100:00100000:3.0:1746143129.465776:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861237760 00000100:00100000:3.0:1746143129.465785:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12279 00000100:00100000:3.0:1746143129.465790:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962861237120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.466116:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861237120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 325us (496us total) trans 17179872749 rc 0/0 00000100:00100000:3.0:1746143129.466122:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12279 00000100:00100000:3.0:1746143129.466135:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12280 00000100:00100000:3.0:1746143129.466140:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962861237632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.466218:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861237632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (555us total) trans 17179872750 rc 0/0 00000100:00100000:3.0:1746143129.466223:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12280 00000100:00100000:3.0:1746143129.466232:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12281 00000100:00100000:3.0:1746143129.466236:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962861237248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.466326:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861237248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (631us total) trans 17179872751 rc 0/0 00000100:00100000:3.0:1746143129.466331:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12281 00000100:00100000:3.0:1746143129.466340:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12282 00000100:00100000:3.0:1746143129.466344:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962861237760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143129.466411:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861237760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (691us total) trans 17179872752 rc 0/0 00000100:00100000:3.0:1746143129.466416:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12282 00000004:00080000:3.0:1746143129.466438:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fdeaa00/2, rc 0, transno 17179872751 00000100:00100000:3.0:1746143129.466442:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fdeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861237248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143129.466449:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fdeb800/2, rc 0, transno 17179872752 00000100:00100000:3.0:1746143129.466452:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861237760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143129.466458:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fde8a80/2, rc 0, transno 17179872749 00000100:00100000:3.0:1746143129.466461:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861237120:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143129.466466:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fdeb480/2, rc 0, transno 17179872750 00000100:00100000:3.0:1746143129.466468:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861237632:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1746143129.466739:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143129.467266:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12283 00000100:00100000:1.0:1746143129.467274:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3300:x1830962861236992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143129.467416:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3300:x1830962861236992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (6109us total) trans 21474840011 rc 0/0 00000100:00100000:1.0:1746143129.467422:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12283 00000004:00080000:1.0:1746143129.467449:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb55f80/2, rc 0, transno 21474840011 00000100:00100000:1.0:1746143129.467453:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861236992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143129.468170:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.468993:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858602624 00000100:00100000:3.0:1746143129.469000:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858602624 00000100:00100000:3.0:1746143129.469051:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8132 00000100:00100000:3.0:1746143129.469058:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30902:x1830962858602624:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.469079:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.469098:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffb9 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.469153:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.469167:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.469186:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.469189:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143129.469193:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb2600, rc 0) 00000100:00100000:3.0:1746143129.469235:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30902:x1830962858602624:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 177us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143129.469241:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8132 00000100:00100000:3.0:1746143129.480487:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.481858:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858602752 00000100:00100000:2.0:1746143129.481871:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858602752 00000100:00100000:3.0:1746143129.483735:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8133 00000100:00100000:3.0:1746143129.483749:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30902:x1830962858602752:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.483772:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.483795:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70ce1c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffc0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.483935:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.483949:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.483961:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143129.483988:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143129.483992:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143129.484008:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143129.484032:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb3800/0x25aee876ca70ce1c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.484065:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143129.484073:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143129.484075:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143129.484078:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eb2a00, rc 0) 00000100:00100000:3.0:1746143129.484139:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30902:x1830962858602752:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 393us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143129.484149:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8133 00000100:00100000:0.0:1746143129.499423:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.499529:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.500993:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143129.501025:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143129.501703:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858602880 00000100:00100000:2.0:1746143129.501713:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858602880 00000100:00100000:3.0:1746143129.502652:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858603136 00000100:00100000:3.0:1746143129.502657:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858603136 00000100:00100000:3.0:1746143129.502683:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858603008 00000100:00100000:3.0:1746143129.502685:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858603008 00000100:00100000:3.0:1746143129.502696:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858603264 00000100:00100000:3.0:1746143129.502698:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858603264 00000100:00100000:3.0:1746143129.502715:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12284 00000100:00100000:3.0:1746143129.502927:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858602880:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.502947:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.502970:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffc7 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143129.502997:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x68140796, atime: 0x68140796, ctime: 0x68140797, blocks: 0x7cd 00010000:00010000:3.0:1746143129.503017:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.503019:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.503044:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.503062:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.503075:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c65600, rc 0) 00000100:00100000:3.0:1746143129.503123:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858602880:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 402us (3711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143129.503123:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.503130:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12284 00000100:00100000:3.0:1746143129.503144:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858603520 00000100:00100000:3.0:1746143129.503147:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858603520 00000100:00100000:3.0:1746143129.503162:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12285 00000100:00100000:3.0:1746143129.503166:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858603136:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143129.503174:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.503185:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffd5 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143129.503200:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x68140797, atime: 0x68140796, ctime: 0x68140797, blocks: 0x821 00010000:00010000:3.0:1746143129.503210:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.503212:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.503216:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.503226:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.503233:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c64800, rc 0) 00000100:00100000:0.0:1746143129.503237:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143129.503251:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858603136:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 84us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143129.503257:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12285 00000100:00100000:3.0:1746143129.503268:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858603392 00000100:00100000:3.0:1746143129.503270:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858603392 00000100:00100000:0.0:1746143129.503281:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12286 00000100:00100000:0.0:1746143129.503302:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858603008:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143129.503309:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143129.503317:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffce expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143129.503330:0:8169:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x68140798, atime: 0x68140796, ctime: 0x68140797, blocks: 0x821 00010000:00010000:0.0:1746143129.503337:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143129.503339:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12287 00010000:00010000:0.0:1746143129.503344:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143129.503345:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858603264:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143129.503348:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.503351:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143129.503358:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffdc expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.503578:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143129.503587:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdee800, rc 0) 00002000:00010000:3.0:1746143129.503588:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x68140798, atime: 0x68140796, ctime: 0x68140798, blocks: 0x81f 00010000:00010000:3.0:1746143129.503598:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.503599:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.503603:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143129.503606:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858603008:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 306us (2616us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143129.503612:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143129.503612:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12286 00010000:00010000:3.0:1746143129.503618:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c65000, rc 0) 00000100:00100000:0.0:1746143129.503622:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12288 00000100:00100000:0.0:1746143129.503626:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858603520:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143129.503632:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858603264:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 288us (2607us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143129.503632:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143129.503637:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12287 00010000:00010000:0.0:1746143129.503639:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffea expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143129.503645:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12289 00000100:00100000:3.0:1746143129.503649:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858603392:12345-192.168.201.28@tcp:101:mirror_io.0 00002000:00010000:0.0:1746143129.503650:0:8169:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x68140798, atime: 0x68140797, ctime: 0x68140798, blocks: 0x1029 00010000:00010000:3.0:1746143129.503653:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143129.503657:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.503659:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.503660:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffe3 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143129.503662:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143129.503670:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x68140797, atime: 0x68140797, ctime: 0x68140797, blocks: 0x180b 00010000:00010000:0.0:1746143129.503671:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143129.503676:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143129.503677:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143129.503678:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdee600, rc 0) 00010000:00010000:3.0:1746143129.503680:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143129.503691:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858603520:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 65us (570us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143129.503694:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143129.503696:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12288 00010000:00010000:3.0:1746143129.503701:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c65400, rc 0) 00000100:00100000:3.0:1746143129.503713:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858603392:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 63us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143129.503717:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12289 00010000:00010000:0.0:1746143129.515310:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143130.517547:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143130.527150:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.527206:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143130.528021:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858603904 00000100:00100000:3.0:1746143130.528050:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858603904 00000100:00100000:3.0:1746143130.528123:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858604032 00000100:00100000:3.0:1746143130.528126:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858604032 00000100:00100000:3.0:1746143130.528148:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5952 00000100:00100000:3.0:1746143130.528157:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858603904:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143130.528195:0:31431:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.528210:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143130.528212:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143130.528218:0:31431:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.528231:0:31431:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143130.529360:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5953 00000100:00100000:2.0:1746143130.529373:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858604032:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143130.529395:0:21522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.529403:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143130.529405:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143130.529408:0:21522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.529421:0:21522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143130.531661:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143130.531669:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143130.532120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.532145:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.532169:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858604416 00000100:00100000:0.0:1746143130.532177:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858604416 00000100:00100000:0.0:1746143130.532225:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858604544 00000100:00100000:0.0:1746143130.532226:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858604544 00000100:00100000:0.0:1746143130.532242:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5954 00000100:00100000:0.0:1746143130.532249:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1971:x1830962858604416:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143130.532292:0:8454:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.532307:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.532309:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.532314:0:8454:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.532325:0:8454:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143130.532548:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5955 00000100:00100000:1.0:1746143130.532556:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1971:x1830962858604544:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143130.532580:0:31806:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.532593:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143130.532595:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143130.532599:0:31806:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.532608:0:31806:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143130.554358:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.554601:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.554611:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858604800 00000100:00100000:2.0:1746143130.554621:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858604800 00000100:00100000:1.0:1746143130.554621:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.554649:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.554683:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858605056 00000100:00100000:2.0:1746143130.554685:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858605056 00000100:00100000:1.0:1746143130.554694:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858605312 00000100:00100000:1.0:1746143130.554698:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858605312 00000100:00100000:2.0:1746143130.554699:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858605568 00000100:00100000:2.0:1746143130.554701:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858605568 00000100:00100000:2.0:1746143130.554717:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5956 00000100:00100000:2.0:1746143130.554724:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:1971:x1830962858604800:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143130.554764:0:31430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.554782:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143130.554785:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143130.554792:0:31430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.554805:0:31430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143130.558253:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5957 00000100:00100000:1.0:1746143130.558281:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:1971:x1830962858605056:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143130.558332:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.558346:0:21520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143130.558348:0:21520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143130.558353:0:21520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143130.558354:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5958 00000100:00100000:3.0:1746143130.558363:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:1971:x1830962858605568:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143130.558365:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.558382:0:31432:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.558389:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143130.558391:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143130.558394:0:31432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.558402:0:31432:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143130.558563:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5959 00000100:00100000:0.0:1746143130.558572:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:1971:x1830962858605312:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143130.558593:0:21521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.558606:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.558608:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.558612:0:21521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.558620:0:21521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.573188:0:21522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.573207:0:21522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.573215:0:21522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.573222:0:21522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093462e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143130.573226:0:21522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.573235:0:21522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.573255:0:21522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.573280:0:21522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093462e00/0x25aee876ca70ce5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143130.573400:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:1971:x1830962858604032:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 44025us (46186us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143130.573411:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5953 00010000:00010000:2.0:1746143130.585257:0:8454:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.585288:0:8454:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.585303:0:8454:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.585310:0:8454:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fdeea00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143130.585315:0:8454:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.585324:0:8454:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.585347:0:8454:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.585353:0:8454:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdeea00/0x25aee876ca70ce62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143130.585446:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1971:x1830962858604416:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 53191us (53326us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143130.585456:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5954 00010000:00010000:3.0:1746143130.601869:0:31431:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.601888:0:31431:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.601897:0:31431:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.601903:0:31431:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135c65a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143130.601907:0:31431:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.601915:0:31431:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.601934:0:31431:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.601940:0:31431:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135c65a00/0x25aee876ca70ce54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143130.602080:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:1971:x1830962858603904:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 73918us (74934us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143130.602091:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5952 00010000:00010000:3.0:1746143130.607407:0:31806:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.607619:0:31806:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.607628:0:31806:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.607635:0:31806:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ba5c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143130.607640:0:31806:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.607648:0:31806:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.607667:0:31806:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.607673:0:31806:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ba5c00/0x25aee876ca70ce69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143130.607751:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1971:x1830962858604544:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 75190us (75598us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143130.607762:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5955 00010000:00010000:3.0:1746143130.629170:0:31430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.629189:0:31430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.629198:0:31430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.629205:0:31430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093462c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143130.629208:0:31430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.629216:0:31430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.629235:0:31430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.629241:0:31430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093462c00/0x25aee876ca70ce70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143130.629360:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1971:x1830962858604800:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 74631us (75008us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143130.629370:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5956 00010000:00010000:3.0:1746143130.633679:0:31432:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.633700:0:31432:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.633711:0:31432:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.633721:0:31432:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cc9a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143130.633725:0:31432:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.633735:0:31432:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.633756:0:31432:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.633761:0:31432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092cc9a00/0x25aee876ca70ce7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143130.633850:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1971:x1830962858605568:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 75481us (79193us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143130.633861:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5958 00010000:00010000:2.0:1746143130.644191:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.644211:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.644219:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.644228:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a48e0400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143130.644232:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.644240:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.644260:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.644276:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a48e0400/0x25aee876ca70ce77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143130.644776:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858605056:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 86507us (90168us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143130.644786:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5957 00010000:00010000:2.0:1746143130.654577:0:21521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.654596:0:21521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.654604:0:21521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.654612:0:21521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094bce200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143130.654617:0:21521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.654626:0:21521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.654646:0:21521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.654653:0:21521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bce200/0x25aee876ca70ce85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143130.657483:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858605312:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 98901us (102849us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143130.657496:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5959 00000100:00100000:0.0:1746143130.667125:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.667402:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858605696 00000100:00100000:2.0:1746143130.667414:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858605696 00000100:00100000:2.0:1746143130.667480:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 609 00000100:00100000:2.0:1746143130.667491:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30902:x1830962858605696:12345-192.168.201.28@tcp:103:mirror_io.0 00010000:00010000:2.0:1746143130.667508:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143130.667536:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1a00/0x25aee876ca70cdcf lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffab expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143130.668467:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143130.668488:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143130.668494:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143130.668781:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30902:x1830962858605696:12345-192.168.201.28@tcp:103:mirror_io.0 Request processed in 1289us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143130.668793:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 609 00000100:00100000:0.0:1746143130.671735:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.671861:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858605952 00000100:00100000:1.0:1746143130.671875:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858605952 00000100:00100000:1.0:1746143130.672158:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3428 00000100:00100000:1.0:1746143130.672167:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30902:x1830962858605952:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143130.676012:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30902:x1830962858605952:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 3835us (4277us total) trans 8589942342 rc 0/0 00000100:00100000:0.0:1746143130.676025:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3428 00000100:00100000:0.0:1746143130.680537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.685554:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858606208 00000100:00100000:2.0:1746143130.685566:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858606208 00000100:00100000:2.0:1746143130.685629:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3429 00000100:00100000:2.0:1746143130.685637:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30902:x1830962858606208:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143130.685885:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30902:x1830962858606208:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 247us (5359us total) trans 8589942343 rc 0/0 00000100:00100000:2.0:1746143130.685892:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3429 00000100:00100000:0.0:1746143130.715121:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.715406:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858606464 00000100:00100000:2.0:1746143130.715416:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858606464 00000100:00080000:0.0:1746143130.715815:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143130.719172:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8134 00000100:00100000:2.0:1746143130.719193:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:30912:x1830962858606464:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143130.719222:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143130.719244:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70ce8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fff1 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.719400:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719413:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719424:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719437:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719443:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719449:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719570:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719577:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719583:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143130.719593:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143130.719684:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719693:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719699:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719704:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cac600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143130.719707:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719715:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719725:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143130.719728:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143130.719732:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.719743:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70ce93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.722521:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.722538:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.722545:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.722552:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b477c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143130.722556:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.722562:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.722579:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92a00) 00010000:00010000:2.0:1746143130.722582:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143130.722585:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.722591:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b477c00/0x25aee876ca70ce9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.722663:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70ce8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.722679:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.722691:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143130.722694:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143130.722696:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b717e00, rc 0) 00000100:00100000:2.0:1746143130.722788:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30912:x1830962858606464:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3602us (7677us total) trans 8589942344 rc 0/0 00000100:00100000:2.0:1746143130.722797:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8134 00000100:00100000:0.0:1746143130.726122:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.726201:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858606720 00000100:00100000:2.0:1746143130.726211:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858606720 00000100:00080000:0.0:1746143130.726299:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143130.727330:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8135 00000100:00100000:2.0:1746143130.727340:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:30916:x1830962858606720:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143130.727367:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143130.727386:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716c00/0x25aee876ca70ceaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164fff8 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.728185:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728200:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728211:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728222:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728229:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728238:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728369:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728377:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728384:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143130.728394:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143130.728487:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728494:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728500:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728507:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b717000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143130.728512:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728518:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728529:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143130.728532:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143130.728536:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.728546:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70ceb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.729193:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.729200:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.729205:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.729209:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b717400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143130.729211:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.729216:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.729223:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92000) 00010000:00010000:2.0:1746143130.729225:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143130.729227:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.729232:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cebd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.729281:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716c00/0x25aee876ca70ceaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.729291:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 199 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.729302:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143130.729305:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143130.729307:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b717c00, rc 0) 00000100:00100000:2.0:1746143130.729376:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30916:x1830962858606720:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2037us (3264us total) trans 8589942345 rc 0/0 00000100:00100000:2.0:1746143130.729383:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8135 00000100:00100000:0.0:1746143130.756973:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.757014:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.757065:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858606848 00000100:00100000:0.0:1746143130.757067:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.757075:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858606848 00000100:00100000:0.0:1746143130.757080:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00080000:0.0:1746143130.757107:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143130.757123:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.757129:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858606976 00000100:00100000:1.0:1746143130.757131:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858606976 00000100:00100000:0.0:1746143130.757136:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858607104 00000100:00100000:0.0:1746143130.757138:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858607104 00000100:00100000:1.0:1746143130.757149:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858607232 00000100:00100000:1.0:1746143130.757151:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858607232 00000100:00100000:0.0:1746143130.757153:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858607360 00000100:00100000:0.0:1746143130.757155:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858607360 00000100:00100000:1.0:1746143130.757165:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12290 00000100:00100000:1.0:1746143130.757172:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858606848:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143130.757191:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143130.757209:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c164ffff expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.757237:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143130.757239:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143130.757248:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143130.757273:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143130.757284:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57e800, rc 0) 00000100:00100000:1.0:1746143130.757331:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858606848:12345-192.168.201.28@tcp:101:cat.0 Request processed in 158us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.757386:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12291 00000100:00100000:0.0:1746143130.757394:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858606976:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.757403:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.757413:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650006 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.757425:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757426:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757431:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 26 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757441:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 26 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757448:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50cee00, rc 0) 00000100:00100000:0.0:1746143130.757465:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858606976:12345-192.168.201.28@tcp:101:cat.0 Request processed in 73us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.757471:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12291 00000100:00100000:0.0:1746143130.757485:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12292 00000100:00100000:0.0:1746143130.757489:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858607104:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.757494:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.757500:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165000d expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.757508:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757510:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757513:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 26 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757521:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 26 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757528:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50ce600, rc 0) 00000100:00100000:0.0:1746143130.757538:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858607104:12345-192.168.201.28@tcp:101:cat.0 Request processed in 49us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.757543:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12292 00000100:00100000:0.0:1746143130.757551:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12293 00000100:00100000:0.0:1746143130.757554:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858607232:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.757559:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.757564:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650014 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.757572:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757573:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757576:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 19 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757583:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 19 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757588:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50cec00, rc 0) 00000100:00100000:0.0:1746143130.757598:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858607232:12345-192.168.201.28@tcp:101:cat.0 Request processed in 43us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.757601:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12293 00000100:00100000:0.0:1746143130.757607:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12294 00000100:00100000:0.0:1746143130.757610:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858607360:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.757617:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.757622:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165001b expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.757629:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757631:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757633:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 19 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757641:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 19 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757646:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50ce200, rc 0) 00000100:00100000:0.0:1746143130.757655:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858607360:12345-192.168.201.28@tcp:101:cat.0 Request processed in 45us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.757659:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12294 00000100:00080000:0.0:1746143130.757667:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143130.757693:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.757705:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858607488 00000100:00100000:0.0:1746143130.757708:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858607488 00000100:00100000:0.0:1746143130.757721:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12295 00000100:00100000:0.0:1746143130.757725:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858607488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.757730:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.757735:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650022 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.757744:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757947:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.757951:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 27 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757959:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 27 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.757965:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50ce000, rc 0) 00000100:00100000:0.0:1746143130.757977:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858607488:12345-192.168.201.28@tcp:101:cat.0 Request processed in 251us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.757981:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12295 00000100:00100000:1.0:1746143130.758495:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12290 00000100:00100000:0.0:1746143130.762764:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.763067:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858607744 00000100:00100000:2.0:1746143130.763077:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858607744 00000100:00100000:2.0:1746143130.763126:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8136 00000100:00100000:2.0:1746143130.763132:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30911:x1830962858607744:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143130.763158:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143130.763176:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717800/0x25aee876ca70cefc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650029 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.763283:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.763297:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.763305:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 7 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.763311:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.763318:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.763346:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.763357:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 200 pid: 14795 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.763368:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861238144:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143130.763672:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 7 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.763680:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 7 pid: 14795 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.763687:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861238272:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143130.763711:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.763718:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.763724:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861238400:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143130.763739:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143130.769970:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143130.770074:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858608000 00000100:00100000:3.0:1746143130.770083:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858608000 00000100:00100000:3.0:1746143130.770127:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8137 00000100:00100000:3.0:1746143130.770135:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30915:x1830962858608000:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143130.770164:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143130.770184:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9000/0x25aee876ca70cf0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650030 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.770292:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143130.770306:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143130.770316:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143130.770326:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143130.770672:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9000/0x25aee876ca70cf0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.770705:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.770713:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143130.770716:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143130.770719:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143130.770725:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143130.770730:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc9400, rc 0) 00000100:00100000:3.0:1746143130.770787:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30915:x1830962858608000:12345-192.168.201.28@tcp:101:cat.0 Request processed in 653us (830us total) trans 8589942346 rc 0/0 00000100:00100000:3.0:1746143130.770797:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8137 00000100:00100000:0.0:1746143130.780569:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.780606:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.780621:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.780637:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.780662:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.780678:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143130.780684:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858608256 00000100:00100000:3.0:1746143130.780694:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858608256 00000100:00100000:0.0:1746143130.780725:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:3.0:1746143130.780743:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880136beaa00 x1830962858608256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143130.780746:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858609280 00000100:00100000:0.0:1746143130.780749:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858609280 00002000:00100000:3.0:1746143130.780753:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beaa00 with x1830962858608256 ext(0->1048575) 00002000:00010000:3.0:1746143130.780759:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136beaa00 00010000:00010000:0.0:1746143130.780772:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 10 pid: 14795 timeout: 1012 lvb_type: 0 00000100:00100000:3.0:1746143130.780776:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858608640 00000100:00100000:3.0:1746143130.780778:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858608640 00002000:00100000:3.0:1746143130.780787:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880136bead80 x1830962858608640/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143130.780791:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858609152 00000100:00100000:0.0:1746143130.780793:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858609152 00002000:00100000:3.0:1746143130.780794:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136bead80 with x1830962858608640 ext(1048576->2097151) 00002000:00010000:3.0:1746143130.780797:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136bead80 00010000:00010000:0.0:1746143130.780802:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 201 pid: 14795 timeout: 1012 lvb_type: 0 00000100:00100000:3.0:1746143130.780805:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858608768 00000100:00100000:3.0:1746143130.780807:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858608768 00002000:00100000:3.0:1746143130.780818:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880136beb100 x1830962858608768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143130.780819:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858609408 00000100:00100000:0.0:1746143130.780821:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858609408 00002000:00100000:3.0:1746143130.780825:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beb100 with x1830962858608768 ext(1048576->2097151) 00002000:00010000:3.0:1746143130.780828:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136beb100 00010000:00010000:0.0:1746143130.780830:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:3.0:1746143130.781009:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858608896 00000100:00100000:3.0:1746143130.781011:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858608896 00000100:00100000:0.0:1746143130.781020:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6499 00002000:00100000:3.0:1746143130.781021:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880136beb480 x1830962858608896/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143130.781027:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858609280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746143130.781028:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beb480 with x1830962858608896 ext(1048576->2097151) 00002000:00010000:3.0:1746143130.781061:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136beb480 00000100:00100000:3.0:1746143130.781072:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5960 00010000:00010000:0.0:1746143130.781072:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143130.781077:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858608256:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:0.0:1746143130.781078:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 10 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:0.0:1746143130.781087:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 10 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:0.0:1746143130.781108:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143130.781113:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781119:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781125:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143130.781162:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858609280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.781169:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6499 00000100:00100000:0.0:1746143130.781213:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6500 00000100:00100000:0.0:1746143130.781217:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858609152:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143130.781225:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143130.781228:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 201 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:0.0:1746143130.781236:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 201 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:0.0:1746143130.781246:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143130.781249:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781253:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781258:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143130.781284:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858609152:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 66us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.781289:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6500 00000100:00100000:0.0:1746143130.781298:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6501 00000100:00100000:0.0:1746143130.781302:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858609408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143130.781307:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143130.781311:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:0.0:1746143130.781319:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:0.0:1746143130.781328:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143130.781331:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781337:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781344:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781358:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143130.781368:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858609408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 66us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.781372:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6501 00000100:00100000:0.0:1746143130.781426:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.781446:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858609536 00000100:00100000:0.0:1746143130.781449:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858609536 00000100:00100000:0.0:1746143130.781466:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8138 00000100:00100000:0.0:1746143130.781470:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30915:x1830962858609536:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.781484:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.781495:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50cea00/0x25aee876ca70cf1f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650037 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.781561:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143130.781568:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781574:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143130.781584:0:14796:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143130.781592:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143130.781699:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5961 00000100:00100000:0.0:1746143130.781705:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858608640:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143130.781891:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5962 00000100:00100000:3.0:1746143130.781897:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858608768:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143130.782047:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5963 00000100:00100000:2.0:1746143130.782056:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858608896:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:2.0:1746143130.784217:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717c00/0x25aee876ca70cec4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff8 expref: 200 pid: 14795 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.784245:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861238144:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143130.784258:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717e00/0x25aee876ca70cea1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164fff1 expref: 11 pid: 14795 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.784281:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861238272:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143130.784294:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2a00/0x25aee876ca70ce23 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc0 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.784303:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861238400:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143130.784327:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.784334:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143130.784339:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143130.784360:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143130.784508:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717800/0x25aee876ca70cefc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650029 expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.784525:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650029 expref: 200 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.784534:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650029 expref: 200 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.784544:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b716600, rc 0) 00000100:00100000:2.0:1746143130.784590:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30911:x1830962858607744:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 21457us (21834us total) trans 8589942347 rc 0/0 00000100:00100000:2.0:1746143130.784597:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8136 00000100:00100000:0.0:1746143130.806597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.806684:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858609664 00000100:00100000:2.0:1746143130.806695:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858609664 00000100:00100000:2.0:1746143130.806740:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8139 00000100:00100000:2.0:1746143130.806750:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30911:x1830962858609664:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143130.806774:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143130.806796:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70cf34 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165003e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.806861:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70cf34 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165003e expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.806875:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70cf34 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165003e expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.806894:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143130.806897:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143130.806901:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cac600, rc 0) 00000100:00100000:2.0:1746143130.806958:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30911:x1830962858609664:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 209us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143130.806964:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8139 00000100:00100000:0.0:1746143130.821297:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.821940:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858609792 00000100:00100000:1.0:1746143130.821951:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858609792 00010000:00010000:1.0:1746143130.821992:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650029 expref: 201 pid: 14795 timeout: 1012 lvb_type: 0 00000100:00100000:1.0:1746143130.822059:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6502 00000100:00100000:1.0:1746143130.822068:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858609792:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143130.822083:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143130.822089:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650029 expref: 201 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:1.0:1746143130.822102:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650029 expref: 201 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:1.0:1746143130.822125:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716600/0x25aee876ca70cf03 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650029 expref: 201 pid: 14795 timeout: 1012 lvb_type: 0 00010000:00010000:1.0:1746143130.822144:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143130.822150:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143130.822159:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143130.822166:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143130.822187:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143130.822235:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1969:x1830962858609792:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 167us (7213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143130.822242:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6502 00010000:00010000:1.0:1746143130.822336:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143130.822343:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143130.822392:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143130.822398:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143130.822416:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143130.822447:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50cea00/0x25aee876ca70cf1f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.822461:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.822467:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143130.822470:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143130.822473:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50ce400, rc 0) 00000100:00100000:1.0:1746143130.822502:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30915:x1830962858609536:12345-192.168.201.28@tcp:101:cat.0 Request processed in 41031us (41075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143130.822509:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8138 00000100:00100000:3.0:1746143130.823438:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858608768:12345-192.168.201.28@tcp:3:cat.0 Request processed in 41539us (42813us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143130.823447:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5962 00002000:00100000:3.0:1746143130.823457:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880136beb100 x1830962858608768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143130.823467:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beb100 with x1830962858608768 ext(1048576->2097151) 00002000:00010000:3.0:1746143130.823472:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136beb100 00000100:00100000:2.0:1746143130.826993:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858608256:12345-192.168.201.28@tcp:3:cat.0 Request processed in 45733us (46255us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143130.827009:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5960 00002000:00100000:2.0:1746143130.827021:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880136beaa00 x1830962858608256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143130.827049:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beaa00 with x1830962858608256 ext(0->1048575) 00002000:00010000:2.0:1746143130.827055:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136beaa00 00000100:00100000:3.0:1746143130.848932:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858608896:12345-192.168.201.28@tcp:3:cat.0 Request processed in 66867us (68282us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143130.848945:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5963 00002000:00100000:3.0:1746143130.848958:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880136beb480 x1830962858608896/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143130.848970:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beb480 with x1830962858608896 ext(1048576->2097151) 00002000:00010000:3.0:1746143130.848977:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136beb480 00000100:00100000:1.0:1746143130.859328:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858608640:12345-192.168.201.28@tcp:3:cat.0 Request processed in 77611us (78709us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143130.859340:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5961 00002000:00100000:1.0:1746143130.859352:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880136bead80 x1830962858608640/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143130.859362:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136bead80 with x1830962858608640 ext(1048576->2097151) 00002000:00010000:1.0:1746143130.859369:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136bead80 00000100:00100000:0.0:1746143130.863147:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.863724:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.863753:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.863796:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858610048 00000100:00100000:1.0:1746143130.863806:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858610048 00000100:00100000:1.0:1746143130.863865:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858610176 00000100:00100000:1.0:1746143130.863868:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858610176 00000100:00100000:1.0:1746143130.863886:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8140 00000100:00100000:1.0:1746143130.863894:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30911:x1830962858610048:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143130.863913:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143130.863916:0:14796:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143130.863943:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cac600/0x25aee876ca70cf34 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165003e expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.863972:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143130.863976:0:14796:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143130.863988:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f600/0x25aee876ca70cf3b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650045 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.864064:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143130.864076:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.864084:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.864092:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.864097:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143130.864128:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.864140:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:1.0:1746143130.864151:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5841880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861238528:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143130.864170:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8141 00000100:00100000:2.0:1746143130.864179:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e36f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30916:x1830962858610176:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143130.864186:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143130.864192:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165004c expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.864224:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.864231:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 202 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143130.864498:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.864518:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858610304 00000100:00100000:0.0:1746143130.864521:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858610304 00000100:00100000:0.0:1746143130.865306:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858610432 00000100:00100000:0.0:1746143130.865310:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858610432 00000100:00100000:0.0:1746143130.865332:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12296 00000100:00100000:0.0:1746143130.865338:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858610304:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.865348:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.865358:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650053 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.865377:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865379:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865388:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865401:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865412:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090014200, rc 0) 00000100:00100000:0.0:1746143130.865439:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858610304:12345-192.168.201.28@tcp:101:cat.0 Request processed in 102us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.865446:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12296 00000100:00100000:0.0:1746143130.865460:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12297 00000100:00100000:0.0:1746143130.865465:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858610432:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.865471:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.865480:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165005a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.865492:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865493:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865498:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865507:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865514:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090014c00, rc 0) 00000100:00100000:0.0:1746143130.865527:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858610432:12345-192.168.201.28@tcp:101:cat.0 Request processed in 63us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.865533:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12297 00000100:00100000:0.0:1746143130.865581:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.865596:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858610560 00000100:00100000:0.0:1746143130.865599:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858610560 00000100:00100000:0.0:1746143130.865615:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12298 00000100:00100000:0.0:1746143130.865619:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858610560:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.865624:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.865630:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650061 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.865641:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865642:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865646:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 17 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865655:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 17 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865661:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090014a00, rc 0) 00000100:00100000:0.0:1746143130.865674:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858610560:12345-192.168.201.28@tcp:101:cat.0 Request processed in 54us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.865678:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12298 00000100:00100000:0.0:1746143130.865709:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.865716:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858610688 00000100:00100000:0.0:1746143130.865719:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858610688 00000100:00100000:0.0:1746143130.865728:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12299 00000100:00100000:0.0:1746143130.865732:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858610688:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.865737:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.865742:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650068 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.865750:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865752:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865756:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865763:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865769:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090015800, rc 0) 00000100:00100000:0.0:1746143130.865780:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858610688:12345-192.168.201.28@tcp:101:cat.0 Request processed in 47us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.865784:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12299 00000100:00100000:0.0:1746143130.865807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.865815:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858610816 00000100:00100000:0.0:1746143130.865817:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858610816 00000100:00100000:0.0:1746143130.865826:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12300 00000100:00100000:0.0:1746143130.865829:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858610816:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.865834:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.865839:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165006f expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.865848:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865849:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865853:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 13 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865861:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 13 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865872:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090014400, rc 0) 00000100:00100000:0.0:1746143130.865882:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858610816:12345-192.168.201.28@tcp:101:cat.0 Request processed in 52us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.865886:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12300 00000100:00100000:0.0:1746143130.865915:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.865924:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858610944 00000100:00100000:0.0:1746143130.865926:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858610944 00000100:00100000:0.0:1746143130.865935:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12301 00000100:00100000:0.0:1746143130.865939:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858610944:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143130.865944:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143130.865949:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650076 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143130.865959:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865960:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143130.865964:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865971:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143130.865977:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090015400, rc 0) 00000100:00100000:0.0:1746143130.865988:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858610944:12345-192.168.201.28@tcp:101:cat.0 Request processed in 49us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143130.865993:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12301 00010000:00010000:1.0:1746143130.866356:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.866371:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:1.0:1746143130.866385:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5840700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861238656:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143130.866388:0:14794:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.866403:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 202 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.866414:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143130.866417:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143130.866419:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.866430:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cad200, rc 0) 00000100:00100000:2.0:1746143130.866465:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e36f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:30916:x1830962858610176:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2288us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143130.866470:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8141 00010000:00010000:1.0:1746143130.866575:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.866583:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 8 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:1.0:1746143130.866591:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5841500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861238784:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143130.866611:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da3a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143130.871779:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5841880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861238528:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143130.873203:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.875312:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858611072 00000100:00100000:2.0:1746143130.875323:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858611072 00010000:00010000:2.0:1746143130.875363:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.875397:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6503 00000100:00100000:2.0:1746143130.875406:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858611072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143130.875421:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143130.875427:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.875439:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.875462:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ce400/0x25aee876ca70cf26 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650037 expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.875497:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143130.875502:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.875510:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.875520:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143130.875564:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858611072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 160us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143130.875571:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6503 00000100:00100000:2.0:1746143130.875730:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5841500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861238784:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143130.877553:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5840700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861238656:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143130.877582:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143130.879329:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.881324:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.881839:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858611200 00000100:00100000:2.0:1746143130.881848:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858611200 00010000:00010000:2.0:1746143130.881887:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.881913:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858611328 00000100:00100000:2.0:1746143130.881915:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858611328 00010000:00010000:2.0:1746143130.881927:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143130.881951:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6504 00000100:00100000:2.0:1746143130.881957:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858611200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143130.881970:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143130.881976:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.881985:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.882005:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eb2600/0x25aee876ca70ce15 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffb9 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.882024:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143130.882028:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.882051:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.882056:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143130.882092:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858611200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 135us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143130.882098:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6504 00000100:00100000:2.0:1746143130.882110:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6505 00000100:00100000:2.0:1746143130.882114:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858611328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143130.882120:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143130.882124:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.882132:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.882141:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf11 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650030 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143130.882150:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143130.882152:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.882159:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.882166:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.882174:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 201 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.882189:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143130.882200:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858611328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 85us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143130.882204:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6505 00010000:00010000:2.0:1746143130.882229:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143130.882235:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00000040:00080000:2.0:1746143130.883072:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2369, 88 off201184 00000004:00080000:2.0:1746143130.883080:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723048464ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883125:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2388, 88 off202592 00000004:00080000:2.0:1746143130.883130:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 912723098638ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143130.883142:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2389, 88 off202680 00000004:00080000:2.0:1746143130.883145:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 912723113855ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143130.883153:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2370, 88 off201272 00000004:00080000:2.0:1746143130.883156:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723124227ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883162:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2371, 88 off201360 00000004:00080000:2.0:1746143130.883165:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723133612ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883172:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2390, 88 off202768 00000004:00080000:2.0:1746143130.883175:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 912723143212ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143130.883181:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2391, 88 off202856 00000004:00080000:2.0:1746143130.883184:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 912723152385ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143130.883190:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2392, 88 off202944 00000004:00080000:2.0:1746143130.883194:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 912723162278ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143130.883201:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2372, 88 off201448 00000004:00080000:2.0:1746143130.883203:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723171390ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883209:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2393, 88 off203032 00000004:00080000:2.0:1746143130.883211:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 912723179575ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143130.883218:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2373, 88 off201536 00000004:00080000:2.0:1746143130.883220:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723188750ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883227:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2394, 88 off203120 00000004:00080000:2.0:1746143130.883230:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 912723198890ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143130.883237:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2374, 88 off201624 00000004:00080000:2.0:1746143130.883247:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723215747ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883255:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2375, 88 off201712 00000004:00080000:2.0:1746143130.883258:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723226730ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883277:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2376, 88 off201800 00000004:00080000:2.0:1746143130.883280:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723248300ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883287:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2377, 88 off201888 00000004:00080000:2.0:1746143130.883290:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 912723258095ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143130.883297:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2395, 88 off203208 00000004:00080000:2.0:1746143130.883300:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 912723268395ns, next at 860119223596ns, rc = 0 00000100:00100000:0.0:1746143130.888803:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.888834:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858611712 00000100:00100000:0.0:1746143130.888844:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858611712 00002000:00100000:0.0:1746143130.888888:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800a84e5880 x1830962858611712/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143130.888898:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5880 with x1830962858611712 ext(1048576->2097151) 00002000:00010000:0.0:1746143130.888903:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e5880 00000100:00100000:0.0:1746143130.888922:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5964 00000100:00100000:0.0:1746143130.888930:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858611712:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143130.890720:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143130.891345:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858611840 00000100:00100000:3.0:1746143130.891352:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858611840 00002000:00100000:3.0:1746143130.891391:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800a84e5c00 x1830962858611840/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143130.891401:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5c00 with x1830962858611840 ext(0->1048575) 00002000:00010000:3.0:1746143130.891406:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e5c00 00000100:00100000:3.0:1746143130.891424:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5965 00000100:00100000:3.0:1746143130.891430:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858611840:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143130.895701:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.895746:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.895776:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858612096 00000100:00100000:1.0:1746143130.895784:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858612096 00002000:00100000:1.0:1746143130.895826:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a5843100 x1830962858612096/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143130.895836:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5843100 with x1830962858612096 ext(1048576->2097151) 00002000:00010000:1.0:1746143130.895842:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5843100 00000100:00100000:1.0:1746143130.895865:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858612352 00000100:00100000:1.0:1746143130.895867:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858612352 00002000:00100000:1.0:1746143130.895882:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800a5840700 x1830962858612352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143130.895889:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840700 with x1830962858612352 ext(1048576->2097151) 00002000:00010000:1.0:1746143130.895892:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5840700 00000100:00100000:1.0:1746143130.895904:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5966 00000100:00100000:1.0:1746143130.895911:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858612096:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143130.896638:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5967 00000100:00100000:2.0:1746143130.896649:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858612352:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143130.903057:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143130.903101:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858612480 00000100:00100000:1.0:1746143130.903110:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858612480 00000100:00100000:1.0:1746143130.903154:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8142 00000100:00100000:1.0:1746143130.903162:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30912:x1830962858612480:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143130.903181:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143130.903201:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165007d expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.903273:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.903286:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.903304:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143130.903307:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143130.903310:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 202 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143130.903317:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57f800, rc 0) 00000100:00100000:1.0:1746143130.903586:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30912:x1830962858612480:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 424us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143130.903592:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8142 00000100:00100000:0.0:1746143130.929652:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858611712:12345-192.168.201.28@tcp:3:cat.0 Request processed in 40710us (40843us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143130.929665:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5964 00002000:00100000:0.0:1746143130.929678:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800a84e5880 x1830962858611712/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143130.929687:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5880 with x1830962858611712 ext(1048576->2097151) 00002000:00010000:0.0:1746143130.929693:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e5880 00000100:00100000:3.0:1746143130.947740:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858611840:12345-192.168.201.28@tcp:3:cat.0 Request processed in 56301us (57017us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143130.947761:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5965 00002000:00100000:3.0:1746143130.947775:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800a84e5c00 x1830962858611840/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143130.947786:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5c00 with x1830962858611840 ext(0->1048575) 00002000:00010000:3.0:1746143130.947793:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e5c00 00000100:00100000:2.0:1746143130.966242:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858612352:12345-192.168.201.28@tcp:3:cat.0 Request processed in 69588us (70488us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143130.966269:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5967 00002000:00100000:2.0:1746143130.966282:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800a5840700 x1830962858612352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143130.966293:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840700 with x1830962858612352 ext(1048576->2097151) 00002000:00010000:2.0:1746143130.966299:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5840700 00000100:00100000:1.0:1746143130.973340:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858612096:12345-192.168.201.28@tcp:3:cat.0 Request processed in 77420us (77641us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143130.973353:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5966 00002000:00100000:1.0:1746143130.973365:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a5843100 x1830962858612096/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143130.973375:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5843100 with x1830962858612096 ext(1048576->2097151) 00002000:00010000:1.0:1746143130.973382:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5843100 00010000:00010000:3.0:1746143130.975333:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 203 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.975347:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143130.975350:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143130.975354:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 203 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.975365:0:14796:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 203 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.975372:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 203 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.975385:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.975393:0:14796:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.975399:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.975438:0:14796:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143130.975451:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861238912:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143130.975772:0:14796:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 203 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143130.975782:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861239040:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143130.975803:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc26c0 going to sleep for 11 seconds 00000001:00080000:1.0:1746143130.976392:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942342 is committed 00000001:00080000:1.0:1746143130.976405:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942348 is committed 00000004:00080000:1.0:1746143130.976409:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1813 committed 00000004:00080000:1.0:1746143130.976424:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1800 committed 00000004:00080000:1.0:1746143130.976431:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1799 committed 00000004:00080000:1.0:1746143130.976432:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1798 committed 00000004:00080000:1.0:1746143130.976434:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1797 committed 00000004:00080000:1.0:1746143130.976436:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1812 committed 00000004:00080000:1.0:1746143130.976437:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1796 committed 00000004:00080000:1.0:1746143130.976440:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1811 committed 00000004:00080000:1.0:1746143130.976441:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1795 committed 00000004:00080000:1.0:1746143130.976443:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1810 committed 00000004:00080000:1.0:1746143130.976444:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1809 committed 00000004:00080000:1.0:1746143130.976446:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1808 committed 00000004:00080000:1.0:1746143130.976447:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1794 committed 00000004:00080000:1.0:1746143130.976448:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1793 committed 00000004:00080000:1.0:1746143130.976450:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1807 committed 00000004:00080000:1.0:1746143130.976451:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1806 committed 00000004:00080000:1.0:1746143130.976453:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1792 committed 00000001:00080000:1.0:1746143130.976466:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942344 is committed 00000001:00080000:1.0:1746143130.976470:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942343 is committed 00000001:00080000:1.0:1746143130.976475:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942346 is committed 00000100:00100000:3.0:1746143130.977305:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861239168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143130.977402:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143130.979493:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861239680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143130.979550:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143130.979598:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861240192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.979601:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861239296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143130.979620:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143130.979643:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143130.979662:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861239808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.979679:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143130.980255:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861239424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143130.980415:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861239168 00000100:00100000:3.0:1746143130.980423:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861239168 00000100:00100000:2.0:1746143130.980426:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861239680 00000100:00100000:2.0:1746143130.980431:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861239680 00000100:00100000:1.0:1746143130.980431:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861240320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.980450:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143130.980477:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861240832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143130.980492:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143130.980571:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861240192 00000100:00100000:2.0:1746143130.980571:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861239296 00000100:00100000:2.0:1746143130.980574:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861239296 00000100:00100000:3.0:1746143130.980575:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861240192 00000100:00100000:1.0:1746143130.980585:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746143130.980589:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861239808 00000100:00100000:1.0:1746143130.980590:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861240704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143130.980591:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861239808 00000100:00100000:3.0:1746143130.980596:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861240320 00000100:00100000:3.0:1746143130.980598:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861240320 00000100:00100000:2.0:1746143130.980601:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861240832 00000100:00100000:2.0:1746143130.980603:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861240832 00000100:00100000:1.0:1746143130.980605:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143130.980610:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12302 00000100:00100000:2.0:1746143130.980615:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861240704 00000100:00100000:2.0:1746143130.980617:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861240704 00000100:00100000:3.0:1746143130.980618:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3301:x1830962861239168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143130.980620:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861239552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143130.980625:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12303 00000100:00100000:2.0:1746143130.980630:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3301:x1830962861239680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143130.980636:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143130.980642:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861240064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.980655:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143130.980662:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861240576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143130.980665:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861239552 00000100:00100000:0.0:1746143130.980668:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861239552 00000100:00100000:1.0:1746143130.980675:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143130.980679:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861240064 00000100:00100000:3.0:1746143130.980681:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861240064 00000100:00100000:1.0:1746143130.980681:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861241088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143130.980684:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861240576 00000100:00100000:0.0:1746143130.980685:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861240576 00000100:00100000:3.0:1746143130.980692:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12304 00000100:00100000:1.0:1746143130.980693:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143130.980697:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3302:x1830962861239296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143130.980698:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12305 00000100:00100000:0.0:1746143130.980702:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3301:x1830962861240192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.980712:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861241088 00000100:00100000:1.0:1746143130.980715:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861241088 00000100:00100000:1.0:1746143130.980732:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12306 00000100:00100000:1.0:1746143130.980738:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3302:x1830962861239808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143130.980740:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12307 00000100:00100000:0.0:1746143130.980746:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3302:x1830962861240320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143130.980815:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12308 00000100:00100000:0.0:1746143130.980820:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3302:x1830962861240832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143130.980835:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143130.980835:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143130.980838:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143130.980838:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143128 -> 1746143128 00002000:00010000:3.0:1746143130.980840:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143130.980841:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:3.0:1746143130.980843:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:1.0:1746143130.980843:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143128 -> 1746143128 00002000:00010000:3.0:1746143130.980845:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1997 -> 1997 00002000:00010000:1.0:1746143130.980845:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143130.980854:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3301:x1830962861239680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 222us (1303us total) trans 17179872753 rc 0/0 00000100:00100000:2.0:1746143130.980860:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12303 00000100:00100000:1.0:1746143130.980871:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3302:x1830962861239808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (1191us total) trans 21474840014 rc 0/0 00000100:00100000:3.0:1746143130.980872:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3302:x1830962861239296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (1229us total) trans 21474840012 rc 0/0 00000100:00100000:2.0:1746143130.980877:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12309 00000100:00100000:1.0:1746143130.980880:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12306 00000100:00100000:2.0:1746143130.980882:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3302:x1830962861240704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143130.980888:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12304 00000100:00100000:1.0:1746143130.980892:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12310 00000100:00100000:1.0:1746143130.980896:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3300:x1830962861239552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143130.980901:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12311 00000100:00100000:3.0:1746143130.980905:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3300:x1830962861240064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143130.980909:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3302:x1830962861240832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (416us total) trans 17179872754 rc 0/0 00000100:00100000:0.0:1746143130.980914:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12308 00000100:00100000:0.0:1746143130.980923:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12312 00000100:00100000:0.0:1746143130.980943:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3300:x1830962861240576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143130.980978:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3302:x1830962861240704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (372us total) trans 17179872755 rc 0/0 00000100:00100000:2.0:1746143130.980983:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12309 00002000:00010000:1.0:1746143130.980984:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143130.980986:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143128 -> 1746143128 00002000:00010000:1.0:1746143130.980989:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143127 -> 1746143127 00002000:00010000:1.0:1746143130.980990:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143128 -> 1746143128 00002000:00010000:1.0:1746143130.980992:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746143130.980993:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12313 00000100:00100000:2.0:1746143130.980998:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3300:x1830962861241088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143130.981005:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3300:x1830962861240064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (348us total) trans 21474840015 rc 0/0 00000100:00100000:3.0:1746143130.981011:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12311 00000100:00100000:1.0:1746143130.981013:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3300:x1830962861239552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (376us total) trans 17179872756 rc 0/0 00000100:00100000:0.0:1746143130.981013:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3300:x1830962861240576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (337us total) trans 21474840016 rc 0/0 00000100:00100000:0.0:1746143130.981018:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12312 00000100:00100000:1.0:1746143130.981021:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12310 00000100:00100000:0.0:1746143130.981029:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143130.981040:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861239424 00000100:00100000:1.0:1746143130.981043:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861239424 00000100:00100000:0.0:1746143130.981060:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861239936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.981073:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12314 00000100:00100000:1.0:1746143130.981077:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3299:x1830962861239424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143130.981094:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3300:x1830962861241088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (400us total) trans 17179872757 rc 0/0 00000100:00100000:0.0:1746143130.981095:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143130.981100:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12313 00002000:00010000:3.0:1746143130.981104:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143130.981107:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143128 -> 1746143128 00002000:00010000:3.0:1746143130.981109:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00000100:00100000:0.0:1746143130.981110:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861240448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143130.981111:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861239936 00002000:00010000:3.0:1746143130.981112:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00000100:00100000:2.0:1746143130.981113:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861239936 00002000:00010000:3.0:1746143130.981114:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143130.981125:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143130.981127:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12315 00000100:00100000:3.0:1746143130.981130:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3301:x1830962861239168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 514us (3730us total) trans 17179872758 rc 0/0 00000100:00100000:2.0:1746143130.981131:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3299:x1830962861239936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143130.981133:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861240960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143130.981136:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12302 00000100:00100000:3.0:1746143130.981144:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861240448 00000100:00100000:0.0:1746143130.981144:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746143130.981146:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746143130.981147:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861240448 00002000:00010000:1.0:1746143130.981149:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143127 -> 1746143127 00002000:00010000:1.0:1746143130.981151:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143126 -> 1746143126 00002000:00010000:1.0:1746143130.981153:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00000100:00100000:3.0:1746143130.981155:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861240960 00002000:00010000:1.0:1746143130.981155:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143130.981156:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861240960 00000100:00100000:3.0:1746143130.981163:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12316 00000100:00100000:3.0:1746143130.981167:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3299:x1830962861240448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143130.981167:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12317 00000100:00100000:0.0:1746143130.981171:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3299:x1830962861240960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143130.981176:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3299:x1830962861239424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (146us total) trans 17179872759 rc 0/0 00000100:00100000:1.0:1746143130.981181:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12314 00000004:00080000:3.0:1746143130.981197:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e6a00/2, rc 0, transno 17179872753 00000004:00080000:1.0:1746143130.981200:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e6680/2, rc 0, transno 17179872756 00000100:00100000:3.0:1746143130.981203:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861239680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143130.981204:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861239552:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143130.981211:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e5f80/2, rc 0, transno 17179872758 00000004:00080000:1.0:1746143130.981213:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d5500/2, rc 0, transno 21474840015 00000100:00100000:3.0:1746143130.981214:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861239168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143130.981218:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861240064:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143130.981226:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d6d80/2, rc 0, transno 21474840016 00000100:00100000:1.0:1746143130.981229:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861240576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143130.981235:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e7800/2, rc 0, transno 17179872757 00000100:00100000:1.0:1746143130.981237:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861241088:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143130.981250:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e6d80/2, rc 0, transno 17179872755 00000100:00100000:0.0:1746143130.981251:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3299:x1830962861240960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (106us total) trans 17179872760 rc 0/0 00000100:00100000:1.0:1746143130.981253:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861240704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143130.981255:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861238912:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143130.981257:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12317 00000100:00100000:2.0:1746143130.981277:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143130.981281:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861239040:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143130.981315:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f600/0x25aee876ca70cf3b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 200 pid: 14796 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143130.981333:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.981359:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57fc00, rc 0) 00000100:00100000:2.0:1746143130.981370:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143130.981394:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30911:x1830962858610048:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 117501us (118255us total) trans 8589942348 rc 0/0 00000100:00100000:2.0:1746143130.981400:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858612608 00000100:00100000:2.0:1746143130.981403:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858612608 00000100:00100000:3.0:1746143130.981404:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8140 00000100:00100000:2.0:1746143130.981422:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858612736 00000100:00100000:2.0:1746143130.981424:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858612736 00000100:00100000:2.0:1746143130.981438:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3430 00000100:00100000:2.0:1746143130.981444:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30916:x1830962858612608:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143130.981504:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30916:x1830962858612608:12345-192.168.201.28@tcp:49:cat.0 Request processed in 60us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143130.981509:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3430 00000100:00100000:2.0:1746143130.981518:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3431 00000100:00100000:2.0:1746143130.981522:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30912:x1830962858612736:12345-192.168.201.28@tcp:49:multiop.0 00000100:00100000:2.0:1746143130.981550:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30912:x1830962858612736:12345-192.168.201.28@tcp:49:multiop.0 Request processed in 28us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143130.981555:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3431 00000004:00080000:2.0:1746143130.982137:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e6300/2, rc 0, transno 17179872759 00000100:00100000:2.0:1746143130.982143:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861239424:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143130.982151:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e7480/2, rc 0, transno 17179872760 00000100:00100000:2.0:1746143130.982153:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861240960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143130.982368:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e7100/2, rc 0, transno 17179872754 00000100:00100000:1.0:1746143130.982373:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861240832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143130.982373:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3302:x1830962861240320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1625us (1920us total) trans 21474840013 rc 0/0 00000100:00100000:0.0:1746143130.982379:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12307 00000004:00080000:1.0:1746143130.982385:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5841880/2, rc 0, transno 21474840012 00000100:00100000:1.0:1746143130.982388:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861239296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143130.982394:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012baa1c00/2, rc 0, transno 21474840014 00000100:00100000:1.0:1746143130.982397:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861239808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143130.982403:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d4380/2, rc 0, transno 21474840013 00000100:00100000:1.0:1746143130.982406:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861240320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.982523:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143130.982530:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861241216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.982554:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143130.982672:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861241216 00000100:00100000:0.0:1746143130.982676:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861241216 00000100:00100000:0.0:1746143130.982696:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12318 00000100:00100000:0.0:1746143130.982701:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3302:x1830962861241216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143130.982800:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+52:3302:x1830962861241216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (245us total) trans 21474840019 rc 0/0 00000100:00100000:0.0:1746143130.982805:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12318 00002000:00010000:3.0:1746143130.983100:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143130.983103:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143130.983105:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143130.983106:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143130.983108:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143130.983133:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3299:x1830962861240448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1965us (2005us total) trans 21474840020 rc 0/0 00000100:00100000:3.0:1746143130.983215:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12316 00000100:00100000:0.0:1746143130.983385:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143130.983426:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3301:x1830962861240192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2722us (3804us total) trans 21474840018 rc 0/0 00000100:00100000:2.0:1746143130.983432:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12305 00002000:00010000:3.0:1746143130.983436:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:3.0:1746143130.983438:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143130.983440:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143130.983442:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:3.0:1746143130.983444:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:3.0:1746143130.983693:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3299:x1830962861239936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2560us (2596us total) trans 21474840017 rc 0/0 00000100:00100000:3.0:1746143130.983698:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12315 00000004:00080000:0.0:1746143130.983752:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d4a80/2, rc 0, transno 21474840018 00000004:00080000:1.0:1746143130.983755:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e80ea00/2, rc 0, transno 21474840019 00000100:00100000:0.0:1746143130.983757:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861240192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143130.983760:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861241216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143130.983850:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858612864 00000100:00100000:3.0:1746143130.983854:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858612864 00000004:00080000:2.0:1746143130.984124:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d5880/2, rc 0, transno 21474840017 00000100:00100000:2.0:1746143130.984128:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861239936:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143130.984141:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d6a00/2, rc 0, transno 21474840020 00000100:00100000:2.0:1746143130.984144:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861240448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143130.984757:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8143 00000100:00100000:3.0:1746143130.984765:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30915:x1830962858612864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143130.984779:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143130.985012:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf81 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650084 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.985685:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650084 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.985700:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650084 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.986308:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143130.986312:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143130.986316:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc9400, rc 0) 00000100:00100000:3.0:1746143130.987117:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30915:x1830962858612864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2349us (3729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143130.987125:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8143 00000100:00100000:0.0:1746143130.997803:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143130.998147:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143130.998347:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858612992 00000100:00100000:3.0:1746143130.998356:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858612992 00000100:00100000:3.0:1746143130.998415:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 610 00000100:00100000:3.0:1746143130.998424:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858612992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143130.998439:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143130.998468:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cf81 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650084 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143130.999311:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143130.999317:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143130.999498:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858613120 00000100:00100000:2.0:1746143130.999504:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858613120 00000100:00100000:2.0:1746143130.999765:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12319 00000100:00100000:2.0:1746143130.999771:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30912:x1830962858613120:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143130.999802:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143130.999816:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165008b expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143130.999839:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143130.999847:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 14 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143130.999854:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 17 pid: 20836 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143130.999858:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1968:x1830962858612992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1434us (2064us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143130.999865:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143130.999866:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 610 00010000:00010000:2.0:1746143130.999867:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143130.999870:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [307200->929791] (req 307200->929791) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143130.999878:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143130.999895:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 17 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143130.999905:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 17 pid: 20836 timeout: 1012 lvb_type: 1 00000100:00100000:2.0:1746143130.999916:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861241344:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143130.999932:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858613376 00000100:00100000:1.0:1746143130.999935:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858613376 00002000:00100000:1.0:1746143130.999967:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008e80d500 x1830962858613376/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/0 e 0 to 0 dl 1746143141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143130.999976:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d500 with x1830962858613376 ext(1048576->2097151) 00002000:00010000:1.0:1746143130.999981:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80d500 00000100:00100000:1.0:1746143131.000000:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5968 00000100:00100000:1.0:1746143131.000005:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858613376:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:2.0:1746143131.000142:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 14 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.000151:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00000100:00100000:2.0:1746143131.000159:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861241472:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.000196:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.000203:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 10 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:2.0:1746143131.000215:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861241600:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.000229:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801364b0780 going to sleep for 10 seconds 00000100:00100000:3.0:1746143131.001624:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.001725:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858613632 00000100:00100000:2.0:1746143131.001730:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858613632 00002000:00100000:2.0:1746143131.001818:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800a5b12a00 x1830962858613632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.001827:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b12a00 with x1830962858613632 ext(1048576->2097151) 00002000:00010000:2.0:1746143131.001833:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b12a00 00000100:00080000:1.0:1746143131.001888:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143131.001949:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5969 00000100:00100000:2.0:1746143131.001958:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858613632:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143131.004974:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861241344:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.005151:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861241472:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.005161:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861241600:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.005192:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [307200->929791] (req 307200->929791) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.005210:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497e00, rc 0) 00000100:00100000:2.0:1746143131.005448:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30912:x1830962858613120:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5675us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.005458:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12319 00000100:00100000:0.0:1746143131.008337:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.008370:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.008395:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.009066:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858613888 00000100:00100000:2.0:1746143131.009079:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858613888 00000100:00100000:3.0:1746143131.009111:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858613760 00000100:00100000:3.0:1746143131.009116:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858613760 00010000:00010000:2.0:1746143131.009125:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.009134:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 18 pid: 20836 timeout: 1012 lvb_type: 1 00000100:00100000:2.0:1746143131.009150:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858614016 00000100:00100000:2.0:1746143131.009152:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858614016 00000100:00100000:3.0:1746143131.009156:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6506 00000100:00100000:3.0:1746143131.009164:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858613888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.009164:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 11 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.009178:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143131.009178:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6507 00000100:00100000:2.0:1746143131.009184:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858613760:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.009191:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.009201:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 18 pid: 20836 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.009202:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:2.0:1746143131.009211:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 18 pid: 20836 timeout: 1012 lvb_type: 1 00000100:00100000:1.0:1746143131.009274:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6508 00000100:00100000:1.0:1746143131.009282:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858614016:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143131.009292:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.009881:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:2.0:1746143131.009906:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e57e800/0x25aee876ca70ced2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffff expref: 18 pid: 20836 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.009907:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 11 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.009916:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 11 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.009928:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135c65600/0x25aee876ca70ce2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffc7 expref: 11 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.009946:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143131.009985:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858614016:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 704us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.009991:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6508 00010000:00010000:3.0:1746143131.010124:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70cf50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650053 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.010137:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.010138:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.010145:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.010153:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.010182:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.010192:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861241728:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143131.010239:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2540 going to sleep for 11 seconds 00010000:00010000:2.0:1746143131.010377:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746143131.010386:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143131.010399:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858613760:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1215us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.010405:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6507 00000100:00100000:1.0:1746143131.015364:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858613376:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 15345us (15473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.015378:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5968 00002000:00100000:1.0:1746143131.015391:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008e80d500 x1830962858613376/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:281/0 lens 488/440 e 0 to 0 dl 1746143141 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.015401:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d500 with x1830962858613376 ext(1048576->2097151) 00002000:00010000:1.0:1746143131.015408:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80d500 00000100:00100000:3.0:1746143131.018192:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861241728:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143131.018216:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.018288:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858613888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9122us (9955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.018301:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6506 00000100:00100000:2.0:1746143131.019183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.019562:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858614272 00000100:00100000:1.0:1746143131.019572:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858614272 00002000:00100000:1.0:1746143131.019615:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (307200->311295) req@ffff8800913dfb80 x1830962858614272/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.019625:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dfb80 with x1830962858614272 ext(307200->311295) 00002000:00010000:1.0:1746143131.019631:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913dfb80 00000100:00100000:1.0:1746143131.019651:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5970 00000100:00100000:1.0:1746143131.019658:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858614272:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143131.019964:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858614272:12345-192.168.201.28@tcp:3:cat.0 Request processed in 306us (784us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143131.019971:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5970 00002000:00100000:1.0:1746143131.019977:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (307200->311295) req@ffff8800913dfb80 x1830962858614272/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.019984:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dfb80 with x1830962858614272 ext(307200->311295) 00002000:00010000:1.0:1746143131.019988:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913dfb80 00000100:00100000:0.0:1746143131.023703:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.023892:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858613632:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21926us (22264us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.023906:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5969 00002000:00100000:2.0:1746143131.023917:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800a5b12a00 x1830962858613632/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.023925:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b12a00 with x1830962858613632 ext(1048576->2097151) 00002000:00010000:2.0:1746143131.023930:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b12a00 00000100:00100000:3.0:1746143131.025168:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858614400 00000100:00100000:0.0:1746143131.025468:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.025944:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858614400 00000100:00100000:3.0:1746143131.025991:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12320 00000100:00100000:3.0:1746143131.025999:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:30911:x1830962858614400:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143131.026017:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143131.027090:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858614656 00000100:00100000:2.0:1746143131.027350:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858614656 00002000:00100000:2.0:1746143131.027616:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008eaadf80 x1830962858614656/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.027626:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaadf80 with x1830962858614656 ext(1048576->2097151) 00002000:00010000:2.0:1746143131.027633:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaadf80 00000100:00100000:2.0:1746143131.027665:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5971 00000100:00100000:2.0:1746143131.027673:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858614656:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:3.0:1746143131.028053:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650092 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.028094:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 10 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.028103:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 17 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.028109:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 29 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.028115:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.028117:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.028121:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1265664->1392639] (req 1265664->1392639) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 29 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.028150:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 29 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.028163:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 29 pid: 21048 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.028175:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861241856:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.028255:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 17 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.028277:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 17 pid: 4758 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.028286:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861241984:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.028310:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 10 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.028317:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 10 pid: 8169 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.028324:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861242112:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.028336:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.032228:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.032438:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858614784 00000100:00100000:3.0:1746143131.032447:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858614784 00000100:00100000:3.0:1746143131.032494:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8144 00000100:00100000:3.0:1746143131.032502:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:30917:x1830962858614784:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143131.032533:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.032553:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70cf96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650099 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.032618:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.032632:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.032643:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.032655:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.032661:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.032666:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.032782:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.032789:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033222:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143131.033268:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143131.033273:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143131.033290:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033300:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033308:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033314:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033320:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033326:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cc8c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143131.033330:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033337:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033348:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143131.033351:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143131.033355:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033360:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70cf9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033376:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033381:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033386:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033390:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cc8400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143131.033393:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033398:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033404:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531000) 00010000:00010000:3.0:1746143131.033406:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143131.033408:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033412:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8400/0x25aee876ca70cfa4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.033438:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70cf96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.033450:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 7 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.033456:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143131.033458:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143131.033461:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc9600, rc 0) 00000100:00100000:3.0:1746143131.034250:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30917:x1830962858614784:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1746us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.034269:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8144 00000100:00100000:2.0:1746143131.039925:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.039977:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.040059:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858615168 00000100:00100000:3.0:1746143131.040068:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858615168 00010000:00010000:3.0:1746143131.040106:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 11 pid: 8169 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.040279:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6509 00000100:00100000:3.0:1746143131.040288:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858615168:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.040303:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.040328:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 11 pid: 8169 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.040541:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 11 pid: 8169 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.040569:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.040613:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858615168:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 326us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.040620:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6509 00000100:00100000:3.0:1746143131.040662:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861241856:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.040688:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861241984:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.040699:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdee800/0x25aee876ca70ce38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffce expref: 10 pid: 8169 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.040711:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861242112:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.040739:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1265664->1392639] (req 1265664->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 30 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.040755:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc9200, rc 0) 00000100:00100000:3.0:1746143131.040951:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30911:x1830962858614400:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14953us (17258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.040958:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12320 00000100:00100000:2.0:1746143131.041586:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.041932:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858615040 00000100:00100000:0.0:1746143131.041939:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858615040 00002000:00100000:0.0:1746143131.041974:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (925696->929791) req@ffff8800913ddf80 x1830962858615040/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.041985:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913ddf80 with x1830962858615040 ext(925696->929791) 00002000:00010000:0.0:1746143131.041989:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913ddf80 00000100:00100000:0.0:1746143131.042005:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5972 00000100:00100000:0.0:1746143131.042011:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858615040:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143131.042190:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858615040:12345-192.168.201.28@tcp:3:cat.0 Request processed in 179us (2277us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143131.042197:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5972 00002000:00100000:0.0:1746143131.042203:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (925696->929791) req@ffff8800913ddf80 x1830962858615040/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.042210:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913ddf80 with x1830962858615040 ext(925696->929791) 00002000:00010000:0.0:1746143131.042213:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913ddf80 00000100:00100000:3.0:1746143131.042765:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858615296 00000100:00100000:3.0:1746143131.042770:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858615296 00010000:00010000:3.0:1746143131.042787:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 30 pid: 21048 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.042883:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6510 00000100:00100000:3.0:1746143131.042890:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858615296:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.042900:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.042914:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 30 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.042925:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 30 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.042944:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50cee00/0x25aee876ca70ced9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650006 expref: 30 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.042956:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.043879:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858615296:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 986us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.043892:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6510 00000100:00100000:0.0:1746143131.050662:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.050700:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.050724:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.050748:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.051079:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858615424 00000100:00100000:2.0:1746143131.051088:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858615424 00000100:00100000:2.0:1746143131.051125:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858615808 00000100:00100000:2.0:1746143131.051126:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858615808 00000100:00100000:2.0:1746143131.051402:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12321 00000100:00100000:2.0:1746143131.051410:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858615424:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143131.051429:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.051446:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5497200/0x25aee876ca70cfb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500a0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.051495:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861242240:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143131.052444:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12322 00000100:00100000:0.0:1746143131.052458:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858615808:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:3.0:1746143131.052463:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858615936 00000100:00100000:3.0:1746143131.052468:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858615936 00010000:00010000:0.0:1746143131.052474:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.052488:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba7a000/0x25aee876ca70cfb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500a7 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.052490:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 18 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.052509:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143131.052516:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6511 00010000:00010000:0.0:1746143131.052519:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7a000/0x25aee876ca70cfb9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500a7 expref: 11 pid: 20836 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143131.052522:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858615936:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.052529:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7a000/0x25aee876ca70cfb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500a7 expref: 11 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.052534:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.052556:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 18 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.052556:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a000, rc 0) 00010000:00010000:3.0:1746143131.052567:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 18 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.052586:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090014c00/0x25aee876ca70cf57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165005a expref: 18 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.052599:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.052601:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.052716:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 28 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.052725:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 28 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.052750:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 28 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.052766:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861242368:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143131.053508:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858615808:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1050us (2779us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143131.053515:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12322 00000100:00100000:2.0:1746143131.053542:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801364b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.054159:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858615680 00000100:00100000:0.0:1746143131.054163:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858615680 00002000:00100000:0.0:1746143131.054193:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008eaae680 x1830962858615680/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.054202:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaae680 with x1830962858615680 ext(1048576->2097151) 00002000:00010000:0.0:1746143131.054207:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaae680 00000100:00100000:3.0:1746143131.054965:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.055181:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5973 00000100:00100000:0.0:1746143131.055190:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858615680:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143131.064631:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.064698:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858616192 00000100:00100000:0.0:1746143131.064707:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858616192 00002000:00100000:0.0:1746143131.064754:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1265664->1269759) req@ffff88008e80ca80 x1830962858616192/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.064765:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80ca80 with x1830962858616192 ext(1265664->1269759) 00002000:00010000:0.0:1746143131.064771:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80ca80 00000100:00100000:0.0:1746143131.064793:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5974 00000100:00100000:0.0:1746143131.064801:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858616192:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143131.064987:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858616192:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 185us (367us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143131.064994:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5974 00002000:00100000:0.0:1746143131.065000:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1265664->1269759) req@ffff88008e80ca80 x1830962858616192/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.065008:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80ca80 with x1830962858616192 ext(1265664->1269759) 00002000:00010000:0.0:1746143131.065011:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80ca80 00002000:00010000:2.0:1746143131.065164:0:4756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143126 -> 1746143129 00002000:00010000:2.0:1746143131.065172:0:4756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143126 -> 1746143129 00002000:00010000:2.0:1746143131.065174:0:4756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143127 -> 1746143129 00000100:00100000:2.0:1746143131.065198:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861242240:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143131.065230:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5497200/0x25aee876ca70cfb2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500a0 expref: 11 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.065243:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497200/0x25aee876ca70cfb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500a0 expref: 11 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.065283:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497200, rc 0) 00000100:00100000:2.0:1746143131.065330:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858615424:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 13920us (14628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143131.065337:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12321 00000100:00100000:3.0:1746143131.065998:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861242368:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143131.066024:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.066081:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858615936:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13558us (15330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.066091:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6511 00000100:00100000:3.0:1746143131.066389:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858614656:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 38716us (40922us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143131.066396:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5971 00002000:00100000:3.0:1746143131.066403:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008eaadf80 x1830962858614656/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.066411:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaadf80 with x1830962858614656 ext(1048576->2097151) 00002000:00010000:3.0:1746143131.066416:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaadf80 00000100:00100000:3.0:1746143131.068912:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.068969:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858616448 00000100:00100000:2.0:1746143131.068981:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858616448 00000100:00100000:2.0:1746143131.069024:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3432 00000100:00100000:2.0:1746143131.069057:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30912:x1830962858616448:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143131.069343:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30912:x1830962858616448:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 310us (443us total) trans 8589942349 rc 0/0 00000100:00100000:2.0:1746143131.069350:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3432 00000100:00100000:0.0:1746143131.070941:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.071123:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858616704 00000100:00100000:2.0:1746143131.071132:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858616704 00000100:00100000:2.0:1746143131.071172:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8145 00000100:00100000:2.0:1746143131.071179:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30917:x1830962858616704:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143131.071198:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.071218:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5128a00/0x25aee876ca70cfc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500ae expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.071318:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.071333:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.071341:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.073007:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.073022:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 8 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143131.073052:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861242496:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.073149:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801364b0780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143131.074937:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858615680:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19742us (24281us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.074948:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5973 00002000:00100000:2.0:1746143131.074959:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008eaae680 x1830962858615680/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.074975:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaae680 with x1830962858615680 ext(1048576->2097151) 00002000:00010000:2.0:1746143131.074981:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaae680 00000100:00100000:0.0:1746143131.077991:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.078178:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858616960 00000100:00100000:2.0:1746143131.078184:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858616960 00002000:00100000:2.0:1746143131.078223:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1388544->1392639) req@ffff88008eaaf800 x1830962858616960/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.078235:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaaf800 with x1830962858616960 ext(1388544->1392639) 00002000:00010000:2.0:1746143131.078239:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaaf800 00000100:00100000:2.0:1746143131.078268:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5975 00000100:00100000:2.0:1746143131.078275:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858616960:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143131.078416:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858616960:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 142us (432us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143131.078421:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5975 00002000:00100000:2.0:1746143131.078425:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1388544->1392639) req@ffff88008eaaf800 x1830962858616960/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.078430:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaaf800 with x1830962858616960 ext(1388544->1392639) 00002000:00010000:2.0:1746143131.078432:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaaf800 00000100:00100000:2.0:1746143131.078462:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861242496:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.078479:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:0.0:1746143131.079741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.079899:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858617088 00000100:00100000:3.0:1746143131.079905:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858617088 00010000:00010000:3.0:1746143131.079929:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:3.0:1746143131.079950:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6512 00000100:00100000:3.0:1746143131.079955:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858617088:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.079967:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.079973:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:3.0:1746143131.079983:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:3.0:1746143131.080005:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70cfab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650099 expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:3.0:1746143131.080084:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143131.080090:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.080099:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.080106:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.080138:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.080144:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:0.0:1746143131.080163:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143131.080169:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143131.080311:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5128a00/0x25aee876ca70cfc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.080327:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.080334:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.080336:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143131.080338:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5496600, rc 0) 00000100:00100000:3.0:1746143131.080722:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858617088:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 765us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.080730:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6512 00000100:00100000:0.0:1746143131.081009:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30917:x1830962858616704:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 9829us (10072us total) trans 8589942350 rc 0/0 00000100:00100000:0.0:1746143131.081017:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8145 00000100:00100000:0.0:1746143131.087934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.088115:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858617344 00000100:00100000:1.0:1746143131.088125:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858617344 00000100:00100000:0.0:1746143131.088131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:1.0:1746143131.088173:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008eaafb80 x1830962858617344/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.088308:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaafb80 with x1830962858617344 ext(1048576->2097151) 00002000:00010000:1.0:1746143131.088315:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaafb80 00000100:00100000:2.0:1746143131.088319:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858617472 00000100:00100000:2.0:1746143131.088323:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858617472 00000100:00100000:2.0:1746143131.088359:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8146 00000100:00100000:2.0:1746143131.088368:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30917:x1830962858617472:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:1.0:1746143131.088398:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5976 00000100:00100000:1.0:1746143131.088404:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858617344:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:2.0:1746143131.088692:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.088711:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70cfd5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500b5 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.088786:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.088799:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.088805:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.088833:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.088844:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 9 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143131.088856:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861242624:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.088978:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801364b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.089469:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.089543:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858617728 00000100:00100000:3.0:1746143131.089547:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858617728 00000100:00100000:3.0:1746143131.089575:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3433 00000100:00100000:3.0:1746143131.089581:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30911:x1830962858617728:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143131.090205:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30911:x1830962858617728:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 622us (735us total) trans 8589942351 rc 0/0 00000100:00100000:2.0:1746143131.090391:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861242624:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.090408:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:3.0:1746143131.090452:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3433 00000100:00100000:0.0:1746143131.090562:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.090620:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858617856 00000100:00100000:3.0:1746143131.090624:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858617856 00010000:00010000:3.0:1746143131.090640:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00000100:00100000:3.0:1746143131.090660:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6513 00000100:00100000:3.0:1746143131.090665:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858617856:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.090674:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.090679:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:3.0:1746143131.091082:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:3.0:1746143131.091104:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5496600/0x25aee876ca70cfc7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ae expref: 10 pid: 14796 timeout: 1012 lvb_type: 0 00010000:00010000:3.0:1746143131.091118:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143131.091122:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.091130:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.091137:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.091150:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.091171:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858617856:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 506us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.091180:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6513 00010000:00010000:2.0:1746143131.091375:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.091382:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:2.0:1746143131.091413:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143131.091418:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143131.091431:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.091454:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717000/0x25aee876ca70cfd5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500b5 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.091468:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500b5 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.091475:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143131.091478:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143131.091480:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b717400, rc 0) 00000100:00100000:2.0:1746143131.091500:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30917:x1830962858617472:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 3134us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.091506:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8146 00000100:00100000:0.0:1746143131.092812:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.092889:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858618112 00000100:00100000:3.0:1746143131.092894:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858618112 00002000:00100000:3.0:1746143131.092922:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008eaaf100 x1830962858618112/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.092932:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaaf100 with x1830962858618112 ext(1048576->2097151) 00002000:00010000:3.0:1746143131.092937:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaaf100 00000100:00100000:3.0:1746143131.092964:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5977 00000100:00100000:3.0:1746143131.092971:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858618112:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143131.098749:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.099085:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858618368 00000100:00100000:3.0:1746143131.099093:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858618368 00000100:00100000:3.0:1746143131.099135:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12323 00000100:00100000:3.0:1746143131.099143:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858618368:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143131.099162:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.099179:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092cc8800/0x25aee876ca70cfe3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500c3 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.099230:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861242752:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143131.099290:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143131.101321:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.101400:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858618240 00000100:00100000:0.0:1746143131.101408:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858618240 00000100:00100000:0.0:1746143131.101444:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12324 00000100:00100000:0.0:1746143131.101452:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858618240:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143131.101469:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.101488:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7bc00/0x25aee876ca70cfea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500bc expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143131.101535:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861242880:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143131.101602:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143131.106646:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858617344:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 18228us (18872us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.106661:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5976 00002000:00100000:1.0:1746143131.106674:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008eaafb80 x1830962858617344/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.106685:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaafb80 with x1830962858617344 ext(1048576->2097151) 00002000:00010000:1.0:1746143131.106692:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaafb80 00002000:00010000:3.0:1746143131.108866:0:4756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143128 -> 1746143129 00002000:00010000:3.0:1746143131.108872:0:4756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143126 -> 1746143129 00002000:00010000:3.0:1746143131.108878:0:4756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143127 -> 1746143129 00000100:00100000:3.0:1746143131.108900:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861242752:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143131.108931:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092cc8800/0x25aee876ca70cfe3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500c3 expref: 11 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.108947:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8800/0x25aee876ca70cfe3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500c3 expref: 11 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.108957:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8800, rc 0) 00000100:00100000:3.0:1746143131.108986:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858618368:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 9843us (10248us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143131.108994:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12323 00000100:00100000:0.0:1746143131.109284:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861242880:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143131.109306:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7bc00/0x25aee876ca70cfea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500bc expref: 11 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.109316:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7bc00/0x25aee876ca70cfea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500bc expref: 11 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.109812:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7bc00, rc 0) 00000100:00100000:0.0:1746143131.110238:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858618240:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 8784us (8921us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143131.110246:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12324 00000100:00100000:3.0:1746143131.114290:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858618112:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21308us (21470us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143131.114302:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5977 00002000:00100000:3.0:1746143131.114314:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008eaaf100 x1830962858618112/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.114324:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaaf100 with x1830962858618112 ext(1048576->2097151) 00002000:00010000:3.0:1746143131.114331:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaaf100 00000100:00100000:0.0:1746143131.115826:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.115941:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858618496 00000100:00100000:2.0:1746143131.115950:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858618496 00000100:00100000:2.0:1746143131.116013:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12325 00000100:00100000:2.0:1746143131.116021:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858618496:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143131.116064:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.116082:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79b400/0x25aee876ca70cff1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500ca expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.116136:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861243008:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143131.116219:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801364b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.117318:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.117457:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861243008:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143131.117482:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c79b400/0x25aee876ca70cff1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ca expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.117496:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b400/0x25aee876ca70cff1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ca expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.117523:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79b400, rc 0) 00000100:00100000:2.0:1746143131.117551:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858618496:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1531us (1730us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143131.117559:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12325 00000100:00100000:3.0:1746143131.117919:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858618752 00000100:00100000:3.0:1746143131.117925:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858618752 00000100:00100000:3.0:1746143131.117970:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8147 00000100:00100000:3.0:1746143131.117976:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30917:x1830962858618752:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143131.117991:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.118005:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cff8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.118110:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.118128:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.118139:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:3.0:1746143131.118151:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143131.118281:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70cff8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 11 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.118293:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.118301:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143131.118303:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143131.118305:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8a00, rc 0) 00000100:00100000:3.0:1746143131.118331:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30917:x1830962858618752:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 356us (1014us total) trans 8589942352 rc 0/0 00000100:00100000:3.0:1746143131.118337:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8147 00000100:00100000:1.0:1746143131.119613:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.119671:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858618880 00000100:00100000:2.0:1746143131.119676:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858618880 00000100:00100000:2.0:1746143131.119709:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12326 00000100:00100000:2.0:1746143131.119715:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858618880:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143131.119727:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.119738:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x25aee876ca70d00d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500d8 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.119955:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861243136:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143131.120012:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801364b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.122292:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.122322:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.122346:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.122360:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.122367:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858619008 00000100:00100000:1.0:1746143131.122373:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858619008 00000100:00100000:0.0:1746143131.122375:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858619264 00000100:00100000:0.0:1746143131.122377:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858619264 00000100:00100000:0.0:1746143131.122398:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858619520 00000100:00100000:0.0:1746143131.122400:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858619520 00000100:00100000:1.0:1746143131.122426:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858619136 00000100:00100000:1.0:1746143131.122429:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858619136 00000100:00100000:1.0:1746143131.122445:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12327 00000100:00100000:1.0:1746143131.122673:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858619264:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:1.0:1746143131.122709:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.122726:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.122733:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 18 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.122740:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 26 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.122747:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.122749:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.122752:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.122795:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 26 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.122810:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 26 pid: 21048 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.122811:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12328 00000100:00100000:0.0:1746143131.122817:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858619008:12345-192.168.201.28@tcp:1:lfs.0 00000100:00100000:1.0:1746143131.122821:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091983480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861243264:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143131.122838:0:754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.122847:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.122853:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143131.122854:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143131.122856:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.122871:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 12 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.122873:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 18 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.122880:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 18 pid: 26949 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.122880:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 12 pid: 4756 timeout: 1012 lvb_type: 0 00000100:00100000:1.0:1746143131.122889:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091980a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861243520:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.122890:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861243392:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.122907:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3300 going to sleep for 11 seconds 00010000:00010000:1.0:1746143131.122910:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.122918:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 11 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.122923:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12329 00000100:00100000:1.0:1746143131.122925:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091983800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861243648:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.122928:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858619520:12345-192.168.201.28@tcp:1:lfs.0 00000100:00100000:1.0:1746143131.122940:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3769c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143131.122942:0:8448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.122952:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143131.122955:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12330 00010000:00010000:0.0:1746143131.122959:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 12 pid: 26949 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143131.122960:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858619136:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143131.122966:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.122972:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.122973:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.122974:0:8169:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.122976:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.122988:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 26 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.122993:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143131.122994:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143131.122996:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.123002:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.123009:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 26 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.123010:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.123016:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 26 pid: 4756 timeout: 1012 lvb_type: 0 00000100:00100000:0.0:1746143131.123018:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861243776:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.123023:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091982a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861243904:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143131.123073:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 12 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.123081:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 12 pid: 26949 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.123089:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861244032:192.168.201.28@tcp:104: 00002000:00010000:2.0:1746143131.123613:0:20836:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143129 -> 1746143130 00000100:00100000:2.0:1746143131.123633:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861243136:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143131.123654:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x25aee876ca70d00d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d8 expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.123664:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ac00/0x25aee876ca70d00d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d8 expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.123673:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79ac00, rc 0) 00000100:00100000:1.0:1746143131.124013:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a376a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746143131.124024:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.124047:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 11 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.124056:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861244160:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.124079:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143131.124134:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858618880:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4416us (4521us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143131.124139:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12326 00000100:00100000:1.0:1746143131.124228:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.124559:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858619392 00000100:00100000:2.0:1746143131.124563:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858619392 00000100:00100000:1.0:1746143131.125139:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.125539:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858619648 00000100:00100000:2.0:1746143131.125542:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858619648 00000100:00100000:3.0:1746143131.125573:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12331 00000100:00100000:3.0:1746143131.125581:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858619392:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:3.0:1746143131.125612:0:20836:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.125624:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 12 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.125631:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.125639:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.125645:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.125646:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.125648:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.125668:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.125677:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 16 pid: 21048 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.125686:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861244288:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.125782:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12332 00000100:00100000:2.0:1746143131.125788:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858619648:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:2.0:1746143131.125806:0:8449:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.125816:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 12 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.125822:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.125828:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 26 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.125838:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.125839:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.125841:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.125855:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 26 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.125862:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 26 pid: 21048 timeout: 1012 lvb_type: 1 00000100:00100000:2.0:1746143131.125870:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861244416:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.126319:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.126328:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 12 pid: 4758 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.126337:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861244544:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.126431:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.126440:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 16 pid: 4758 timeout: 1012 lvb_type: 1 00000100:00100000:2.0:1746143131.126680:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861244672:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.126706:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 12 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.126714:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 12 pid: 8169 timeout: 1012 lvb_type: 1 00000100:00100000:2.0:1746143131.126727:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861244800:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.126741:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801364b0780 going to sleep for 11 seconds 00010000:00010000:3.0:1746143131.126829:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 12 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.126842:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 12 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:3.0:1746143131.126850:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861244928:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.126868:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.131681:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.131748:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861243392:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143131.131771:0:754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143131.131993:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861243776:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.132195:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858619904 00000100:00100000:3.0:1746143131.132202:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858619904 00002000:00100000:3.0:1746143131.132246:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880092a70380 x1830962858619904/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.132269:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70380 with x1830962858619904 ext(2097152->3145727) 00010000:00010000:3.0:1746143131.132277:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 17 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:3.0:1746143131.132287:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 17 pid: 21048 timeout: 1012 lvb_type: 1 00002000:00010000:3.0:1746143131.132294:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a70380 00000100:00100000:1.0:1746143131.132455:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091983480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861243264:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.132465:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091980a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861243520:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.132474:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091983800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861243648:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.132499:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143131.134216:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861244032:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.134242:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861244160:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143131.134274:0:8448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143131.134355:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.134402:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091982a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861243904:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.134419:0:8169:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.134477:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861244416:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.134485:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861244672:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.134491:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861244800:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.134505:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.134522:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861244288:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.134528:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861244544:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.134534:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861244928:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.134547:0:20836:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.136226:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858620416 00000100:00100000:3.0:1746143131.136236:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858620416 00002000:00100000:3.0:1746143131.136289:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880092a73800 x1830962858620416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.136299:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73800 with x1830962858620416 ext(3145728->4194303) 00010000:00010000:3.0:1746143131.136308:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 18 pid: 21048 timeout: 1012 lvb_type: 1 00000100:00100000:1.0:1746143131.136308:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1965 00000100:00100000:1.0:1746143131.136318:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858619904:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:3.0:1746143131.136323:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 18 pid: 21048 timeout: 1012 lvb_type: 1 00002000:00010000:3.0:1746143131.136330:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a73800 00000100:00100000:3.0:1746143131.136352:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1966 00000100:00100000:3.0:1746143131.136357:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858620416:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143131.136979:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.136995:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.137011:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.137027:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858620032 00000100:00100000:0.0:1746143131.137043:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858620032 00010000:00010000:0.0:1746143131.137062:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 27 pid: 21048 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.137079:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6514 00000100:00100000:0.0:1746143131.137084:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858620032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.137093:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.137111:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 27 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137121:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 27 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137140:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce600/0x25aee876ca70cee0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165000d expref: 27 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137156:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.137191:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858620032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 107us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.137197:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6514 00000100:00100000:0.0:1746143131.137226:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.137236:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858620800 00000100:00100000:0.0:1746143131.137239:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858620800 00010000:00010000:0.0:1746143131.137247:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 13 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.137273:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6515 00000100:00100000:0.0:1746143131.137278:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858620800:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.137284:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.137291:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 13 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137298:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 13 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137309:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135c64800/0x25aee876ca70ce31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffd5 expref: 13 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137317:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.137330:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858620800:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.137335:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6515 00000100:00100000:0.0:1746143131.137379:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.137388:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858621312 00000100:00100000:0.0:1746143131.137392:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858621312 00010000:00010000:0.0:1746143131.137402:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 13 pid: 26949 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.137415:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6516 00000100:00100000:0.0:1746143131.137419:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858621312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.137426:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.137434:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 13 pid: 26949 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137442:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 13 pid: 26949 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137453:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70cf6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165006f expref: 13 pid: 26949 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137462:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.137474:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858621312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.137479:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6516 00000100:00100000:0.0:1746143131.137511:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.137522:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858622080 00000100:00100000:0.0:1746143131.137525:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858622080 00010000:00010000:0.0:1746143131.137534:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 17 pid: 26949 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.137546:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6517 00000100:00100000:0.0:1746143131.137550:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858622080:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.137556:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.137562:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 17 pid: 26949 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137569:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 17 pid: 26949 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137580:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090014a00/0x25aee876ca70cf5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650061 expref: 17 pid: 26949 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137587:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.137589:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.137594:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.137601:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.137627:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.137640:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858622080:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 90us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.137645:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6517 00000100:00100000:0.0:1746143131.137674:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.137688:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858620672 00000100:00100000:0.0:1746143131.137691:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858620672 00002000:00100000:0.0:1746143131.137707:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092a73480 x1830962858620672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.137721:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73480 with x1830962858620672 ext(2097152->3145727) 00010000:00010000:0.0:1746143131.137726:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 26 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137733:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 26 pid: 21048 timeout: 1012 lvb_type: 1 00002000:00010000:0.0:1746143131.137739:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a73480 00000100:00100000:0.0:1746143131.137749:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858621056 00000100:00100000:0.0:1746143131.137751:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858621056 00002000:00100000:0.0:1746143131.137759:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a70000 x1830962858621056/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.137765:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70000 with x1830962858621056 ext(3145728->4194303) 00010000:00010000:0.0:1746143131.137769:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 27 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.137775:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 27 pid: 21048 timeout: 1012 lvb_type: 1 00002000:00010000:0.0:1746143131.137780:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a70000 00000100:00100000:0.0:1746143131.137788:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858620288 00000100:00100000:0.0:1746143131.137789:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858620288 00002000:00100000:0.0:1746143131.137798:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fc:0x0] (307200->929791) req@ffff880093b8a300 x1830962858620288/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.137804:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8a300 with x1830962858620288 ext(307200->929791) 00010000:00010000:0.0:1746143131.137810:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 12 pid: 4756 timeout: 1012 lvb_type: 0 00010000:00010000:0.0:1746143131.137816:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 12 pid: 4756 timeout: 1012 lvb_type: 0 00002000:00010000:0.0:1746143131.137821:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093b8a300 00000100:00100000:0.0:1746143131.137831:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1967 00000100:00100000:0.0:1746143131.137835:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858620672:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:1.0:1746143131.137909:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.137917:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.137937:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.137943:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.137950:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.137955:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009490b200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143131.137958:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.137965:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.137978:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.137984:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009490b200/0x25aee876ca70d014 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143131.138025:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858619264:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 15353us (15702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.138048:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12327 00000100:00100000:1.0:1746143131.138104:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.138119:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858621184 00000100:00100000:1.0:1746143131.138121:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858621184 00002000:00100000:1.0:1746143131.138135:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1265664->1392639) req@ffff880091982a00 x1830962858621184/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.138142:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982a00 with x1830962858621184 ext(1265664->1392639) 00010000:00010000:1.0:1746143131.138147:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 28 pid: 4756 timeout: 1012 lvb_type: 0 00010000:00010000:1.0:1746143131.138153:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 28 pid: 4756 timeout: 1012 lvb_type: 0 00002000:00010000:1.0:1746143131.138158:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091982a00 00000100:00100000:1.0:1746143131.138169:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1968 00000100:00100000:1.0:1746143131.138173:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858621056:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143131.139246:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1969 00000100:00100000:0.0:1746143131.139271:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858620288:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143131.140150:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1970 00000100:00100000:1.0:1746143131.140158:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858621184:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143131.140246:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.140279:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858621440 00000100:00100000:0.0:1746143131.140282:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858621440 00010000:00010000:0.0:1746143131.140300:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 13 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.140318:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6518 00000100:00100000:0.0:1746143131.140323:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858621440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.140333:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.140345:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 13 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:1.0:1746143131.140354:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143131.140354:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 13 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:1.0:1746143131.140369:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858622208 00000100:00100000:1.0:1746143131.140372:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858622208 00010000:00010000:0.0:1746143131.140377:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135c65400/0x25aee876ca70ce4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffe3 expref: 13 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.140384:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 20 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.140388:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143131.140398:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6519 00000100:00100000:1.0:1746143131.140402:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858622208:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143131.140403:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858621440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 80us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143131.140408:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143131.140408:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6518 00010000:00010000:1.0:1746143131.140418:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 20 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.140426:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 20 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.140438:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50cec00/0x25aee876ca70cee7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650014 expref: 20 pid: 21048 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.140446:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143131.140448:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.140458:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858621696 00000100:00100000:1.0:1746143131.140459:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858622208:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.140460:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858621696 00000100:00100000:1.0:1746143131.140466:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6519 00010000:00010000:0.0:1746143131.140472:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 11 pid: 8169 timeout: 1012 lvb_type: 1 00000100:00100000:0.0:1746143131.140484:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6520 00000100:00100000:0.0:1746143131.140487:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858621696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.140494:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.140501:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 11 pid: 8169 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.140509:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 11 pid: 8169 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.140520:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdee600/0x25aee876ca70ce46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffea expref: 11 pid: 8169 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.140534:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.140548:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858621696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 60us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.140553:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6520 00000100:00100000:0.0:1746143131.140588:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.140597:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858621952 00000100:00100000:0.0:1746143131.140600:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858621952 00000100:00100000:1.0:1746143131.141804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.142547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.142568:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858621568 00000100:00100000:1.0:1746143131.142574:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858621568 00010000:00010000:1.0:1746143131.142595:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 16 pid: 4758 timeout: 1012 lvb_type: 1 00000100:00100000:1.0:1746143131.142615:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858621824 00000100:00100000:1.0:1746143131.142617:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858621824 00010000:00010000:1.0:1746143131.142625:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00000100:00100000:1.0:1746143131.142635:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6521 00000100:00100000:1.0:1746143131.142640:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858621568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143131.142649:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143131.142662:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 16 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.142671:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 16 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.142688:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090015400/0x25aee876ca70cf73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650076 expref: 16 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.142700:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143131.142721:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858621568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 81us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.142726:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6521 00000100:00100000:1.0:1746143131.142738:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6522 00000100:00100000:1.0:1746143131.142741:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858621824:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143131.142750:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143131.142761:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.142769:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.142780:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090015800/0x25aee876ca70cf65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650068 expref: 14 pid: 4758 timeout: 1012 lvb_type: 1 00010000:00010000:1.0:1746143131.142789:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143131.142801:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858621824:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 60us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.142806:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6522 00000100:00100000:1.0:1746143131.142860:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.143709:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858622336 00000100:00100000:1.0:1746143131.143714:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858622336 00010000:00010000:0.0:1746143131.145758:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 12 pid: 8449 timeout: 1012 lvb_type: 1 00000100:00100000:1.0:1746143131.146500:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12333 00000100:00100000:1.0:1746143131.146513:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30915:x1830962858622336:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143131.146532:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.146548:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500df expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.146574:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.146578:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.146589:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143131.146593:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.146609:0:8450:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.146622:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.146633:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245600, rc 0) 00000100:00100000:1.0:1746143131.146665:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30915:x1830962858622336:12345-192.168.201.28@tcp:101:cat.0 Request processed in 156us (3804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.146671:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12333 00000100:00100000:2.0:1746143131.147445:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6523 00000100:00100000:2.0:1746143131.147458:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858621952:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.147470:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.147497:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 12 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:2.0:1746143131.147508:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 12 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:2.0:1746143131.147530:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135c65000/0x25aee876ca70ce3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ffdc expref: 12 pid: 8449 timeout: 1012 lvb_type: 1 00010000:00010000:2.0:1746143131.147556:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.147561:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.147566:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.147574:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.147604:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.147620:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858621952:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 167us (7032us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.147625:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6523 00010000:00010000:3.0:1746143131.147688:0:20836:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.147698:0:20836:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.147720:0:20836:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.147728:0:20836:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.147735:0:20836:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.147743:0:20836:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cc8600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143131.147746:0:20836:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.147758:0:20836:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.147970:0:20836:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.147976:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092cc8600/0x25aee876ca70d030 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.148019:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858619392:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 22439us (23791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.148025:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12331 00000100:00100000:2.0:1746143131.160219:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858619904:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23889us (28533us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.160233:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1965 00002000:00100000:2.0:1746143131.160247:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880092a70380 x1830962858619904/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.160270:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70380 with x1830962858619904 ext(2097152->3145727) 00010000:00010000:2.0:1746143131.160282:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 18 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:2.0:1746143131.160298:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 18 pid: 21048 timeout: 1013 lvb_type: 1 00002000:00010000:2.0:1746143131.160307:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a70380 00000100:00100000:0.0:1746143131.162074:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.162188:0:14792:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858622464 00000100:00100000:3.0:1746143131.162197:0:14792:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858622464 00000100:00100000:3.0:1746143131.162246:0:14792:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 230 00000100:00100000:3.0:1746143131.162254:0:14792:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1971:x1830962858622464:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:3.0:1746143131.162879:0:14792:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1971:x1830962858622464:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 623us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.162886:0:14792:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 230 00000100:00100000:0.0:1746143131.165396:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858620672:12345-192.168.201.28@tcp:3:cat.0 Request processed in 27552us (28410us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143131.165408:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1967 00002000:00100000:0.0:1746143131.165420:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092a73480 x1830962858620672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.165429:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73480 with x1830962858620672 ext(2097152->3145727) 00010000:00010000:0.0:1746143131.165439:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 30 pid: 21048 timeout: 1012 lvb_type: 1 00010000:00010000:0.0:1746143131.165452:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 30 pid: 21048 timeout: 1013 lvb_type: 1 00002000:00010000:0.0:1746143131.165458:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a73480 00000100:00100000:2.0:1746143131.173136:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.173202:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858622592 00000100:00100000:3.0:1746143131.173212:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858622592 00000100:00100000:3.0:1746143131.173266:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12334 00000100:00100000:3.0:1746143131.173293:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30916:x1830962858622592:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.173309:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.173326:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500e6 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.173351:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.173355:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.173362:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143131.173365:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.173381:0:8450:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.173392:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.173403:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8c00, rc 0) 00000100:00100000:3.0:1746143131.173466:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:30916:x1830962858622592:12345-192.168.201.28@tcp:101:cat.0 Request processed in 185us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.173472:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12334 00000100:00100000:1.0:1746143131.174438:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858621184:12345-192.168.201.28@tcp:4:cat.0 Request processed in 34278us (36330us total) trans 17179872761 rc 0/0 00000100:00100000:1.0:1746143131.174447:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1970 00002000:00100000:1.0:1746143131.174456:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1265664->1392639) req@ffff880091982a00 x1830962858621184/t17179872761(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/448 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.174470:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982a00 with x1830962858621184 ext(1265664->1392639) 00010000:00010000:1.0:1746143131.174478:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 31 pid: 4756 timeout: 1012 lvb_type: 0 00010000:00010000:1.0:1746143131.174489:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 31 pid: 4756 timeout: 1013 lvb_type: 0 00002000:00010000:1.0:1746143131.174496:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091982a00 00000100:00100000:2.0:1746143131.175652:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858621056:12345-192.168.201.28@tcp:3:cat.0 Request processed in 37471us (38648us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.175662:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1968 00002000:00100000:2.0:1746143131.175669:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a70000 x1830962858621056/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.175677:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70000 with x1830962858621056 ext(3145728->4194303) 00010000:00010000:2.0:1746143131.175684:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 30 pid: 21048 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143131.175693:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 30 pid: 21048 timeout: 1013 lvb_type: 1 00002000:00010000:2.0:1746143131.175699:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a70000 00000100:00100000:0.0:1746143131.179196:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.179530:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858622720 00000100:00100000:2.0:1746143131.179539:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858622720 00010000:00010000:2.0:1746143131.179572:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 29 pid: 4756 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.179601:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6524 00000100:00100000:2.0:1746143131.179608:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858622720:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.179622:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.179644:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 29 pid: 4756 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.179656:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 29 pid: 4756 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.179681:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092cc9200/0x25aee876ca70cf8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1392639) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650092 expref: 29 pid: 4756 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.179705:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.179707:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.179711:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.179719:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.179748:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.179789:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858622720:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 180us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.179795:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6524 00010000:00010000:3.0:1746143131.179803:0:8169:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.179812:0:8169:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.179861:0:8169:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.179876:0:8169:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.179883:0:8169:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.179890:0:8169:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093602a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143131.179906:0:8169:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.179915:0:8169:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.179926:0:8169:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.179933:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x25aee876ca70d029 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.179976:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858619136:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 57015us (57614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.179983:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12330 00000100:00100000:3.0:1746143131.184575:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858620416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 48205us (50207us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143131.184588:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1966 00002000:00100000:3.0:1746143131.184600:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880092a73800 x1830962858620416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.184611:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73800 with x1830962858620416 ext(3145728->4194303) 00010000:00010000:3.0:1746143131.184621:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.184634:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 1013 lvb_type: 1 00002000:00010000:3.0:1746143131.184641:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a73800 00000100:00100000:0.0:1746143131.185208:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.185234:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858622848 00000100:00100000:0.0:1746143131.185241:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858622848 00010000:00010000:0.0:1746143131.185276:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 28 pid: 21048 timeout: 1013 lvb_type: 1 00000100:00100000:0.0:1746143131.186625:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6525 00000100:00100000:0.0:1746143131.186636:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858622848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.186649:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.186672:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 28 pid: 21048 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143131.186683:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 28 pid: 21048 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143131.186705:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50ce000/0x25aee876ca70cef5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650022 expref: 28 pid: 21048 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143131.186722:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.186724:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.186729:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.186737:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.187022:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143131.187299:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858620288:12345-192.168.201.28@tcp:4:cat.0 Request processed in 48044us (49621us total) trans 21474840021 rc 0/0 00000100:00100000:1.0:1746143131.187309:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1969 00002000:00100000:1.0:1746143131.187317:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fc:0x0] (307200->929791) req@ffff880093b8a300 x1830962858620288/t21474840021(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/448 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.187326:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8a300 with x1830962858620288 ext(307200->929791) 00000100:00100000:0.0:1746143131.187331:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858622848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 698us (2124us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143131.187332:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 14 pid: 4756 timeout: 1012 lvb_type: 0 00000100:00100000:0.0:1746143131.187338:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6525 00010000:00010000:1.0:1746143131.187341:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 14 pid: 4756 timeout: 1013 lvb_type: 0 00002000:00010000:1.0:1746143131.187346:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093b8a300 00010000:00010000:3.0:1746143131.187535:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187545:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187565:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187573:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187711:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187718:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79ae00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143131.187722:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187735:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187745:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.187746:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.187752:0:8449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187758:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.187786:0:8449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.187796:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861245056:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143131.187870:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143131.189909:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861245056:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143131.189932:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.189943:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79ae00/0x25aee876ca70d037 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.190004:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858619648:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 64214us (64863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.190017:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12332 00000100:00100000:0.0:1746143131.190754:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.191891:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858622976 00000100:00100000:2.0:1746143131.191901:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858622976 00010000:00010000:2.0:1746143131.191933:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 14 pid: 4756 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.191966:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6526 00000100:00100000:2.0:1746143131.191972:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858622976:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.191986:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.192010:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 14 pid: 4756 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.192020:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 14 pid: 4756 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.192066:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5497e00/0x25aee876ca70cf88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 307200->929791) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165008b expref: 14 pid: 4756 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.192093:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.192096:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.192100:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.192109:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.192129:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.192168:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858622976:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 196us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.192174:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6526 00010000:00010000:0.0:1746143131.192279:0:754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.192288:0:754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.192310:0:754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.192317:0:754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.192328:0:754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.192520:0:754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba7a400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143131.192524:0:754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.192530:0:754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.192539:0:754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.192550:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d01b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143131.192589:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858619008:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 69771us (70303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.192596:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12328 00000100:00100000:0.0:1746143131.193372:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.193657:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858623104 00000100:00100000:2.0:1746143131.193661:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858623104 00010000:00010000:2.0:1746143131.193682:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143131.193700:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6527 00000100:00100000:2.0:1746143131.193705:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858623104:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.193716:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.193729:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143131.193737:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143131.193751:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50ce200/0x25aee876ca70ceee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165001b expref: 16 pid: 21048 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143131.193761:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.193762:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.193766:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.193773:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.194757:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.194788:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858623104:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1081us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.194794:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6527 00010000:00010000:1.0:1746143131.195218:0:8448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195229:0:8448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195252:0:8448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195269:0:8448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195280:0:8448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195287:0:8448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba7a800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143131.195290:0:8448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195296:0:8448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195308:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.195309:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.195315:0:8448:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195322:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.195352:0:8448:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143131.195365:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091983800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861245184:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143131.195933:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.196761:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.196826:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858623360 00000100:00100000:1.0:1746143131.196834:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858623360 00002000:00100000:1.0:1746143131.196873:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880093b88000 x1830962858623360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.196882:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b88000 with x1830962858623360 ext(2097152->3145727) 00002000:00010000:1.0:1746143131.196887:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b88000 00000100:00100000:1.0:1746143131.196914:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5978 00000100:00100000:1.0:1746143131.196921:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858623360:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143131.202685:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091983800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861245184:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143131.202722:0:8448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.202733:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a800/0x25aee876ca70d022 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143131.202820:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858619520:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 79889us (80471us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.202831:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12329 00000100:00100000:2.0:1746143131.205803:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.205858:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858623616 00000100:00100000:3.0:1746143131.205867:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858623616 00002000:00100000:3.0:1746143131.205911:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800913dea00 x1830962858623616/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.205922:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dea00 with x1830962858623616 ext(2097152->3145727) 00002000:00010000:3.0:1746143131.205928:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913dea00 00000100:00100000:3.0:1746143131.205987:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5979 00000100:00100000:3.0:1746143131.205996:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858623616:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143131.207955:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858623360:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11026us (11189us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.207968:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5978 00002000:00100000:1.0:1746143131.207976:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880093b88000 x1830962858623360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.207985:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b88000 with x1830962858623360 ext(2097152->3145727) 00002000:00010000:1.0:1746143131.207991:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b88000 00000100:00100000:0.0:1746143131.210196:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.210222:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858623872 00000100:00100000:0.0:1746143131.210232:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858623872 00000100:00100000:0.0:1746143131.210293:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8148 00000100:00100000:0.0:1746143131.210301:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30917:x1830962858623872:12345-192.168.201.28@tcp:36:lfs.0 00010000:00010000:0.0:1746143131.210359:0:14795:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.210389:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717400/0x25aee876ca70cfdc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500b5 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.210408:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.210412:0:14795:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143131.210439:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143131.210449:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.210455:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.210462:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.210467:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 6/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143131.210494:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.210505:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 7 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143131.210517:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861245312:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143131.210586:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.210594:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 199 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143131.210601:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861245440:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143131.210620:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.210626:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 199 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143131.210633:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861245568:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.210646:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.217560:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.217589:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.217612:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858624128 00000100:00100000:0.0:1746143131.217619:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858624128 00010000:00010000:0.0:1746143131.217655:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 200 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143131.217677:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858624000 00000100:00100000:0.0:1746143131.217679:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858624000 00010000:00010000:0.0:1746143131.217687:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 8 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143131.217699:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6528 00000100:00100000:0.0:1746143131.217706:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1971:x1830962858624128:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.217719:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.217725:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 200 pid: 14794 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143131.217735:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 200 pid: 14794 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143131.217754:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.217759:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143131.217766:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.217803:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1971:x1830962858624128:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 96us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.217812:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6528 00000100:00100000:0.0:1746143131.217826:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6529 00000100:00100000:0.0:1746143131.217831:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858624000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143131.217838:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143131.217842:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 8 pid: 14794 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143131.217848:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 8 pid: 14794 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143131.217859:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.217862:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143131.217867:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.217881:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858624000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 50us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.217887:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6529 00010000:00010000:1.0:1746143131.218877:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57f800/0x25aee876ca70cf7a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165007d expref: 7 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.218914:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861245312:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.218927:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cad200/0x25aee876ca70cf49 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165004c expref: 199 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.218935:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861245440:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.218943:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861245568:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.218964:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:0.0:1746143131.222401:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.222466:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.222495:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858624256 00000100:00100000:2.0:1746143131.222508:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858624256 00010000:00010000:2.0:1746143131.222543:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 199 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.222584:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6530 00000100:00100000:2.0:1746143131.222591:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:1968:x1830962858624256:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.222607:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.222612:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 199 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.222623:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 199 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.222646:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57fc00/0x25aee876ca70cf42 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650045 expref: 199 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.222986:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143131.222990:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143131.222998:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143131.223005:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143131.223024:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.223082:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:1968:x1830962858624256:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 490us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.223088:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6530 00010000:00010000:1.0:1746143131.223252:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143131.223269:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000040:00080000:1.0:1746143131.223881:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2378, 88 off201976 00000004:00080000:1.0:1746143131.223889:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913063857233ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.223934:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2396, 88 off203296 00000004:00080000:1.0:1746143131.223939:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913063907869ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.223964:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2397, 88 off203384 00000004:00080000:1.0:1746143131.223968:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913063936242ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.223975:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2379, 88 off202064 00000004:00080000:1.0:1746143131.223978:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913063946291ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.223983:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2380, 88 off202152 00000004:00080000:1.0:1746143131.223987:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913063955519ns, next at 860071159912ns, rc = 0 00000100:00100000:1.0:1746143131.224002:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858624384 00000100:00100000:1.0:1746143131.224007:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858624384 00000100:00100000:1.0:1746143131.224047:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12335 00000100:00100000:1.0:1746143131.224053:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:30916:x1830962858624384:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143131.225869:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.225889:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500ed expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1746143131.225942:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2398, 88 off203472 00000004:00080000:3.0:1746143131.225950:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913065918305ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143131.225974:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2399, 88 off203560 00000004:00080000:3.0:1746143131.225977:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913065945203ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143131.225983:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2400, 88 off203648 00000004:00080000:3.0:1746143131.225986:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913065954570ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143131.225996:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2381, 88 off202240 00000004:00080000:3.0:1746143131.225999:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913065967453ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143131.226009:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2401, 88 off203736 00000004:00080000:3.0:1746143131.226011:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913065979923ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143131.226017:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2382, 88 off202328 00000004:00080000:3.0:1746143131.226019:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913065988051ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143131.226026:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2402, 88 off203824 00000004:00080000:3.0:1746143131.226028:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913065996448ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143131.226049:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2383, 88 off202416 00000004:00080000:3.0:1746143131.226051:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913066019871ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143131.226059:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2384, 88 off202504 00000004:00080000:3.0:1746143131.226061:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913066029735ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143131.226068:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2385, 88 off202592 00000004:00080000:3.0:1746143131.226070:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913066038781ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143131.226076:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2386, 88 off202680 00000004:00080000:3.0:1746143131.226079:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913066047183ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143131.226085:0:14795:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2403, 88 off203912 00000004:00080000:3.0:1746143131.226087:0:14795:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913066055615ns, next at 860119223596ns, rc = 0 00010000:00010000:1.0:1746143131.226140:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.226142:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.226151:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.226166:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.226177:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245a00, rc 0) 00000100:00100000:1.0:1746143131.226236:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30916:x1830962858624384:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2172us (3757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.226243:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12335 00000100:00100000:0.0:1746143131.232819:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.232849:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858624512 00000100:00100000:0.0:1746143131.232857:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858624512 00000100:00100000:0.0:1746143131.232902:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8149 00000100:00100000:0.0:1746143131.232910:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:30916:x1830962858624512:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143131.232933:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.232952:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500f4 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.233009:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143131.233018:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.233055:0:14796:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143131.233068:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.233081:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.233084:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143131.233087:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.233094:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880137757c00, rc 0) 00000100:00100000:0.0:1746143131.233139:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30916:x1830962858624512:12345-192.168.201.28@tcp:101:cat.0 Request processed in 230us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.233146:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8149 00000100:00100000:3.0:1746143131.233210:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858623616:12345-192.168.201.28@tcp:3:cat.0 Request processed in 27207us (27406us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143131.233220:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5979 00002000:00100000:3.0:1746143131.233229:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800913dea00 x1830962858623616/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.233239:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913dea00 with x1830962858623616 ext(2097152->3145727) 00002000:00010000:3.0:1746143131.233244:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913dea00 00000100:00100000:0.0:1746143131.251263:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.251346:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.251739:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858624640 00000100:00100000:1.0:1746143131.251748:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858624640 00000100:00100000:1.0:1746143131.251789:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12336 00000100:00100000:1.0:1746143131.251797:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30915:x1830962858624640:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143131.251816:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.252060:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16500fb expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143131.252666:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858624896 00000100:00100000:0.0:1746143131.252671:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858624896 00000100:00100000:0.0:1746143131.252711:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8150 00000100:00100000:0.0:1746143131.252716:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30922:x1830962858624896:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143131.252728:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.252980:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70d068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650102 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.253663:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.253676:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.253686:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.253699:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.253704:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.253709:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.254189:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.254194:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.254204:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.254218:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.254231:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245400, rc 0) 00000100:00100000:1.0:1746143131.254292:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30915:x1830962858624640:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2495us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.254299:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12336 00000100:00100000:1.0:1746143131.256811:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.256839:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858625024 00000100:00100000:1.0:1746143131.256845:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858625024 00000100:00100000:1.0:1746143131.257432:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8151 00000100:00100000:1.0:1746143131.257441:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30915:x1830962858625024:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143131.257462:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.257479:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650109 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.257541:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.257553:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.257564:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.257567:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143131.257572:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.257578:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245800, rc 0) 00000100:00100000:1.0:1746143131.257630:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30915:x1830962858625024:12345-192.168.201.28@tcp:101:cat.0 Request processed in 190us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.257636:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8151 00000004:00010000:2.0:1746143131.278682:0:14795:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093b89500 reply state ffff88009adcac00 transno 8589942353 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00000100:00100000:2.0:1746143131.278704:0:14795:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143131.278825:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30917:x1830962858623872:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 68520us (68637us total) trans 8589942353 rc 0/0 00000100:00100000:2.0:1746143131.278834:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8148 00010000:00010000:1.0:1746143131.278938:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.278953:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.278961:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.278997:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 10 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.279011:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 10 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.279023:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861245696:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.279110:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cccc0 going to sleep for 11 seconds 00000001:00080000:0.0:1746143131.279769:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942350 is committed 00000001:00080000:0.0:1746143131.279978:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942353 is committed 00000004:00080000:0.0:1746143131.279983:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1821 committed 00000004:00080000:0.0:1746143131.279994:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1809 committed 00000004:00080000:0.0:1746143131.280001:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1808 committed 00000004:00080000:0.0:1746143131.280003:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1807 committed 00000004:00080000:0.0:1746143131.280004:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1806 committed 00000004:00080000:0.0:1746143131.280005:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1820 committed 00000004:00080000:0.0:1746143131.280006:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1805 committed 00000004:00080000:0.0:1746143131.280008:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1819 committed 00000004:00080000:0.0:1746143131.280010:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1804 committed 00000004:00080000:0.0:1746143131.280012:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1818 committed 00000004:00080000:0.0:1746143131.280013:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1817 committed 00000004:00080000:0.0:1746143131.280014:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1816 committed 00000004:00080000:0.0:1746143131.280016:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1803 committed 00000004:00080000:0.0:1746143131.280018:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1802 committed 00000004:00080000:0.0:1746143131.280020:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1815 committed 00000004:00080000:0.0:1746143131.280022:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1814 committed 00010000:00010000:2.0:1746143131.280024:0:3285:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14795 initiator: MDT0 00000004:00080000:0.0:1746143131.280024:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1801 committed 00010000:00010000:2.0:1746143131.280054:0:3285:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14795 initiator: MDT0 00000001:00080000:0.0:1746143131.280055:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942349 is committed 00000001:00080000:0.0:1746143131.280063:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942351 is committed 00010000:00010000:2.0:1746143131.280064:0:3285:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143131.280070:0:3285:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e81d800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143131.280074:0:3285:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143131.280081:0:3285:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143131.280263:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143131.280266:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143131.280270:0:3285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.280278:0:3285:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.280285:0:3285:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.280297:0:3285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 6 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.280303:0:3285:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 6 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.281268:0:3285:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 6 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.281292:0:3285:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 6 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.281301:0:3285:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3285:1830962861246208:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143131.281456:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861245824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143131.281495:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143131.281516:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861246080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.281517:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861246336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143131.281531:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.281574:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143131.281603:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861245824 00000100:00100000:1.0:1746143131.281611:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861245824 00000100:00100000:1.0:1746143131.281645:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861246080 00000100:00100000:1.0:1746143131.281647:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861246080 00000100:00100000:1.0:1746143131.281656:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861246336 00000100:00100000:1.0:1746143131.281658:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861246336 00000100:00100000:1.0:1746143131.281669:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12337 00000100:00100000:1.0:1746143131.281674:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3302:x1830962861245824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.281690:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12338 00000100:00100000:0.0:1746143131.281701:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3300:x1830962861246080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143131.281864:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3302:x1830962861245824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (368us total) trans 17179872762 rc 0/0 00000100:00100000:1.0:1746143131.281870:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12337 00002000:00010000:0.0:1746143131.281875:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143131.281878:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143128 -> 1746143128 00002000:00010000:0.0:1746143131.281880:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143127 -> 1746143127 00000100:00100000:1.0:1746143131.281882:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12339 00002000:00010000:0.0:1746143131.281882:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143128 -> 1746143128 00002000:00010000:0.0:1746143131.281883:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143131.281886:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3301:x1830962861246336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.281916:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3300:x1830962861246080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (383us total) trans 17179872763 rc 0/0 00000100:00100000:0.0:1746143131.281922:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12338 00000100:00100000:1.0:1746143131.281966:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3301:x1830962861246336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (393us total) trans 17179872764 rc 0/0 00000100:00100000:1.0:1746143131.281972:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12339 00010000:00010000:2.0:1746143131.282011:0:3285:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.282021:0:3285:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3285:1830962861246976:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.282152:0:3285:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84e2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143131.282243:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861245952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.282310:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.282322:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861246592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.282336:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.282343:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861247232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.282357:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.282365:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861247744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.282379:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143131.282785:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8bb80/2, rc 0, transno 17179872763 00000100:00100000:0.0:1746143131.282792:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861246080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.282799:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861246720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.282823:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746143131.283604:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143131.283677:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143131.283685:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861247360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143131.283989:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eaad180/2, rc 0, transno 17179872764 00000100:00100000:0.0:1746143131.283996:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861246336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.284003:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861245952 00000100:00100000:0.0:1746143131.284003:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861246848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.284009:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861245952 00000100:00100000:0.0:1746143131.284026:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.285057:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861247488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.285081:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143131.285105:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861246592 00000100:00100000:3.0:1746143131.285110:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861246592 00000100:00100000:3.0:1746143131.285135:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861247232 00000100:00100000:3.0:1746143131.285138:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861247232 00000100:00100000:3.0:1746143131.285156:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861247744 00000100:00100000:3.0:1746143131.285159:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861247744 00000100:00100000:3.0:1746143131.285169:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861246720 00000100:00100000:3.0:1746143131.285171:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861246720 00000100:00100000:3.0:1746143131.285180:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861246848 00000100:00100000:3.0:1746143131.285182:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861246848 00000100:00100000:3.0:1746143131.285193:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12340 00000100:00100000:3.0:1746143131.285200:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3299:x1830962861245952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143131.285415:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3299:x1830962861245952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (3103us total) trans 17179872765 rc 0/0 00000100:00100000:3.0:1746143131.285422:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12340 00000100:00100000:3.0:1746143131.285437:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12341 00000100:00100000:3.0:1746143131.285442:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3299:x1830962861246592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143131.285520:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3299:x1830962861246592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (3183us total) trans 17179872766 rc 0/0 00000100:00100000:3.0:1746143131.285525:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12341 00000100:00100000:3.0:1746143131.285536:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12342 00000100:00100000:3.0:1746143131.285540:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3299:x1830962861247232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143131.285647:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3299:x1830962861247232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (3289us total) trans 21474840022 rc 0/0 00000100:00100000:3.0:1746143131.285653:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12342 00000100:00100000:3.0:1746143131.285661:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12343 00000100:00100000:3.0:1746143131.285665:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3299:x1830962861247744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143131.285741:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3299:x1830962861247744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (3361us total) trans 21474840023 rc 0/0 00000100:00100000:3.0:1746143131.285746:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12343 00000100:00100000:3.0:1746143131.285871:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12344 00000100:00100000:3.0:1746143131.285876:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3300:x1830962861246720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143131.285967:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12345 00000100:00100000:1.0:1746143131.285975:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3301:x1830962861246848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143131.286096:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3301:x1830962861246848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (2069us total) trans 17179872768 rc 0/0 00000100:00100000:1.0:1746143131.286101:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12345 00000004:00080000:1.0:1746143131.286151:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b88a80/2, rc 0, transno 17179872762 00000100:00100000:1.0:1746143131.286159:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861245824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143131.286167:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861246464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143131.286276:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.286297:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.286687:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.286710:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858625152 00000100:00100000:1.0:1746143131.286713:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858625152 00000100:00100000:1.0:1746143131.286738:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8152 00000100:00100000:1.0:1746143131.286743:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30917:x1830962858625152:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143131.286759:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.286777:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650110 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.286826:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.287054:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.287076:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.287079:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143131.287082:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc9a00, rc 0) 00000100:00100000:2.0:1746143131.287142:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861247488 00000100:00100000:2.0:1746143131.287147:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861247488 00000100:00100000:2.0:1746143131.287172:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12346 00000100:00100000:2.0:1746143131.287178:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3301:x1830962861247488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143131.287884:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858625280 00000100:00100000:3.0:1746143131.287887:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858625280 00000100:00100000:3.0:1746143131.287909:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3434 00000100:00100000:3.0:1746143131.287914:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30915:x1830962858625280:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143131.288053:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858625408 00000100:00100000:2.0:1746143131.288057:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858625408 00010000:00010000:2.0:1746143131.288075:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 10 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.288095:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6531 00000100:00100000:2.0:1746143131.288100:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858625408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.288107:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.288112:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 10 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.288122:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 10 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.288143:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143131.288147:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143131.288154:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143131.288160:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143131.288174:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.288200:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858625408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 100us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.288206:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6531 00000100:00100000:2.0:1746143131.288226:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.288252:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861247872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.288285:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143131.288308:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8b480/2, rc 0, transno 17179872765 00000100:00100000:2.0:1746143131.288312:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861245952:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143131.288321:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb75180/2, rc 0, transno 17179872766 00000100:00100000:2.0:1746143131.288324:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861246592:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143131.288332:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913dc380/2, rc 0, transno 21474840022 00000100:00100000:2.0:1746143131.288339:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861247232:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143131.288346:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e4e00/2, rc 0, transno 21474840023 00000100:00100000:2.0:1746143131.288349:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861247744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.288364:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861247360 00000100:00100000:2.0:1746143131.288367:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861247360 00000100:00100000:2.0:1746143131.288378:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861247872 00000100:00100000:2.0:1746143131.288380:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861247872 00000100:00100000:2.0:1746143131.288389:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12347 00000100:00100000:2.0:1746143131.288392:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3299:x1830962861247360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143131.288483:0:21048:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:2.0:1746143131.288486:0:21048:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143127 -> 1746143127 00002000:00010000:2.0:1746143131.288489:0:21048:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143127 -> 1746143127 00002000:00010000:2.0:1746143131.288490:0:21048:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:2.0:1746143131.288492:0:21048:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:2.0:1746143131.288513:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3299:x1830962861247360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (287us total) trans 21474840025 rc 0/0 00000100:00100000:2.0:1746143131.288517:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12347 00000100:00100000:2.0:1746143131.288525:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12348 00000100:00100000:2.0:1746143131.288529:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3299:x1830962861247872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143131.288588:0:21048:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143131.288590:0:21048:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143131.288592:0:21048:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143131.288593:0:21048:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143131.288595:0:21048:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143131.288611:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3299:x1830962861247872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (325us total) trans 21474840026 rc 0/0 00000100:00100000:2.0:1746143131.288616:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12348 00000004:00080000:2.0:1746143131.288672:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913dce00/2, rc 0, transno 21474840025 00000100:00100000:2.0:1746143131.288675:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861247360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143131.288681:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e5180/2, rc 0, transno 21474840026 00000100:00100000:2.0:1746143131.288683:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861247872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.288702:0:3285:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913de300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3285:1830962861246208:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.288727:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3301:x1830962861247488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1550us (3645us total) trans 21474840024 rc 0/0 00000100:00100000:2.0:1746143131.288733:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12346 00000004:00080000:0.0:1746143131.288816:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913de680/2, rc 0, transno 21474840024 00000100:00100000:0.0:1746143131.288820:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861247488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.288825:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861248000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.288844:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143131.288860:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009535e680/2, rc 0, transno 17179872768 00000100:00100000:0.0:1746143131.288862:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861246848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.288869:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746143131.288874:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861247104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.288887:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.288897:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861247616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.288909:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.288919:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861248128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.288930:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.288950:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861248000 00000100:00100000:0.0:1746143131.288953:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861248000 00000100:00100000:0.0:1746143131.288968:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861247104 00000100:00100000:0.0:1746143131.288970:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861247104 00000100:00100000:0.0:1746143131.288976:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861247616 00000100:00100000:0.0:1746143131.288978:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861247616 00000100:00100000:0.0:1746143131.288984:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861248128 00000100:00100000:0.0:1746143131.288985:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861248128 00000100:00100000:0.0:1746143131.288994:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12349 00000100:00100000:0.0:1746143131.288998:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962861248000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.289111:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3301:x1830962861248000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (266us total) trans 21474840027 rc 0/0 00000100:00100000:0.0:1746143131.289116:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12349 00000100:00100000:0.0:1746143131.289125:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12350 00000100:00100000:0.0:1746143131.289129:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962861247104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.289200:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3301:x1830962861247104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (311us total) trans 21474840028 rc 0/0 00000100:00100000:0.0:1746143131.289204:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12350 00000100:00100000:0.0:1746143131.289212:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12351 00000100:00100000:0.0:1746143131.289215:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962861247616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.289285:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3301:x1830962861247616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (374us total) trans 21474840029 rc 0/0 00000100:00100000:0.0:1746143131.289290:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12351 00000100:00100000:0.0:1746143131.289297:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12352 00000100:00100000:0.0:1746143131.289301:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962861248128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.289358:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3301:x1830962861248128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (427us total) trans 21474840030 rc 0/0 00000100:00100000:0.0:1746143131.289362:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12352 00000004:00080000:0.0:1746143131.289412:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913dc000/2, rc 0, transno 21474840028 00000100:00100000:0.0:1746143131.289416:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861247104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143131.289420:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913dd880/2, rc 0, transno 21474840029 00000100:00100000:0.0:1746143131.289423:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861247616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143131.289428:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e4000/2, rc 0, transno 21474840030 00000100:00100000:0.0:1746143131.289430:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861248128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143131.289434:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e5500/2, rc 0, transno 21474840027 00000100:00100000:0.0:1746143131.289436:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861248000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143131.289504:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30917:x1830962858625152:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 2759us (3228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.289511:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8152 00000100:00100000:1.0:1746143131.289637:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143131.289661:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861246464 00000100:00100000:1.0:1746143131.289665:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861246464 00000100:00100000:1.0:1746143131.289680:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12353 00000100:00100000:1.0:1746143131.289685:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3302:x1830962861246464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143131.289783:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3302:x1830962861246464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (146us total) trans 17179872769 rc 0/0 00000100:00100000:1.0:1746143131.289790:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12353 00000004:00080000:1.0:1746143131.289806:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092a70700/2, rc 0, transno 17179872769 00000100:00100000:1.0:1746143131.289809:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861246464:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746143131.289826:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70cfff lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500d1 expref: 8 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.289837:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861245696:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.289851:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.289859:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.289864:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:1.0:1746143131.289878:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143131.289999:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290006:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290011:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290017:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093245000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143131.290020:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290026:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290037:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.290039:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143131.290042:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290063:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d084 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290076:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290081:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290085:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290089:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79a800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143131.290091:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290094:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290100:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143131.290102:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143131.290104:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290108:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d06f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290114:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290119:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290124:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290127:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79ba00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143131.290129:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290132:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290136:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009494dd00) 00010000:00010000:1.0:1746143131.290138:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143131.290139:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290143:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ba00/0x25aee876ca70d076 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.290179:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70d068 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650102 expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.290185:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70d068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650102 expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.290192:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79a400, rc 0) 00000100:00100000:1.0:1746143131.290213:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30922:x1830962858624896:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 37496us (38867us total) trans 8589942354 rc 301/301 00000100:00100000:1.0:1746143131.290221:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8150 00000100:00080000:3.0:1746143131.290638:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143131.290659:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30915:x1830962858625280:12345-192.168.201.28@tcp:49:cat.0 Request processed in 2742us (4359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.290668:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3434 00000100:00100000:3.0:1746143131.290745:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3300:x1830962861246720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4868us (7920us total) trans 17179872767 rc 0/0 00000100:00100000:3.0:1746143131.290750:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12344 00000004:00080000:3.0:1746143131.290778:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eb76680/2, rc 0, transno 17179872767 00000100:00100000:3.0:1746143131.290782:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861246720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.292194:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.292264:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858625536 00000100:00100000:2.0:1746143131.292271:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858625536 00000100:00100000:2.0:1746143131.292746:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3435 00000100:00100000:2.0:1746143131.292754:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30916:x1830962858625536:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143131.293049:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30916:x1830962858625536:12345-192.168.201.28@tcp:49:cat.0 Request processed in 296us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.293056:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3435 00000100:00100000:3.0:1746143131.293374:0:3285:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3285:1830962861246976:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143131.293399:0:3285:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143131.293407:0:3285:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e81d800/0x25aee876ca70d04c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14795 initiator: MDT0 00000100:00100000:0.0:1746143131.298740:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.298828:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858625792 00000100:00100000:3.0:1746143131.298838:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858625792 00000100:00100000:2.0:1746143131.299166:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3436 00000100:00100000:2.0:1746143131.299178:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30917:x1830962858625792:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:2.0:1746143131.299423:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30917:x1830962858625792:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 248us (695us total) trans 8589942355 rc 0/0 00000100:00100000:2.0:1746143131.299430:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3436 00000100:00100000:0.0:1746143131.310093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.310132:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.310223:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.310316:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858626304 00000100:00100000:1.0:1746143131.310325:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858626304 00000100:00100000:1.0:1746143131.310369:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8153 00000100:00100000:1.0:1746143131.310376:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30922:x1830962858626304:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143131.310400:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.310404:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143131.310432:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880137757c00/0x25aee876ca70d05a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500f4 expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.310450:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.310454:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143131.310465:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef600/0x25aee876ca70d099 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650117 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.310531:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.310542:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 6 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.310550:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 7 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.310555:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.310582:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 7 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.310594:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 7 pid: 14795 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.310605:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861248256:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.310685:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 6 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.310693:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 6 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.310700:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861248384:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.310717:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143131.311023:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858626048 00000100:00100000:3.0:1746143131.311027:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858626048 00000100:00100000:3.0:1746143131.311071:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3437 00000100:00100000:3.0:1746143131.311077:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30917:x1830962858626048:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:3.0:1746143131.311264:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30917:x1830962858626048:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 175us (1172us total) trans 8589942356 rc 0/0 00000100:00100000:3.0:1746143131.311272:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3437 00000100:00100000:2.0:1746143131.311346:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858626560 00000100:00100000:2.0:1746143131.311351:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858626560 00002000:00100000:2.0:1746143131.311381:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880136beb800 x1830962858626560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.311391:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beb800 with x1830962858626560 ext(3145728->4194303) 00002000:00010000:2.0:1746143131.311395:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136beb800 00000100:00100000:2.0:1746143131.311408:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5980 00000100:00100000:2.0:1746143131.311413:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858626560:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143131.321828:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.321868:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.324448:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.324926:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858626944 00000100:00100000:1.0:1746143131.324935:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858626944 00002000:00100000:1.0:1746143131.324983:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880136bebb80 x1830962858626944/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.324994:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136bebb80 with x1830962858626944 ext(3145728->4194303) 00002000:00010000:1.0:1746143131.325000:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136bebb80 00000100:00100000:0.0:1746143131.326197:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.327041:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858627200 00000100:00100000:3.0:1746143131.327047:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858627200 00010000:00010000:3.0:1746143131.327080:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 9 pid: 14795 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.327110:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858627328 00000100:00100000:2.0:1746143131.327362:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858627072 00000100:00100000:2.0:1746143131.327367:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858627072 00002000:00100000:2.0:1746143131.327398:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880136be9180 x1830962858627072/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.327406:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9180 with x1830962858627072 ext(2097152->3145727) 00002000:00010000:2.0:1746143131.327411:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136be9180 00000100:00100000:2.0:1746143131.327428:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5981 00000100:00100000:2.0:1746143131.327437:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858626944:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143131.328864:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5982 00000100:00100000:2.0:1746143131.328875:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858627072:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143131.330194:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6532 00000100:00100000:2.0:1746143131.330205:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858627200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.330220:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.330232:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 9 pid: 14795 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.330247:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 9 pid: 14795 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.330282:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143131.330287:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143131.330294:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143131.330299:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.330330:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858627200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 127us (5888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.330336:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6532 00000100:00100000:3.0:1746143131.333775:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858627328 00010000:00010000:3.0:1746143131.333823:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 7 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.333875:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6533 00000100:00100000:3.0:1746143131.333883:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1971:x1830962858627328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.333899:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.333905:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 7 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.333916:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 7 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.333938:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143131.333943:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143131.333952:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143131.333960:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143131.333977:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143131.334588:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9a00/0x25aee876ca70d08b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650110 expref: 8 pid: 14795 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.334613:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861248256:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.334625:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d07d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650109 expref: 7 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.334639:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861248384:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.334663:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.334671:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.334675:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000040:00080000:1.0:1746143131.335711:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2387, 88 off202768 00000004:00080000:1.0:1746143131.335719:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913175686777ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.335967:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2404, 88 off204000 00000004:00080000:1.0:1746143131.335971:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913175939257ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.335983:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2405, 88 off204088 00000004:00080000:1.0:1746143131.335986:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913175955127ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.335994:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2388, 88 off202856 00000004:00080000:1.0:1746143131.335997:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913175965304ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.336003:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2389, 88 off202944 00000004:00080000:1.0:1746143131.336005:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913175973872ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.336012:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2406, 88 off204176 00000004:00080000:1.0:1746143131.336014:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913175982530ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.336020:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2407, 88 off204264 00000004:00080000:1.0:1746143131.336022:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913175990635ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.336028:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2408, 88 off204352 00000004:00080000:1.0:1746143131.336045:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913176013245ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.336052:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2390, 88 off203032 00000004:00080000:1.0:1746143131.336056:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913176024110ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.336062:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2409, 88 off204440 00000004:00080000:1.0:1746143131.336065:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913176033109ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.336071:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2391, 88 off203120 00000004:00080000:1.0:1746143131.336073:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913176041790ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.336079:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2410, 88 off204528 00000004:00080000:1.0:1746143131.336081:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913176049974ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143131.336087:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2392, 88 off203208 00000004:00080000:1.0:1746143131.336090:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913176058237ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.336096:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2393, 88 off203296 00000004:00080000:1.0:1746143131.336099:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913176067383ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.336105:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2394, 88 off203384 00000004:00080000:1.0:1746143131.336108:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913176076415ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.336114:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2395, 88 off203472 00000004:00080000:1.0:1746143131.336116:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913176084935ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143131.336122:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2411, 88 off204616 00000004:00080000:1.0:1746143131.336125:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913176093215ns, next at 860119223596ns, rc = 0 00000100:00100000:0.0:1746143131.346130:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.346213:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.346236:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858627584 00000100:00100000:0.0:1746143131.346245:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858627584 00002000:00100000:0.0:1746143131.346295:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880136be9880 x1830962858627584/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.346306:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9880 with x1830962858627584 ext(3145728->4194303) 00002000:00010000:0.0:1746143131.346311:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136be9880 00000100:00100000:0.0:1746143131.346333:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858627840 00000100:00100000:0.0:1746143131.346335:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858627840 00002000:00100000:0.0:1746143131.346345:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880136be9c00 x1830962858627840/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.346352:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9c00 with x1830962858627840 ext(3145728->4194303) 00002000:00010000:0.0:1746143131.346355:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136be9c00 00000100:00100000:0.0:1746143131.346369:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5983 00000100:00100000:0.0:1746143131.346376:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858627584:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143131.348182:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5984 00000100:00100000:3.0:1746143131.348193:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858627840:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143131.350152:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858626560:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 38733us (39922us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.350162:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5980 00002000:00100000:1.0:1746143131.350170:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880136beb800 x1830962858626560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.350181:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136beb800 with x1830962858626560 ext(3145728->4194303) 00002000:00010000:1.0:1746143131.350187:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136beb800 00000100:00100000:3.0:1746143131.353641:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:1971:x1830962858627328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 19747us (27433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.353655:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6533 00000100:00100000:0.0:1746143131.357229:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858626944:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 29784us (35402us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143131.357240:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5981 00002000:00100000:0.0:1746143131.357261:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880136bebb80 x1830962858626944/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.357272:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136bebb80 with x1830962858626944 ext(3145728->4194303) 00002000:00010000:0.0:1746143131.357278:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136bebb80 00000100:00100000:0.0:1746143131.366304:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.366345:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.366349:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858627968 00000100:00100000:0.0:1746143131.366357:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858627968 00000100:00100000:1.0:1746143131.367367:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858628224 00000100:00100000:1.0:1746143131.367372:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858628224 00000100:00100000:0.0:1746143131.370666:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8154 00000100:00100000:0.0:1746143131.370685:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30916:x1830962858627968:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143131.370707:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.370729:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165011e expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.370793:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.370801:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 202 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.370823:0:14796:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.370836:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 202 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.370848:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.370851:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143131.370854:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 202 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.370860:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79a000, rc 0) 00000100:00100000:0.0:1746143131.370915:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:30916:x1830962858627968:12345-192.168.201.28@tcp:101:cat.0 Request processed in 238us (4622us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.370921:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8154 00000100:00100000:0.0:1746143131.370940:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8155 00000100:00100000:0.0:1746143131.370945:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:30924:x1830962858628224:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143131.370953:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.370959:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d0ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650125 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.374876:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00000100:00100000:2.0:1746143131.375000:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858627072:12345-192.168.201.28@tcp:3:cat.0 Request processed in 46119us (53121us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.375012:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5982 00002000:00100000:2.0:1746143131.375024:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880136be9180 x1830962858627072/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.375058:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9180 with x1830962858627072 ext(2097152->3145727) 00002000:00010000:2.0:1746143131.375064:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136be9180 00010000:00010000:0.0:1746143131.376152:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.376163:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.376179:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.376186:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.376191:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.376301:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.376309:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.376315:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:0.0:1746143131.376324:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143131.377699:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377707:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377713:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377718:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79b600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143131.377722:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377728:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377738:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.377741:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746143131.377745:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377750:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b600/0x25aee876ca70d0c3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377761:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377766:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.377770:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378853:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79ae00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143131.378856:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378863:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378872:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143131.378874:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143131.378877:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378882:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d0b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378890:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378895:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378901:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378904:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79a200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143131.378907:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378911:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378918:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009494d000) 00010000:00010000:0.0:1746143131.378921:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143131.378923:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.378928:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a200/0x25aee876ca70d0bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143131.380364:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d0ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650125 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.380372:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a800/0x25aee876ca70d0ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650125 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.380380:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79a800, rc 0) 00000100:00100000:0.0:1746143131.380444:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30924:x1830962858628224:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9497us (14107us total) trans 8589942358 rc 301/301 00000100:00100000:0.0:1746143131.380453:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8155 00000100:00100000:0.0:1746143131.385817:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.385843:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858628352 00000100:00100000:0.0:1746143131.385880:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858628352 00000100:00100000:3.0:1746143131.385977:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858627840:12345-192.168.201.28@tcp:3:cat.0 Request processed in 37784us (39760us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143131.385987:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5984 00002000:00100000:3.0:1746143131.385997:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880136be9c00 x1830962858627840/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.386006:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9c00 with x1830962858627840 ext(3145728->4194303) 00002000:00010000:3.0:1746143131.386011:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136be9c00 00000100:00100000:0.0:1746143131.386394:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8156 00000100:00100000:0.0:1746143131.386402:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:30915:x1830962858628352:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143131.386416:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.386432:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165012c expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.386476:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.386486:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.386496:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.386800:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143131.386806:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.386813:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efa3e00, rc 0) 00000100:00100000:0.0:1746143131.387028:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30915:x1830962858628352:12345-192.168.201.28@tcp:101:cat.0 Request processed in 626us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.387050:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8156 00000100:00100000:1.0:1746143131.394416:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858627584:12345-192.168.201.28@tcp:3:cat.0 Request processed in 48032us (48289us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.394427:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5983 00002000:00100000:1.0:1746143131.394437:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880136be9880 x1830962858627584/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.394445:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9880 with x1830962858627584 ext(3145728->4194303) 00002000:00010000:1.0:1746143131.394450:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136be9880 00000001:00080000:0.0:1746143131.398422:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942357 is committed 00000004:00080000:0.0:1746143131.398430:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1829 committed 00000004:00080000:0.0:1746143131.398442:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1818 committed 00000004:00080000:0.0:1746143131.398452:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1817 committed 00000004:00080000:0.0:1746143131.398454:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1816 committed 00000004:00080000:0.0:1746143131.398455:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1815 committed 00000004:00080000:0.0:1746143131.398457:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1828 committed 00000004:00080000:0.0:1746143131.398459:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1814 committed 00000004:00080000:0.0:1746143131.398460:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1827 committed 00000004:00080000:0.0:1746143131.398462:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1813 committed 00000004:00080000:0.0:1746143131.398463:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1826 committed 00000004:00080000:0.0:1746143131.398464:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1825 committed 00000004:00080000:0.0:1746143131.398467:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1824 committed 00000004:00080000:0.0:1746143131.398469:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1812 committed 00000004:00080000:0.0:1746143131.398470:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1811 committed 00000004:00080000:0.0:1746143131.398471:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1823 committed 00000004:00080000:0.0:1746143131.398473:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1822 committed 00000004:00080000:0.0:1746143131.398474:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1810 committed 00000001:00080000:0.0:1746143131.398483:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942355 is committed 00000001:00080000:0.0:1746143131.398489:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942356 is committed 00000100:00100000:2.0:1746143131.398579:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861248512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143131.398593:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861248640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.398672:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861248768:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746143131.398698:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.398709:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.398712:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143131.398715:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.398725:0:14794:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.398731:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.398737:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 7 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.398742:0:14794:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 7 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.398747:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 7 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.398797:0:14794:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 7 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143131.398807:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861250560:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.398878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.398915:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.398928:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861248896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.399075:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861248512 00000100:00100000:2.0:1746143131.399082:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861248512 00000100:00100000:0.0:1746143131.399089:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.399106:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.399116:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fdea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.399120:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861248768 00000100:00100000:2.0:1746143131.399122:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861248768 00000100:00100000:0.0:1746143131.399126:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.399137:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861249280 00000100:00100000:0.0:1746143131.399137:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861250304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.399138:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861249280 00000100:00100000:2.0:1746143131.399149:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861249792 00000100:00100000:0.0:1746143131.399149:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.399151:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861249792 00000100:00100000:2.0:1746143131.399162:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861250304 00000100:00100000:2.0:1746143131.399164:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861250304 00000100:00100000:0.0:1746143131.399166:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746143131.399170:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.399180:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12354 00000100:00100000:0.0:1746143131.399182:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.399192:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.399203:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.399211:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.399222:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.399228:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861250432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.399239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.399267:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861249024 00000100:00100000:0.0:1746143131.399273:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861249024 00000100:00100000:0.0:1746143131.399291:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861249408 00000100:00100000:0.0:1746143131.399293:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861249408 00000100:00100000:0.0:1746143131.399299:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861249920 00000100:00100000:0.0:1746143131.399300:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861249920 00000100:00100000:0.0:1746143131.399306:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861250432 00000100:00100000:0.0:1746143131.399307:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861250432 00000100:00100000:0.0:1746143131.399315:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12355 00000100:00100000:0.0:1746143131.399321:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3301:x1830962861248768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143131.399463:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143131.399466:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143128 -> 1746143128 00002000:00010000:0.0:1746143131.399468:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143127 -> 1746143127 00002000:00010000:0.0:1746143131.399470:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143128 -> 1746143128 00002000:00010000:0.0:1746143131.399472:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143131.399497:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962861248768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (582us total) trans 17179872770 rc 0/0 00000100:00100000:0.0:1746143131.399502:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12355 00000100:00100000:0.0:1746143131.399515:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12356 00000100:00100000:0.0:1746143131.399519:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3301:x1830962861249280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.399593:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962861249280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (485us total) trans 17179872771 rc 0/0 00000100:00100000:0.0:1746143131.399597:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12356 00000100:00100000:0.0:1746143131.399607:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12357 00000100:00100000:0.0:1746143131.399612:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3301:x1830962861249792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.399681:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962861249792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (553us total) trans 17179872772 rc 0/0 00000100:00100000:0.0:1746143131.399685:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12357 00000100:00100000:0.0:1746143131.399694:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12358 00000100:00100000:0.0:1746143131.399698:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3301:x1830962861250304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143131.399972:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143131.399974:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143131.399976:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143131.399977:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143131.399979:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143131.399998:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3301:x1830962861250304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (847us total) trans 21474840031 rc 0/0 00000100:00100000:0.0:1746143131.400002:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12358 00000100:00100000:0.0:1746143131.400012:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12359 00000100:00100000:0.0:1746143131.400016:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3301:x1830962861249024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.400113:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3301:x1830962861249024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (930us total) trans 17179872773 rc 0/0 00000100:00100000:0.0:1746143131.400118:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12359 00000100:00100000:0.0:1746143131.400127:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12360 00000100:00100000:0.0:1746143131.400131:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3301:x1830962861249408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.400158:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3299:x1830962861248512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143131.400199:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3301:x1830962861249408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (995us total) trans 21474840032 rc 0/0 00000100:00100000:0.0:1746143131.400204:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12360 00000100:00100000:0.0:1746143131.400211:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12361 00000100:00100000:0.0:1746143131.400216:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3301:x1830962861249920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.400290:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3301:x1830962861249920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1066us total) trans 21474840033 rc 0/0 00000100:00100000:0.0:1746143131.400295:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12361 00000100:00100000:0.0:1746143131.400304:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12362 00000100:00100000:0.0:1746143131.400307:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3301:x1830962861250432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.400369:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3301:x1830962861250432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (1128us total) trans 21474840034 rc 0/0 00000100:00100000:0.0:1746143131.400373:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12362 00000004:00080000:0.0:1746143131.400404:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fde8e00/2, rc 0, transno 17179872773 00000100:00100000:0.0:1746143131.400408:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143131.400415:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb56d80/2, rc 0, transno 21474840032 00000100:00100000:0.0:1746143131.400423:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143131.400428:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb55880/2, rc 0, transno 21474840033 00000100:00100000:0.0:1746143131.400431:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143131.400436:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b89180/2, rc 0, transno 21474840034 00000100:00100000:0.0:1746143131.400439:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861250432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143131.400443:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009535c380/2, rc 0, transno 17179872770 00000100:00100000:0.0:1746143131.400446:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861248768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143131.400451:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fde8380/2, rc 0, transno 17179872771 00000100:00100000:0.0:1746143131.400453:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143131.400459:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fdea680/2, rc 0, transno 17179872772 00000100:00100000:0.0:1746143131.400461:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fdea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861249792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143131.400469:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b88380/2, rc 0, transno 21474840031 00000100:00100000:0.0:1746143131.400471:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861250304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.400475:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3299:x1830962861248512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1287us (1597us total) trans 17179872774 rc 0/0 00000100:00100000:2.0:1746143131.400482:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12354 00000100:00100000:2.0:1746143131.400513:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.400538:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861249536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.400570:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143131.400590:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861248896 00000100:00100000:2.0:1746143131.400593:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861248896 00000100:00100000:2.0:1746143131.400607:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861249536 00010000:00010000:1.0:1746143131.400608:0:14794:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.400609:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861249536 00000100:00100000:2.0:1746143131.400617:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12363 00000100:00100000:1.0:1746143131.400618:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861250816:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.400622:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3299:x1830962861248896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143131.400640:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143131.400660:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12364 00000100:00100000:1.0:1746143131.400667:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3299:x1830962861249536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.400727:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:3299:x1830962861248896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (212us total) trans 21474840035 rc 0/0 00000100:00100000:2.0:1746143131.400933:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12363 00000100:00100000:3.0:1746143131.400973:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143131.400978:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3299:x1830962861249536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (407us total) trans 17179872775 rc 0/0 00000100:00100000:1.0:1746143131.400983:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12364 00000100:00100000:3.0:1746143131.400990:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861249152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143131.401008:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143131.401018:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861249664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143131.401045:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143131.401056:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861250176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143131.401069:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143131.401080:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746143131.401084:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861250688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143131.401097:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143131.401113:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861248640 00000100:00100000:3.0:1746143131.401116:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861248640 00000100:00100000:2.0:1746143131.401223:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861249152 00000100:00100000:2.0:1746143131.401227:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861249152 00000100:00100000:1.0:1746143131.402382:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861249664 00000100:00100000:1.0:1746143131.402388:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861249664 00000100:00100000:1.0:1746143131.402409:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861250176 00000100:00100000:1.0:1746143131.402411:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861250176 00000100:00100000:1.0:1746143131.402421:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861250688 00000100:00100000:1.0:1746143131.402422:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861250688 00000100:00100000:1.0:1746143131.402432:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12365 00000100:00100000:1.0:1746143131.402437:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3300:x1830962861249664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143131.402539:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12366 00000100:00100000:3.0:1746143131.402546:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3300:x1830962861250176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.402547:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12367 00000100:00100000:2.0:1746143131.402556:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3300:x1830962861250688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143131.402564:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:1.0:1746143131.402567:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143127 -> 1746143127 00002000:00010000:1.0:1746143131.402569:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143127 -> 1746143127 00002000:00010000:1.0:1746143131.402571:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143127 -> 1746143127 00002000:00010000:1.0:1746143131.402573:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:1.0:1746143131.402608:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3300:x1830962861249664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (1576us total) trans 21474840036 rc 0/0 00000100:00100000:1.0:1746143131.402613:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12365 00000100:00100000:1.0:1746143131.402624:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12368 00000100:00100000:1.0:1746143131.402628:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3300:x1830962861248640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143131.402631:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3300:x1830962861250176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (1561us total) trans 21474840037 rc 0/0 00000100:00100000:3.0:1746143131.402636:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12366 00000100:00100000:3.0:1746143131.402644:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12369 00000100:00100000:3.0:1746143131.402649:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3300:x1830962861249152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.402681:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3300:x1830962861250688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (1581us total) trans 21474840038 rc 0/0 00000100:00100000:2.0:1746143131.402687:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12367 00000004:00080000:1.0:1746143131.402718:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cca680/2, rc 0, transno 21474840038 00000100:00100000:1.0:1746143131.402722:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861250688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143131.402729:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+62:3300:x1830962861249152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1721us total) trans 17179872776 rc 0/0 00000004:00080000:1.0:1746143131.402731:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fde9180/2, rc 0, transno 17179872776 00000100:00100000:1.0:1746143131.402734:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861249152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143131.402735:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12369 00000004:00080000:1.0:1746143131.402739:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb56300/2, rc 0, transno 21474840036 00000100:00100000:1.0:1746143131.402742:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861249664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143131.402747:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092a72a00/2, rc 0, transno 21474840037 00000100:00100000:1.0:1746143131.402749:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861250176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143131.402879:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3300:x1830962861248640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (1906us total) trans 17179872777 rc 0/0 00000100:00100000:1.0:1746143131.402885:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12368 00000004:00080000:1.0:1746143131.402903:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009535c000/2, rc 0, transno 17179872777 00000100:00100000:1.0:1746143131.402906:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861248640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143131.402986:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fde8000/2, rc 0, transno 17179872775 00000100:00100000:2.0:1746143131.402992:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fde8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861249536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143131.403000:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861250048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143131.403062:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143131.403177:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861250048 00000100:00100000:0.0:1746143131.403181:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861250048 00000100:00100000:0.0:1746143131.403203:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12370 00000100:00100000:0.0:1746143131.403208:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3299:x1830962861250048:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143131.403249:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e4700/2, rc 0, transno 17179872774 00000100:00100000:2.0:1746143131.403263:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861248512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143131.403292:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb57100/2, rc 0, transno 21474840035 00000100:00100000:2.0:1746143131.403312:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861248896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143131.403315:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3299:x1830962861250048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (251us total) trans 21474840039 rc 0/0 00000100:00100000:0.0:1746143131.403321:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12370 00000004:00080000:2.0:1746143131.403342:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb57480/2, rc 0, transno 21474840039 00000100:00100000:2.0:1746143131.403345:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861250048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143131.405296:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861250560:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143131.405307:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861250816:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143131.405347:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef600/0x25aee876ca70d099 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 200 pid: 14794 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746143131.405575:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.405599:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdee800, rc 0) 00000100:00100000:1.0:1746143131.405644:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30922:x1830962858626304:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 95267us (95510us total) trans 8589942357 rc 0/0 00000100:00100000:1.0:1746143131.405650:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8153 00000100:00100000:0.0:1746143131.405860:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.405887:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.405916:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858628608 00000100:00100000:0.0:1746143131.405917:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.405924:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858628608 00000100:00100000:2.0:1746143131.405960:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858628736 00000100:00100000:2.0:1746143131.405963:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858628736 00000100:00100000:2.0:1746143131.405981:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3438 00000100:00100000:2.0:1746143131.405988:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30915:x1830962858628608:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:1.0:1746143131.406022:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858628480 00000100:00100000:1.0:1746143131.406027:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858628480 00000100:00100000:0.0:1746143131.406097:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3439 00000100:00100000:0.0:1746143131.406107:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30916:x1830962858628736:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143131.406122:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30915:x1830962858628608:12345-192.168.201.28@tcp:49:cat.0 Request processed in 134us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.406128:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3438 00000100:00100000:1.0:1746143131.406222:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8157 00000100:00100000:1.0:1746143131.406227:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30924:x1830962858628480:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143131.406236:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.406246:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70d0d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650133 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.406286:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70d0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650133 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.406296:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70d0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650133 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.406307:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.406309:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143131.406312:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc9400, rc 0) 00000100:00100000:1.0:1746143131.406331:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30924:x1830962858628480:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 104us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.406340:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8157 00000100:00100000:0.0:1746143131.406393:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30916:x1830962858628736:12345-192.168.201.28@tcp:49:cat.0 Request processed in 288us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.406399:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3439 00000100:00100000:0.0:1746143131.408111:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.408209:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858628864 00000100:00100000:1.0:1746143131.408215:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858628864 00000100:00100000:1.0:1746143131.408242:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3440 00000100:00100000:1.0:1746143131.408247:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30922:x1830962858628864:12345-192.168.201.28@tcp:49:multiop.0 00000100:00100000:1.0:1746143131.408339:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30922:x1830962858628864:12345-192.168.201.28@tcp:49:multiop.0 Request processed in 91us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.408344:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3440 00000100:00100000:0.0:1746143131.409977:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.410125:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858628992 00000100:00100000:3.0:1746143131.410132:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858628992 00000100:00100000:0.0:1746143131.412299:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.412668:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12371 00000100:00100000:3.0:1746143131.412680:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30924:x1830962858628992:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143131.412698:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.412716:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165013a expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.412747:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.412754:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.412760:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.412762:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.412765:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->2723839] (req 2646016->2723839) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.412792:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.412804:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.412815:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861250944:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.412891:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.412899:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 26 pid: 8450 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.412906:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861251072:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.412920:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143131.412938:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858629120 00000100:00100000:3.0:1746143131.412943:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858629120 00000100:00100000:3.0:1746143131.412971:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 611 00000100:00100000:3.0:1746143131.412976:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858629120:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.412984:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.413002:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70d0d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650133 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.413016:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143131.413019:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.413052:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858629120:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 74us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.413062:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 611 00000100:00100000:0.0:1746143131.413239:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.413310:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858629248 00000100:00100000:0.0:1746143131.413314:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858629248 00000100:00100000:0.0:1746143131.413637:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12372 00000100:00100000:0.0:1746143131.413642:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30922:x1830962858629248:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143131.413654:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.413664:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650141 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.413719:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.413727:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.413733:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.413734:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.413737:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3796992->3981311] (req 3796992->3981311) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.413755:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.413764:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143131.413773:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861251200:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143131.414265:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.414275:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 12 pid: 8450 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143131.414289:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861251328:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.414956:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.420358:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.420694:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858629504 00000100:00100000:2.0:1746143131.420703:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858629504 00000100:00100000:1.0:1746143131.420717:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861251200:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.420730:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861251328:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.420737:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 18 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.420759:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3796992->3981311] (req 3796992->3981311) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.420768:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6534 00000100:00100000:3.0:1746143131.420773:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861250944:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.420775:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858629504:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143131.420779:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efa3000, rc 0) 00000100:00100000:3.0:1746143131.420783:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861251072:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.420802:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->2723839] (req 2646016->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.420812:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093462c00, rc 0) 00010000:00010000:2.0:1746143131.420824:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143131.420824:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30922:x1830962858629248:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7181us (7585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.420832:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30924:x1830962858628992:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8157us (10862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.420832:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12372 00000100:00100000:3.0:1746143131.420838:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12371 00010000:00010000:2.0:1746143131.420845:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.420854:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.420874:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093245a00/0x25aee876ca70d053 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500ed expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.420893:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.420911:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858629504:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 137us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.420917:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6534 00000100:00100000:0.0:1746143131.421803:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.421999:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858629632 00000100:00100000:1.0:1746143131.422003:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858629632 00002000:00100000:1.0:1746143131.422054:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5cc9880 x1830962858629632/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.422064:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc9880 with x1830962858629632 ext(3145728->4194303) 00010000:00010000:1.0:1746143131.422071:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 27 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.422086:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 27 pid: 8450 timeout: 1013 lvb_type: 0 00002000:00010000:1.0:1746143131.422093:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5cc9880 00000100:00100000:0.0:1746143131.422261:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.422426:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858629888 00000100:00100000:1.0:1746143131.422430:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858629888 00002000:00100000:1.0:1746143131.422445:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5cc9f80 x1830962858629888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.422665:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc9f80 with x1830962858629888 ext(3145728->4194303) 00010000:00010000:1.0:1746143131.422670:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 13 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.422678:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 13 pid: 8450 timeout: 1013 lvb_type: 0 00002000:00010000:1.0:1746143131.422684:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5cc9f80 00000100:00100000:1.0:1746143131.422698:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1971 00000100:00100000:1.0:1746143131.422703:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858629632:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143131.422705:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1972 00000100:00100000:2.0:1746143131.422710:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858629888:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143131.423989:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.424003:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858630144 00000100:00100000:0.0:1746143131.424006:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858630144 00002000:00100000:0.0:1746143131.424024:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5ccaa00 x1830962858630144/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.424047:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccaa00 with x1830962858630144 ext(3145728->4194303) 00010000:00010000:0.0:1746143131.424053:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143131.424062:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00002000:00010000:0.0:1746143131.424069:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ccaa00 00000100:00100000:0.0:1746143131.424091:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1973 00000100:00100000:0.0:1746143131.424097:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858630144:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143131.439319:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858630144:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 15210us (15320us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.439330:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1973 00002000:00100000:1.0:1746143131.439341:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5ccaa00 x1830962858630144/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.439350:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccaa00 with x1830962858630144 ext(3145728->4194303) 00010000:00010000:1.0:1746143131.439362:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.439376:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00002000:00010000:1.0:1746143131.439383:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ccaa00 00000100:00100000:2.0:1746143131.446757:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858629888:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 24031us (24491us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.446773:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1972 00002000:00100000:2.0:1746143131.446787:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5cc9f80 x1830962858629888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.446798:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc9f80 with x1830962858629888 ext(3145728->4194303) 00010000:00010000:2.0:1746143131.446809:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 13 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.446824:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 13 pid: 8450 timeout: 1013 lvb_type: 0 00002000:00010000:2.0:1746143131.446831:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5cc9f80 00000100:00100000:3.0:1746143131.449787:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.449949:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858630272 00000100:00100000:2.0:1746143131.450016:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858630272 00010000:00010000:2.0:1746143131.450067:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.450106:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6535 00000100:00100000:2.0:1746143131.450113:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858630272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.450129:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.450148:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.450157:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.450179:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d061 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500fb expref: 17 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.450196:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.450231:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858630272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 119us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.450237:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6535 00000100:00100000:1.0:1746143131.450710:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858629632:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 28005us (28906us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.450720:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1971 00002000:00100000:1.0:1746143131.450729:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800a5cc9880 x1830962858629632/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.450739:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc9880 with x1830962858629632 ext(3145728->4194303) 00010000:00010000:1.0:1746143131.450745:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 27 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.450754:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 27 pid: 8450 timeout: 1013 lvb_type: 0 00002000:00010000:1.0:1746143131.450760:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5cc9880 00000100:00100000:0.0:1746143131.453678:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.453722:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.453779:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858630528 00000100:00100000:2.0:1746143131.453791:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858630528 00010000:00010000:2.0:1746143131.453826:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 13 pid: 8450 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.453855:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6536 00000100:00100000:2.0:1746143131.453863:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858630528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143131.453865:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858630400 00000100:00100000:3.0:1746143131.453869:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858630400 00010000:00010000:2.0:1746143131.453878:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.453899:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 13 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.453910:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 13 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.453934:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d03e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500df expref: 13 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.453948:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.453950:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.453957:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 15 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.453966:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 15 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.453982:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12373 00000100:00100000:3.0:1746143131.453988:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30915:x1830962858630400:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143131.453999:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 15 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.454011:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861251456:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.454107:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746143131.454145:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.454169:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650148 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.454407:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.454410:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.454415:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.454632:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.454669:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79bc00, rc 0) 00000100:00100000:3.0:1746143131.454726:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30915:x1830962858630400:12345-192.168.201.28@tcp:101:cat.0 Request processed in 735us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.454732:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12373 00000100:00100000:2.0:1746143131.457668:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861251456:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143131.457693:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.457731:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858630528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3868us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.457742:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6536 00000100:00100000:0.0:1746143131.458202:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.458222:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.458239:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.458277:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.458292:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.458294:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858630912 00000100:00100000:2.0:1746143131.458300:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858630912 00000100:00100000:0.0:1746143131.458317:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.458327:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858631168 00000100:00100000:2.0:1746143131.458329:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858631168 00000100:00100000:0.0:1746143131.458336:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858630784 00000100:00100000:0.0:1746143131.458338:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858630784 00000100:00100000:2.0:1746143131.458341:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858631424 00000100:00100000:2.0:1746143131.458343:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858631424 00000100:00100000:2.0:1746143131.458351:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858631040 00000100:00100000:2.0:1746143131.458353:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858631040 00000100:00100000:2.0:1746143131.458362:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858631296 00000100:00100000:2.0:1746143131.458363:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858631296 00002000:00100000:0.0:1746143131.458367:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3796992->3801087) req@ffff88008e192d80 x1830962858630784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143131.458375:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12374 00002000:00100000:0.0:1746143131.458377:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192d80 with x1830962858630784 ext(3796992->3801087) 00000100:00100000:2.0:1746143131.458381:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858630912:12345-192.168.201.28@tcp:101:cat.0 00002000:00010000:0.0:1746143131.458382:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e192d80 00010000:00010000:2.0:1746143131.458394:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143131.458395:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5985 00000100:00100000:0.0:1746143131.458399:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858630784:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:2.0:1746143131.458411:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165014f expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143131.458435:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x68140799, atime: 0x68140796, ctime: 0x68140799, blocks: 0x7cd 00010000:00010000:2.0:1746143131.458450:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.458452:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.458462:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.458477:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.458486:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a000, rc 0) 00000100:00100000:2.0:1746143131.458504:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858630912:12345-192.168.201.28@tcp:101:cat.0 Request processed in 124us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.458509:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12374 00000100:00100000:2.0:1746143131.458522:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12375 00000100:00100000:2.0:1746143131.458527:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858631168:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143131.458533:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.458545:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165015d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143131.458560:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x68140797, atime: 0x68140796, ctime: 0x68140797, blocks: 0x821 00010000:00010000:2.0:1746143131.458569:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.458570:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.458575:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 30 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.458584:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 30 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.458592:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7b400, rc 0) 00000100:00100000:2.0:1746143131.458607:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858631168:12345-192.168.201.28@tcp:101:cat.0 Request processed in 80us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.458611:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12375 00000100:00100000:2.0:1746143131.458621:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12376 00000100:00100000:2.0:1746143131.458626:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858631424:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143131.458631:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.458638:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba7a400/0x25aee876ca70d102 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165016b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.458647:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.458655:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7a400/0x25aee876ca70d102 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165016b expref: 30 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.458664:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7a400/0x25aee876ca70d102 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165016b expref: 30 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.458674:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a400, rc 0) 00000100:00100000:0.0:1746143131.458674:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858630784:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 273us (355us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143131.458680:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5985 00002000:00100000:0.0:1746143131.458685:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3796992->3801087) req@ffff88008e192d80 x1830962858630784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143131.458686:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858631424:12345-192.168.201.28@tcp:101:cat.0 Request processed in 61us (447us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143131.458691:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12376 00000100:00100000:2.0:1746143131.458700:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12377 00000100:00100000:2.0:1746143131.458705:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858631040:12345-192.168.201.28@tcp:101:cat.0 00002000:00100000:0.0:1746143131.458706:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192d80 with x1830962858630784 ext(3796992->3801087) 00002000:00010000:0.0:1746143131.458709:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e192d80 00010000:00010000:2.0:1746143131.458710:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.458718:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650156 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143131.458729:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x68140799, atime: 0x68140796, ctime: 0x68140799, blocks: 0x821 00010000:00010000:2.0:1746143131.458738:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.458739:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.458743:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.458751:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.458757:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7ac00, rc 0) 00000100:00100000:2.0:1746143131.458771:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858631040:12345-192.168.201.28@tcp:101:cat.0 Request processed in 66us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.458776:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12377 00000100:00100000:2.0:1746143131.458788:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12378 00000100:00100000:2.0:1746143131.458792:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1970:x1830962858631296:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143131.458799:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.458806:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650164 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143131.458997:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x68140798, atime: 0x68140796, ctime: 0x68140798, blocks: 0x81f 00010000:00010000:2.0:1746143131.459006:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.459008:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.459012:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.459021:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.459028:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7b600, rc 0) 00000100:00100000:2.0:1746143131.459061:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858631296:12345-192.168.201.28@tcp:101:cat.0 Request processed in 268us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.459066:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12378 00000100:00100000:2.0:1746143131.461131:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.461150:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858631552 00000100:00100000:2.0:1746143131.461157:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858631552 00010000:00010000:2.0:1746143131.461182:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 29 pid: 8450 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.461216:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6537 00000100:00100000:2.0:1746143131.461222:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858631552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.461233:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.461257:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 29 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.461268:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 29 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.461285:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8c00/0x25aee876ca70d045 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16500e6 expref: 29 pid: 8450 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.461296:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.461297:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.461303:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.461311:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.461340:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 16 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.461351:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861251584:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.461412:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.464224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.464412:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861251584:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143131.464434:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143131.464436:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.464461:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858632064 00000100:00100000:0.0:1746143131.464465:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858632064 00000100:00100000:2.0:1746143131.464467:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858631552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3244us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.464476:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6537 00002000:00100000:0.0:1746143131.464503:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2646016->2650111) req@ffff88008e193100 x1830962858632064/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.464519:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193100 with x1830962858632064 ext(2646016->2650111) 00002000:00010000:0.0:1746143131.464523:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e193100 00000100:00100000:0.0:1746143131.464554:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858631808 00000100:00100000:0.0:1746143131.464557:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858631808 00000100:00100000:1.0:1746143131.464567:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5986 00002000:00100000:0.0:1746143131.464569:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3977216->3981311) req@ffff88008e193480 x1830962858631808/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143131.464576:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858632064:12345-192.168.201.28@tcp:3:multiop.0 00002000:00100000:0.0:1746143131.464576:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193480 with x1830962858631808 ext(3977216->3981311) 00002000:00010000:0.0:1746143131.464579:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e193480 00000100:00100000:0.0:1746143131.464587:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5987 00000100:00100000:0.0:1746143131.464591:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858631808:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143131.464708:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858631808:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 115us (271us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143131.464713:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5987 00002000:00100000:0.0:1746143131.464718:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3977216->3981311) req@ffff88008e193480 x1830962858631808/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.464725:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193480 with x1830962858631808 ext(3977216->3981311) 00002000:00010000:0.0:1746143131.464728:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e193480 00000100:00100000:1.0:1746143131.464967:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858632064:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 392us (752us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143131.464974:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5986 00002000:00100000:1.0:1746143131.464980:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2646016->2650111) req@ffff88008e193100 x1830962858632064/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.464986:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193100 with x1830962858632064 ext(2646016->2650111) 00002000:00010000:1.0:1746143131.464989:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e193100 00000100:00100000:0.0:1746143131.466249:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.466755:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858632320 00000100:00100000:1.0:1746143131.466760:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858632320 00002000:00100000:1.0:1746143131.466788:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008e193800 x1830962858632320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.466795:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193800 with x1830962858632320 ext(3145728->4194303) 00002000:00010000:1.0:1746143131.466799:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e193800 00000100:00100000:1.0:1746143131.466824:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5988 00000100:00100000:1.0:1746143131.466831:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858632320:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143131.468189:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.468350:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858632576 00000100:00100000:2.0:1746143131.468355:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858632576 00002000:00100000:2.0:1746143131.468382:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008eaace00 x1830962858632576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.468390:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaace00 with x1830962858632576 ext(4194304->5210111) 00000100:00100000:0.0:1746143131.468390:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:2.0:1746143131.468395:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaace00 00000100:00100000:0.0:1746143131.468618:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858632832 00000100:00100000:2.0:1746143131.468619:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5989 00000100:00100000:0.0:1746143131.468621:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858632832 00000100:00100000:2.0:1746143131.468626:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858632576:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143131.468649:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3441 00000100:00100000:0.0:1746143131.468654:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:30922:x1830962858632832:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:0.0:1746143131.469689:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30922:x1830962858632832:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 1032us (1296us total) trans 8589942359 rc 0/0 00000100:00100000:0.0:1746143131.469697:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3441 00000100:00100000:0.0:1746143131.469798:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.471480:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858633088 00000100:00100000:3.0:1746143131.471490:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858633088 00002000:00100000:3.0:1746143131.471524:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2719744->2723839) req@ffff8800999cc850 x1830962858633088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.471532:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800999cc850 with x1830962858633088 ext(2719744->2723839) 00002000:00010000:3.0:1746143131.471536:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800999cc850 00000100:00100000:3.0:1746143131.471552:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5990 00000100:00100000:3.0:1746143131.471557:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800999cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858633088:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143131.471687:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800999cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858633088:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 130us (1889us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143131.471693:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5990 00002000:00100000:3.0:1746143131.471697:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2719744->2723839) req@ffff8800999cc850 x1830962858633088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.471704:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800999cc850 with x1830962858633088 ext(2719744->2723839) 00002000:00010000:3.0:1746143131.471706:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800999cc850 00000100:00100000:0.0:1746143131.479609:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.479744:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858633344 00000100:00100000:1.0:1746143131.479754:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858633344 00000100:00100000:1.0:1746143131.479806:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3442 00000100:00100000:1.0:1746143131.479816:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30924:x1830962858633344:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143131.480317:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30924:x1830962858633344:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 502us (720us total) trans 8589942360 rc 0/0 00000100:00100000:1.0:1746143131.480324:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3442 00000100:00100000:3.0:1746143131.488630:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858632576:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19992us (20433us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143131.488642:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5989 00002000:00100000:3.0:1746143131.488656:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008eaace00 x1830962858632576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.488665:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaace00 with x1830962858632576 ext(4194304->5210111) 00002000:00010000:3.0:1746143131.488671:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaace00 00000100:00100000:2.0:1746143131.494381:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858632320:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 27536us (28120us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.494394:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5988 00002000:00100000:2.0:1746143131.494407:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008e193800 x1830962858632320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.494417:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193800 with x1830962858632320 ext(3145728->4194303) 00002000:00010000:2.0:1746143131.494424:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e193800 00000100:00100000:0.0:1746143131.494874:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.494949:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858633472 00000100:00100000:3.0:1746143131.494957:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858633472 00000100:00100000:3.0:1746143131.495008:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12379 00000100:00100000:3.0:1746143131.495015:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858633472:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.495047:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.495067:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79a400/0x25aee876ca70d117 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650172 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.495100:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79a400/0x25aee876ca70d117 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650172 expref: 29 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.496204:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79a400/0x25aee876ca70d117 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650172 expref: 29 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.496220:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79a400, rc 0) 00000100:00100000:3.0:1746143131.496268:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858633472:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1253us (1395us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143131.496275:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12379 00000100:00100000:0.0:1746143131.498742:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.498818:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858633600 00000100:00100000:3.0:1746143131.498824:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858633600 00000100:00100000:3.0:1746143131.498863:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12380 00000100:00100000:3.0:1746143131.498870:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858633600:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.498891:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.498904:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79b800/0x25aee876ca70d11e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650179 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.498928:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79b800/0x25aee876ca70d11e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650179 expref: 29 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.498937:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79b800/0x25aee876ca70d11e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650179 expref: 29 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.498946:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79b800, rc 0) 00000100:00100000:3.0:1746143131.498987:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858633600:12345-192.168.201.28@tcp:101:cat.0 Request processed in 113us (246us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143131.498999:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12380 00000100:00100000:2.0:1746143131.504443:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.504481:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.504490:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858633728 00000100:00100000:2.0:1746143131.504495:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.504499:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858633728 00000100:00100000:2.0:1746143131.504507:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.504519:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.504543:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858633856 00000100:00100000:2.0:1746143131.504543:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858633984 00000100:00100000:3.0:1746143131.504545:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858633856 00000100:00100000:2.0:1746143131.504545:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858633984 00000100:00100000:2.0:1746143131.504561:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858634240 00000100:00100000:3.0:1746143131.504563:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858634112 00000100:00100000:2.0:1746143131.504563:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858634240 00000100:00100000:3.0:1746143131.504564:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858634112 00000100:00100000:2.0:1746143131.504576:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12381 00000100:00100000:3.0:1746143131.504581:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12382 00000100:00100000:2.0:1746143131.504584:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858633728:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143131.504585:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858633856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.504600:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.504600:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.504617:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650187 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.504617:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650180 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.504638:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.504638:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.504641:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.504641:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.504649:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.504649:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 15 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.504663:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.504663:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 15 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.504674:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79a800, rc 0) 00010000:00010000:2.0:1746143131.504674:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5471600, rc 0) 00000100:00100000:2.0:1746143131.504718:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858633728:12345-192.168.201.28@tcp:101:cat.0 Request processed in 134us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.504725:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12381 00000100:00100000:3.0:1746143131.504732:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858633856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 145us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.504736:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12382 00000100:00100000:3.0:1746143131.504747:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12383 00000100:00100000:3.0:1746143131.504751:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858633984:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.504756:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.504762:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165018e expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.504770:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.504772:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.504775:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.504784:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.504790:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79be00, rc 0) 00000100:00100000:3.0:1746143131.504802:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858633984:12345-192.168.201.28@tcp:101:cat.0 Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.504810:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12383 00000100:00100000:3.0:1746143131.504996:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12384 00000100:00100000:3.0:1746143131.505001:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858634240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.505007:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.505013:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70d13a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165019c expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.505064:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861251712:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143131.505105:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12385 00000100:00100000:3.0:1746143131.505112:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.505112:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858634112:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143131.505118:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.505125:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650195 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.505135:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.505136:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.505141:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.505156:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 16 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.505163:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5496200, rc 0) 00000100:00100000:0.0:1746143131.505180:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858634112:12345-192.168.201.28@tcp:101:cat.0 Request processed in 70us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.505190:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12385 00000100:00100000:0.0:1746143131.505217:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.505232:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858634368 00000100:00100000:0.0:1746143131.505234:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858634368 00000100:00100000:0.0:1746143131.505266:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12386 00000100:00100000:0.0:1746143131.505271:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858634368:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143131.505277:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.505284:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d148 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501a3 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.505306:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d148 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501a3 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.505315:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d148 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501a3 expref: 20 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.505330:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497e00, rc 0) 00000100:00100000:0.0:1746143131.505345:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858634368:12345-192.168.201.28@tcp:101:cat.0 Request processed in 74us (127us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143131.505350:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12386 00000100:00100000:0.0:1746143131.505413:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.505469:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858634624 00000100:00100000:1.0:1746143131.505473:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858634624 00000100:00100000:1.0:1746143131.505500:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3443 00000100:00100000:1.0:1746143131.505504:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:30916:x1830962858634624:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:1.0:1746143131.505687:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30916:x1830962858634624:12345-192.168.201.28@tcp:35:cat.0 Request processed in 175us (266us total) trans 8589942361 rc 0/0 00000100:00100000:1.0:1746143131.505693:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3443 00002000:00010000:3.0:1746143131.511747:0:22204:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143127 -> 1746143130 00002000:00010000:3.0:1746143131.511757:0:22204:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143127 -> 1746143130 00002000:00010000:3.0:1746143131.511759:0:22204:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143127 -> 1746143130 00000100:00100000:3.0:1746143131.512111:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861251712:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143131.512146:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70d13a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165019c expref: 15 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.512161:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70d13a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165019c expref: 15 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.512189:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79b600, rc 0) 00000100:00100000:3.0:1746143131.512261:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858634240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7247us (7740us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143131.512271:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12384 00000100:00100000:0.0:1746143131.515081:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.515153:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858634752 00000100:00100000:3.0:1746143131.515162:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858634752 00000100:00100000:3.0:1746143131.515216:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12387 00000100:00100000:3.0:1746143131.515224:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30915:x1830962858634752:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.515242:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.515274:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501aa expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.515303:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.515311:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143131.515313:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143131.515316:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.515347:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 17 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.515360:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 17 pid: 21048 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.515372:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861251840:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.515654:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.518704:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.518751:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858634880 00000100:00100000:2.0:1746143131.518758:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858634880 00002000:00100000:2.0:1746143131.518804:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3796992->3981311) req@ffff88008e191c00 x1830962858634880/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.518816:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191c00 with x1830962858634880 ext(3796992->3981311) 00010000:00010000:2.0:1746143131.518825:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 18 pid: 21048 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.518839:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 18 pid: 21048 timeout: 1013 lvb_type: 0 00002000:00010000:2.0:1746143131.518850:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e191c00 00000100:00100000:2.0:1746143131.518871:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1974 00000100:00100000:2.0:1746143131.518878:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858634880:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143131.519196:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861251840:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.519221:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.519240:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79ae00, rc 0) 00000100:00100000:3.0:1746143131.519302:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30915:x1830962858634752:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4077us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.519310:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12387 00010000:00010000:1.0:1746143131.521194:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143131.526789:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858634880:12345-192.168.201.28@tcp:4:cat.0 Request processed in 7898us (8081us total) trans 21474840040 rc 0/0 00000100:00100000:2.0:1746143131.526803:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1974 00002000:00100000:2.0:1746143131.526815:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3796992->3981311) req@ffff88008e191c00 x1830962858634880/t21474840040(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/448 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.526825:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e191c00 with x1830962858634880 ext(3796992->3981311) 00010000:00010000:2.0:1746143131.526836:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 20 pid: 21048 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.526852:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 20 pid: 21048 timeout: 1013 lvb_type: 0 00002000:00010000:2.0:1746143131.526859:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e191c00 00000100:00100000:0.0:1746143131.530734:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.530997:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858635008 00000100:00100000:2.0:1746143131.531007:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858635008 00010000:00010000:2.0:1746143131.531295:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 20 pid: 21048 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.531336:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6538 00000100:00100000:2.0:1746143131.531350:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858635008:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.531368:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.531393:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 20 pid: 21048 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.531405:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 20 pid: 21048 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.531544:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008efa3000/0x25aee876ca70d0e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3796992->3981311) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650141 expref: 20 pid: 21048 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.531594:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.531596:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.531604:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.531612:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.531647:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.531660:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861251968:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.531960:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143131.536108:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861251968:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143131.536134:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143131.536178:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858635008:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4833us (5452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.536191:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6538 00000100:00100000:0.0:1746143131.536913:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.537062:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858635264 00000100:00100000:2.0:1746143131.537069:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858635264 00002000:00100000:2.0:1746143131.537108:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008e192300 x1830962858635264/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.537118:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192300 with x1830962858635264 ext(4194304->5210111) 00002000:00010000:2.0:1746143131.537123:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e192300 00000100:00100000:2.0:1746143131.537140:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5991 00000100:00100000:2.0:1746143131.537304:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858635264:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143131.559549:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858635264:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22384us (22620us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143131.559563:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5991 00002000:00100000:2.0:1746143131.559581:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008e192300 x1830962858635264/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.559592:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192300 with x1830962858635264 ext(4194304->5210111) 00002000:00010000:2.0:1746143131.559599:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e192300 00000100:00100000:0.0:1746143131.563853:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.563932:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858635392 00000100:00100000:3.0:1746143131.563943:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858635392 00000100:00100000:3.0:1746143131.564002:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12388 00000100:00100000:3.0:1746143131.564010:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858635392:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.564050:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.564070:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79b800/0x25aee876ca70d156 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501b1 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.564106:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79b800/0x25aee876ca70d156 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501b1 expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.564117:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79b800/0x25aee876ca70d156 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501b1 expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.564146:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79b800, rc 0) 00000100:00100000:3.0:1746143131.564208:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858635392:12345-192.168.201.28@tcp:101:cat.0 Request processed in 197us (366us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143131.564216:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12388 00000100:00100000:0.0:1746143131.569928:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.570053:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858635520 00000100:00100000:2.0:1746143131.570063:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858635520 00000100:00100000:2.0:1746143131.570182:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12389 00000100:00100000:2.0:1746143131.570192:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858635520:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143131.570209:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.570228:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a529ec00/0x25aee876ca70d15d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501b8 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.570277:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a529ec00/0x25aee876ca70d15d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501b8 expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.570288:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a529ec00/0x25aee876ca70d15d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501b8 expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.570323:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529ec00, rc 0) 00000100:00100000:2.0:1746143131.570452:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858635520:12345-192.168.201.28@tcp:101:cat.0 Request processed in 261us (534us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143131.570459:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12389 00000100:00100000:2.0:1746143131.575768:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.575854:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858635776 00000100:00100000:1.0:1746143131.575865:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858635776 00000100:00100000:1.0:1746143131.575922:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3444 00000100:00100000:1.0:1746143131.575932:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30915:x1830962858635776:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:1.0:1746143131.576208:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30915:x1830962858635776:12345-192.168.201.28@tcp:35:cat.0 Request processed in 278us (454us total) trans 8589942362 rc 0/0 00000100:00100000:1.0:1746143131.576215:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3444 00000100:00100000:0.0:1746143131.630112:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.630185:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858636032 00000100:00100000:2.0:1746143131.630196:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858636032 00000100:00100000:2.0:1746143131.630287:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8158 00000100:00100000:2.0:1746143131.630297:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:30931:x1830962858636032:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143131.630325:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.630347:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70d164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501bf expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.630463:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630477:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630488:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630506:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630512:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630517:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630632:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630641:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630648:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:2.0:1746143131.630657:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143131.630750:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630758:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630765:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630771:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a529f000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143131.630775:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630781:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.630792:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143131.631009:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143131.631014:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631020:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f000/0x25aee876ca70d16b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631068:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631074:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631079:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631082:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a529f200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143131.631085:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631090:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631097:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008fddf000) 00010000:00010000:2.0:1746143131.631099:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143131.631101:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631106:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f200/0x25aee876ca70d172 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.631142:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70d164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 204 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.631158:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 203 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.631165:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143131.631167:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143131.631169:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529f400, rc 0) 00000100:00100000:2.0:1746143131.631256:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:30931:x1830962858636032:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 951us (1146us total) trans 8589942363 rc 0/0 00000100:00100000:2.0:1746143131.631263:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8158 00000100:00100000:0.0:1746143131.638473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.638548:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858636288 00000100:00100000:1.0:1746143131.638558:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858636288 00000100:00100000:1.0:1746143131.638620:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8159 00000100:00100000:1.0:1746143131.638629:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30933:x1830962858636288:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143131.638655:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.638676:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245400/0x25aee876ca70d187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501c6 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.638794:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.638809:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.638820:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.639096:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.639108:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.639114:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.639233:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.639242:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.639262:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:1.0:1746143131.639272:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143131.639363:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.639370:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646716:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646724:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093245e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143131.646729:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646738:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646758:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143131.646762:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143131.646767:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646772:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d18e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646811:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646817:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646822:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646826:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093245800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143131.646828:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646833:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646838:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e924200) 00010000:00010000:1.0:1746143131.646840:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143131.646842:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646846:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245800/0x25aee876ca70d195 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.646908:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245400/0x25aee876ca70d187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.646925:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.646931:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.646933:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143131.646936:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245000, rc 0) 00000100:00100000:1.0:1746143131.647012:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30933:x1830962858636288:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8383us (8550us total) trans 8589942364 rc 0/0 00000100:00100000:1.0:1746143131.647020:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8159 00000100:00100000:3.0:1746143131.653132:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.653822:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858636544 00000100:00100000:1.0:1746143131.653831:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858636544 00000100:00100000:1.0:1746143131.653886:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8160 00000100:00100000:1.0:1746143131.653893:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:30936:x1830962858636544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143131.653917:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.653945:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093244400/0x25aee876ca70d1aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501cd expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.654065:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.654079:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.654091:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:1.0:1746143131.654102:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143131.654218:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244400/0x25aee876ca70d1aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 206 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.654242:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 205 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.654260:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.654263:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143131.654267:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245200, rc 0) 00000100:00100000:1.0:1746143131.655742:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:30936:x1830962858636544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1842us (2614us total) trans 8589942365 rc 0/0 00000100:00100000:1.0:1746143131.655752:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8160 00000100:00100000:0.0:1746143131.669151:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.669845:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.670273:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858636672 00000100:00100000:1.0:1746143131.670282:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858636672 00000100:00100000:1.0:1746143131.670333:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858636800 00000100:00100000:1.0:1746143131.670335:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858636800 00000100:00100000:0.0:1746143131.670530:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.672605:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858636928 00000100:00100000:1.0:1746143131.672616:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858636928 00000100:00100000:1.0:1746143131.672663:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12390 00000100:00100000:1.0:1746143131.672672:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30933:x1830962858636672:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143131.672693:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143131.672694:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12391 00000100:00100000:3.0:1746143131.672705:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858636800:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143131.672711:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501d4 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.672717:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.672730:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501db expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.672744:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.672745:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.672747:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.672752:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.672755:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.672764:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.672766:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.672769:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 5/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1781760->2002943] (req 1781760->2002943) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.672770:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.672780:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79a400, rc 0) 00010000:00010000:1.0:1746143131.672797:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.672809:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 20 pid: 22204 timeout: 1013 lvb_type: 1 00000100:00100000:1.0:1746143131.672821:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861252096:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.672829:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858636800:12345-192.168.201.28@tcp:101:cat.0 Request processed in 126us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.672835:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12391 00000100:00100000:3.0:1746143131.672851:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12392 00000100:00100000:3.0:1746143131.672857:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858636928:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.672864:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.672871:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70d1cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501e2 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.672881:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.672889:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70d1cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e2 expref: 29 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.672890:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 29 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.672898:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79a200/0x25aee876ca70d1cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e2 expref: 29 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143131.672898:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861252224:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.672914:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b240 going to sleep for 11 seconds 00010000:00010000:3.0:1746143131.672917:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c79a200, rc 0) 00000100:00100000:3.0:1746143131.672934:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858636928:12345-192.168.201.28@tcp:101:cat.0 Request processed in 77us (2404us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143131.672939:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12392 00000100:00100000:1.0:1746143131.682257:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.682294:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.682325:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858637056 00000100:00100000:3.0:1746143131.682334:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858637056 00010000:00010000:3.0:1746143131.682371:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 21 pid: 22204 timeout: 1013 lvb_type: 1 00000100:00100000:1.0:1746143131.682380:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.682398:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858637184 00000100:00100000:3.0:1746143131.682400:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858637184 00000100:00100000:1.0:1746143131.682407:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858637440 00010000:00010000:3.0:1746143131.682410:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 28 pid: 8450 timeout: 1013 lvb_type: 1 00000100:00100000:1.0:1746143131.682410:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858637440 00000100:00100000:3.0:1746143131.682424:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6539 00000100:00100000:3.0:1746143131.682430:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5317c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858637056:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.682443:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746143131.682445:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880135180000 x1830962858637440/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.682455:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180000 with x1830962858637440 ext(0->1048575) 00002000:00010000:1.0:1746143131.682459:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135180000 00010000:00010000:3.0:1746143131.682465:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 21 pid: 22204 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.682476:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 21 pid: 22204 timeout: 1013 lvb_type: 1 00000100:00100000:1.0:1746143131.682482:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5992 00000100:00100000:1.0:1746143131.682488:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858637440:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:3.0:1746143131.682502:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.682539:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5317c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858637056:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.682548:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6539 00000100:00100000:3.0:1746143131.682586:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6540 00000100:00100000:3.0:1746143131.682590:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858637184:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.682595:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.682600:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 28 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.682609:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 28 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.682619:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.682621:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.682628:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.682635:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.682663:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.682673:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861252352:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143131.682716:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b840 going to sleep for 11 seconds 00010000:00010000:2.0:1746143131.684085:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79a800/0x25aee876ca70d125 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650187 expref: 20 pid: 22204 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143131.684115:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861252096:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.684128:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7ac00/0x25aee876ca70d109 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650156 expref: 28 pid: 8450 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143131.684136:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861252224:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.684158:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.684168:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245400, rc 0) 00000100:00100000:2.0:1746143131.684192:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30933:x1830962858636672:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11522us (15054us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.684199:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12390 00000100:00100000:0.0:1746143131.702284:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.703001:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858637696 00000100:00100000:1.0:1746143131.703015:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858637696 00002000:00100000:1.0:1746143131.703115:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1781760->1785855) req@ffff88008e192680 x1830962858637696/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.703125:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192680 with x1830962858637696 ext(1781760->1785855) 00002000:00010000:1.0:1746143131.703131:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e192680 00000100:00100000:3.0:1746143131.703268:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861252352:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143131.703289:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143131.703580:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5993 00000100:00100000:1.0:1746143131.703595:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858637696:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143131.703625:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858637184:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 21031us (21328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.703635:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6540 00000100:00100000:1.0:1746143131.703970:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858637696:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 379us (1690us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143131.703977:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5993 00002000:00100000:1.0:1746143131.703984:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1781760->1785855) req@ffff88008e192680 x1830962858637696/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.703993:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192680 with x1830962858637696 ext(1781760->1785855) 00002000:00010000:1.0:1746143131.703998:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e192680 00000100:00100000:0.0:1746143131.711524:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.712123:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858637952 00000100:00100000:2.0:1746143131.712133:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858637952 00002000:00100000:2.0:1746143131.712175:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x303:0x0] (1998848->2002943) req@ffff88008e192a00 x1830962858637952/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.712185:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192a00 with x1830962858637952 ext(1998848->2002943) 00002000:00010000:2.0:1746143131.712191:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e192a00 00000100:00100000:2.0:1746143131.712215:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5994 00000100:00100000:2.0:1746143131.712222:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858637952:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143131.712601:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858637952:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 379us (1087us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143131.712608:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5994 00002000:00100000:2.0:1746143131.712614:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x303:0x0] (1998848->2002943) req@ffff88008e192a00 x1830962858637952/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.712621:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192a00 with x1830962858637952 ext(1998848->2002943) 00002000:00010000:2.0:1746143131.712624:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e192a00 00000100:00100000:1.0:1746143131.716127:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858637440:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33630us (33737us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.716145:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5992 00002000:00100000:1.0:1746143131.716157:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880135180000 x1830962858637440/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.716166:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180000 with x1830962858637440 ext(0->1048575) 00002000:00010000:1.0:1746143131.716171:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135180000 00000100:00100000:0.0:1746143131.717532:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.717622:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858638208 00000100:00100000:1.0:1746143131.717631:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858638208 00000100:00100000:1.0:1746143131.717724:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8161 00000100:00100000:1.0:1746143131.717732:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30939:x1830962858638208:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143131.717754:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.717770:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245600/0x25aee876ca70d1d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501e9 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.717858:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.717871:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143131.717882:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:1.0:1746143131.717891:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143131.718194:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245600/0x25aee876ca70d1d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 15 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.718224:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.718232:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.718235:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143131.718238:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093244800, rc 0) 00000100:00100000:1.0:1746143131.718559:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30939:x1830962858638208:12345-192.168.201.28@tcp:101:cat.0 Request processed in 827us (1034us total) trans 8589942366 rc 0/0 00000100:00100000:1.0:1746143131.718565:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8161 00000100:00100000:3.0:1746143131.721295:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.721345:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.721389:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858638464 00000100:00100000:2.0:1746143131.721579:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858638464 00000100:00100000:0.0:1746143131.721579:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858638592 00000100:00100000:0.0:1746143131.721582:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858638592 00000100:00100000:0.0:1746143131.721632:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12393 00000100:00100000:0.0:1746143131.721639:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:30931:x1830962858638592:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143131.721653:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.721667:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501f0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.721690:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.721698:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.721704:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.721706:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.721709:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1482752->2011135] (req 1482752->2011135) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.721738:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.721753:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 18 pid: 22204 timeout: 1013 lvb_type: 1 00000100:00100000:0.0:1746143131.721770:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e190700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861252480:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.721798:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3445 00000100:00100000:1.0:1746143131.721804:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30933:x1830962858638464:12345-192.168.201.28@tcp:35:multiop.0 00010000:00010000:0.0:1746143131.721908:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.721916:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 28 pid: 8450 timeout: 1013 lvb_type: 1 00000100:00100000:0.0:1746143131.721925:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861252608:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.721951:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143131.722985:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30933:x1830962858638464:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 1178us (1743us total) trans 8589942367 rc 0/0 00000100:00100000:1.0:1746143131.722992:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3445 00000100:00100000:0.0:1746143131.731666:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.731725:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.731837:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858638848 00000100:00100000:2.0:1746143131.731837:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858638720 00000100:00100000:3.0:1746143131.732055:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858638848 00000100:00100000:2.0:1746143131.732055:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858638720 00000100:00100000:3.0:1746143131.732109:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12394 00000100:00100000:3.0:1746143131.732117:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858638848:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.732134:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.732150:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d75000/0x25aee876ca70d1f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501fe expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.732178:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d75000/0x25aee876ca70d1f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501fe expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.732190:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d75000/0x25aee876ca70d1f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501fe expref: 20 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.732217:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d75000, rc 0) 00000100:00100000:3.0:1746143131.732274:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858638848:12345-192.168.201.28@tcp:101:cat.0 Request processed in 158us (548us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143131.732281:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12394 00000100:00100000:3.0:1746143131.732294:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12395 00000100:00100000:3.0:1746143131.732297:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:30936:x1830962858638720:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.732302:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.732308:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16501f7 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.732321:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.732325:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143131.732326:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143131.732329:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 30 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.732524:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.732535:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 18 pid: 8449 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.732548:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861252736:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.732610:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.732864:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e190700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861252480:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143131.732874:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861252608:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143131.733341:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1482752->2011135] (req 1482752->2011135) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 30 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.733353:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5497e00, rc 0) 00000100:00100000:0.0:1746143131.733376:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30931:x1830962858638592:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11738us (12031us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.733383:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12393 00000100:00100000:1.0:1746143131.733387:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.733650:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.733728:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858639104 00000100:00100000:3.0:1746143131.733734:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858639104 00010000:00010000:3.0:1746143131.733750:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 30 pid: 8450 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143131.733767:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858638976 00000100:00100000:3.0:1746143131.733770:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858638976 00010000:00010000:3.0:1746143131.733778:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 19 pid: 22204 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143131.733797:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6541 00000100:00100000:3.0:1746143131.733803:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858639104:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.733811:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.733828:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 30 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.733837:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 30 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.733853:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba7b400/0x25aee876ca70d0fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165015d expref: 30 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.733862:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.733882:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858639104:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 80us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.733889:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6541 00000100:00100000:3.0:1746143131.733901:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6542 00000100:00100000:3.0:1746143131.733906:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858638976:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.733913:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.733921:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 19 pid: 22204 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.733929:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 19 pid: 22204 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.733946:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79be00/0x25aee876ca70d133 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165018e expref: 19 pid: 22204 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143131.733953:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.733955:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.733960:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.733967:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.733987:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.733995:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861252864:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143131.734021:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.735559:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.735588:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861252736:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.735607:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 28 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.735618:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d74e00, rc 0) 00000100:00100000:3.0:1746143131.735711:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:30936:x1830962858638720:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3412us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.735718:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12395 00000100:00100000:1.0:1746143131.735725:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858639232 00000100:00100000:1.0:1746143131.735730:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858639232 00002000:00100000:1.0:1746143131.735827:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1781760->2002943) req@ffff880093917800 x1830962858639232/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.735837:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093917800 with x1830962858639232 ext(1781760->2002943) 00010000:00010000:1.0:1746143131.735843:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 19 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.735855:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 19 pid: 8449 timeout: 1013 lvb_type: 0 00002000:00010000:1.0:1746143131.735862:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093917800 00000100:00100000:1.0:1746143131.735889:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1975 00000100:00100000:1.0:1746143131.735895:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858639232:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:3.0:1746143131.739630:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861252864:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143131.739650:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.739695:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858638976:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5786us (6042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.739704:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6542 00000100:00100000:1.0:1746143131.741210:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858639232:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 5312us (5651us total) trans 17179872778 rc 0/0 00000100:00100000:1.0:1746143131.741220:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1975 00002000:00100000:1.0:1746143131.741229:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1781760->2002943) req@ffff880093917800 x1830962858639232/t17179872778(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/448 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.741239:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093917800 with x1830962858639232 ext(1781760->2002943) 00010000:00010000:1.0:1746143131.741259:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.741273:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 1013 lvb_type: 0 00002000:00010000:1.0:1746143131.741279:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093917800 00000100:00100000:0.0:1746143131.742085:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.742114:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.742133:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858639488 00000100:00100000:0.0:1746143131.742141:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858639488 00002000:00100000:0.0:1746143131.742169:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1482752->1486847) req@ffff880093917480 x1830962858639488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.742177:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093917480 with x1830962858639488 ext(1482752->1486847) 00002000:00010000:0.0:1746143131.742181:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093917480 00000100:00100000:0.0:1746143131.742204:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858639744 00000100:00100000:0.0:1746143131.742208:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858639744 00002000:00100000:0.0:1746143131.742222:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880093917100 x1830962858639744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.742229:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093917100 with x1830962858639744 ext(0->1048575) 00000100:00100000:2.0:1746143131.742230:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5995 00002000:00010000:0.0:1746143131.742233:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093917100 00000100:00100000:2.0:1746143131.742240:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858639488:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143131.742269:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5996 00000100:00100000:0.0:1746143131.742276:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858639744:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143131.743265:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858639488:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1027us (1182us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143131.743273:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5995 00002000:00100000:2.0:1746143131.743278:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (1482752->1486847) req@ffff880093917480 x1830962858639488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.743286:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093917480 with x1830962858639488 ext(1482752->1486847) 00002000:00010000:2.0:1746143131.743304:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093917480 00000100:00100000:0.0:1746143131.751625:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.751723:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858639872 00000100:00100000:3.0:1746143131.751735:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858639872 00010000:00010000:3.0:1746143131.751776:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.753983:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6543 00000100:00100000:3.0:1746143131.753999:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858639872:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.754016:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143131.754055:0:7112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143129 -> 1746143130 00002000:00010000:3.0:1746143131.754058:0:7112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143129 -> 1746143130 00010000:00010000:3.0:1746143131.754065:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.754080:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.754101:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70d1bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501d4 expref: 20 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.754126:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.754128:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.754135:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 27 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.754155:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 27 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.754188:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 27 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.754201:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861252992:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143131.754306:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.758669:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.758739:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858640128 00000100:00100000:2.0:1746143131.758747:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858640128 00002000:00100000:2.0:1746143131.758784:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (2007040->2011135) req@ffff880093915500 x1830962858640128/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.758793:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915500 with x1830962858640128 ext(2007040->2011135) 00002000:00010000:2.0:1746143131.758798:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093915500 00000100:00100000:2.0:1746143131.758819:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5997 00000100:00100000:2.0:1746143131.758826:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858640128:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143131.759108:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861252992:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143131.759126:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.759380:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858639872:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5168us (7548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.759391:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6543 00000100:00100000:2.0:1746143131.759626:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858640128:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 799us (964us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143131.759633:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5997 00002000:00100000:2.0:1746143131.759639:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (2007040->2011135) req@ffff880093915500 x1830962858640128/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/4536 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.759646:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915500 with x1830962858640128 ext(2007040->2011135) 00002000:00010000:2.0:1746143131.759649:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093915500 00000100:00100000:1.0:1746143131.760681:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858639744:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18402us (18563us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.760688:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5996 00002000:00100000:1.0:1746143131.760694:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880093917100 x1830962858639744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.760702:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093917100 with x1830962858639744 ext(0->1048575) 00002000:00010000:1.0:1746143131.760706:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093917100 00000100:00100000:0.0:1746143131.772012:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.772075:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858640512 00000100:00100000:1.0:1746143131.772085:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858640512 00000100:00100000:0.0:1746143131.772085:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:1.0:1746143131.772122:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1482751) req@ffff880093914e00 x1830962858640512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.772137:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093914e00 with x1830962858640512 ext(1048576->1482751) 00000100:00100000:2.0:1746143131.772141:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858640384 00002000:00010000:1.0:1746143131.772142:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093914e00 00000100:00100000:2.0:1746143131.772147:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858640384 00002000:00100000:2.0:1746143131.772166:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093915f80 x1830962858640384/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143131.772173:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5998 00000100:00100000:1.0:1746143131.772181:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858640512:12345-192.168.201.28@tcp:3:multiop.0 00002000:00100000:2.0:1746143131.772183:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915f80 with x1830962858640384 ext(1048576->2097151) 00002000:00010000:2.0:1746143131.772187:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093915f80 00000100:00100000:2.0:1746143131.772200:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 5999 00000100:00100000:2.0:1746143131.772205:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858640384:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143131.774604:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.774953:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858640896 00000100:00100000:1.0:1746143131.774959:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858640896 00000100:00100000:1.0:1746143131.775066:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3446 00000100:00100000:1.0:1746143131.775073:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:30931:x1830962858640896:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143131.775459:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:30931:x1830962858640896:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 385us (859us total) trans 8589942368 rc 0/0 00000100:00100000:1.0:1746143131.775466:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3446 00000100:00100000:1.0:1746143131.781785:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858640512:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 9597us (9774us total) trans 0 rc 434176/434176 00000100:00100000:1.0:1746143131.781796:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5998 00002000:00100000:1.0:1746143131.781806:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1482751) req@ffff880093914e00 x1830962858640512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 434176/434176 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.781814:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093914e00 with x1830962858640512 ext(1048576->1482751) 00002000:00010000:1.0:1746143131.781819:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093914e00 00000100:00100000:0.0:1746143131.792452:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.792547:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858641024 00000100:00100000:3.0:1746143131.792559:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858641024 00000100:00100000:3.0:1746143131.792612:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12396 00000100:00100000:3.0:1746143131.792620:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30939:x1830962858641024:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.792636:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.792651:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650205 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.792673:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.792675:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.792681:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.792700:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.792709:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d74c00, rc 0) 00000100:00100000:3.0:1746143131.792779:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30939:x1830962858641024:12345-192.168.201.28@tcp:101:cat.0 Request processed in 159us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.792785:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12396 00000100:00100000:3.0:1746143131.798355:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858640384:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 26141us (26261us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143131.798366:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 5999 00002000:00100000:3.0:1746143131.798575:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093915f80 x1830962858640384/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.798584:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915f80 with x1830962858640384 ext(1048576->2097151) 00002000:00010000:3.0:1746143131.798589:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093915f80 00000100:00100000:0.0:1746143131.801236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.802676:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858641280 00000100:00100000:3.0:1746143131.802686:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858641280 00002000:00100000:3.0:1746143131.802729:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093914700 x1830962858641280/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143131.802737:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093914700 with x1830962858641280 ext(1048576->2097151) 00002000:00010000:3.0:1746143131.802742:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093914700 00000100:00100000:3.0:1746143131.804153:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6000 00000100:00100000:3.0:1746143131.804165:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858641280:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143131.805785:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.806605:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.806953:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858641664 00000100:00100000:1.0:1746143131.806961:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858641664 00002000:00100000:1.0:1746143131.806994:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880093915880 x1830962858641664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.807002:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915880 with x1830962858641664 ext(1048576->2097151) 00002000:00010000:1.0:1746143131.807006:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093915880 00000100:00100000:1.0:1746143131.807019:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858641792 00000100:00100000:1.0:1746143131.807021:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858641792 00002000:00100000:1.0:1746143131.807041:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (2011136->2097151) req@ffff880093915c00 x1830962858641792/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.807047:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915c00 with x1830962858641792 ext(2011136->2097151) 00002000:00010000:1.0:1746143131.807049:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093915c00 00000100:00100000:1.0:1746143131.807065:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6001 00000100:00100000:1.0:1746143131.807071:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858641664:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143131.807911:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6002 00000100:00100000:0.0:1746143131.807918:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858641792:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143131.842416:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858641792:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 34488us (35802us total) trans 0 rc 86016/86016 00000100:00100000:0.0:1746143131.842429:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6002 00002000:00100000:0.0:1746143131.842441:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (2011136->2097151) req@ffff880093915c00 x1830962858641792/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 86016/86016 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.842451:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915c00 with x1830962858641792 ext(2011136->2097151) 00002000:00010000:0.0:1746143131.842457:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093915c00 00000100:00100000:0.0:1746143131.847789:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858641280:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43619us (46551us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143131.847801:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6000 00002000:00100000:0.0:1746143131.847813:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093914700 x1830962858641280/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.847823:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093914700 with x1830962858641280 ext(1048576->2097151) 00002000:00010000:0.0:1746143131.847828:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093914700 00000100:00100000:1.0:1746143131.848205:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858641664:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 41132us (42422us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.848212:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6001 00002000:00100000:1.0:1746143131.848219:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880093915880 x1830962858641664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.848226:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915880 with x1830962858641664 ext(1048576->2097151) 00002000:00010000:1.0:1746143131.848229:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093915880 00000100:00100000:1.0:1746143131.856876:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.857272:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858641920 00000100:00100000:0.0:1746143131.857281:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858641920 00000100:00100000:3.0:1746143131.857356:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12397 00000100:00100000:3.0:1746143131.857372:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30939:x1830962858641920:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143131.857391:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.857411:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165020c expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.857443:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.857451:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143131.857453:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143131.857456:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.857487:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.857500:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 27 pid: 8449 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.857512:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861253120:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143131.857596:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143131.866486:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.866507:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.866526:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858642176 00000100:00100000:0.0:1746143131.866531:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858642176 00002000:00100000:0.0:1746143131.866566:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880093915180 x1830962858642176/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.866575:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915180 with x1830962858642176 ext(2097152->3145727) 00002000:00010000:0.0:1746143131.866581:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093915180 00000100:00100000:0.0:1746143131.866597:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858642304 00000100:00100000:0.0:1746143131.866599:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858642304 00002000:00100000:0.0:1746143131.866611:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1482752->2011135) req@ffff880093916d80 x1830962858642304/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.866618:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093916d80 with x1830962858642304 ext(1482752->2011135) 00010000:00010000:0.0:1746143131.866625:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 28 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143131.866637:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 28 pid: 8449 timeout: 1013 lvb_type: 0 00002000:00010000:0.0:1746143131.866644:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093916d80 00000100:00100000:0.0:1746143131.866659:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1976 00000100:00100000:0.0:1746143131.866665:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858642304:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143131.867329:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6003 00000100:00100000:0.0:1746143131.867335:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858642176:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143131.869705:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861253120:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.869732:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.869748:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d75400, rc 0) 00000100:00100000:3.0:1746143131.869779:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:30939:x1830962858641920:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12412us (12910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.869786:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12397 00000100:00100000:0.0:1746143131.893386:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.893537:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858642432 00000100:00100000:0.0:1746143131.893544:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858642432 00000100:00100000:0.0:1746143131.895074:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8162 00000100:00100000:0.0:1746143131.895082:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:30942:x1830962858642432:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143131.895104:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.895119:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec51a00/0x25aee876ca70d20c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650213 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.895173:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895184:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895193:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895204:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895210:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895215:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895314:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895321:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895327:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143131.895352:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143131.895356:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143131.895368:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895376:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895384:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895389:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895394:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895399:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec50000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143131.895403:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895408:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895417:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143131.895420:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143131.895423:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895428:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50000/0x25aee876ca70d213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895442:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895447:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895451:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895455:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec50600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143131.895458:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895462:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895468:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4f56200) 00010000:00010000:0.0:1746143131.895470:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143131.895472:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895477:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50600/0x25aee876ca70d21a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143131.895498:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec51a00/0x25aee876ca70d20c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.895508:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.895514:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143131.895516:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143131.895518:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec50a00, rc 0) 00000100:00100000:0.0:1746143131.895557:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30942:x1830962858642432:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 477us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143131.895563:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8162 00000100:00100000:1.0:1746143131.902853:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.903133:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858642560 00000100:00100000:1.0:1746143131.903140:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.903142:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858642560 00000100:00100000:1.0:1746143131.903153:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.903158:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858642688 00000100:00100000:0.0:1746143131.903163:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858642688 00000100:00100000:2.0:1746143131.903172:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858642816 00000100:00100000:2.0:1746143131.903174:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858642816 00000100:00100000:1.0:1746143131.903175:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.903181:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858642944 00000100:00100000:0.0:1746143131.903184:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858642944 00000100:00100000:2.0:1746143131.903189:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12398 00000100:00100000:2.0:1746143131.903195:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858642560:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:0.0:1746143131.903207:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12399 00010000:00010000:2.0:1746143131.903210:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143131.903215:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858642688:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143131.903222:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165021a expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.903223:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143131.903224:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12400 00000100:00100000:3.0:1746143131.903230:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858642816:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143131.903236:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.903241:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.903253:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d75000/0x25aee876ca70d22f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650228 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.903258:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650221 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.903271:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.903272:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143131.903279:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143131.903293:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861253248:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143131.903293:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.903302:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3dea00, rc 0) 00000100:00100000:1.0:1746143131.903335:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12401 00000100:00100000:0.0:1746143131.903339:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858642688:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 124us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.903342:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858642944:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:0.0:1746143131.903345:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12399 00010000:00010000:1.0:1746143131.903348:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.903356:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165022f expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.903365:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.903367:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.903547:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.903558:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.903566:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490b200, rc 0) 00010000:00010000:2.0:1746143131.903592:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.903597:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 11 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.903607:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 11 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143131.903613:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529fc00, rc 0) 00000100:00100000:2.0:1746143131.903629:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858642560:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 435us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.903635:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12398 00000100:00100000:3.0:1746143131.904396:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143131.905334:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858642944:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1990us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.905342:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12401 00000100:00100000:0.0:1746143131.905382:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.905445:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.905449:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858643072 00000100:00100000:1.0:1746143131.905454:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858643072 00000100:00100000:0.0:1746143131.905461:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858643200 00000100:00100000:0.0:1746143131.905464:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858643200 00000100:00100000:0.0:1746143131.905484:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12402 00000100:00100000:0.0:1746143131.905489:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858643200:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143131.905498:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143131.905506:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3de200/0x25aee876ca70d244 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165023d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143131.905528:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3de200/0x25aee876ca70d244 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165023d expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.905537:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3de200/0x25aee876ca70d244 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165023d expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143131.905545:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3de200, rc 0) 00000100:00100000:0.0:1746143131.905563:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858643200:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 74us (118us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143131.905567:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12402 00000100:00100000:1.0:1746143131.905745:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12403 00000100:00100000:1.0:1746143131.905750:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858643072:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143131.905757:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.905764:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650236 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.905774:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.905776:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143131.905781:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.905791:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143131.905798:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093cedc00, rc 0) 00000100:00100000:1.0:1746143131.905815:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858643072:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 65us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.905819:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12403 00000100:00100000:2.0:1746143131.905950:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858642176:12345-192.168.201.28@tcp:3:cat.0 Request processed in 38614us (39467us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.905957:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6003 00002000:00100000:2.0:1746143131.905966:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880093915180 x1830962858642176/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.905975:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093915180 with x1830962858642176 ext(2097152->3145727) 00002000:00010000:2.0:1746143131.905979:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093915180 00000100:00100000:2.0:1746143131.907319:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858642304:12345-192.168.201.28@tcp:4:cat.0 Request processed in 40652us (40808us total) trans 17179872779 rc 0/0 00000100:00100000:2.0:1746143131.907326:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1976 00002000:00100000:2.0:1746143131.907332:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1482752->2011135) req@ffff880093916d80 x1830962858642304/t17179872779(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:282/0 lens 488/448 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.907340:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093916d80 with x1830962858642304 ext(1482752->2011135) 00010000:00010000:2.0:1746143131.907347:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 30 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.907360:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 30 pid: 8449 timeout: 1013 lvb_type: 0 00002000:00010000:2.0:1746143131.907366:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093916d80 00002000:00010000:3.0:1746143131.915179:0:10061:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143127 -> 1746143130 00002000:00010000:3.0:1746143131.915185:0:10061:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143126 -> 1746143130 00002000:00010000:3.0:1746143131.915187:0:10061:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143127 -> 1746143130 00000100:00100000:3.0:1746143131.915206:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861253248:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143131.915232:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d75000/0x25aee876ca70d22f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650228 expref: 10 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.915256:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d75000/0x25aee876ca70d22f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650228 expref: 10 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143131.915265:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d75000, rc 0) 00000100:00100000:3.0:1746143131.915306:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858642816:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 12075us (12151us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143131.915314:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12400 00000100:00100000:2.0:1746143131.924159:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.924188:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.924214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.924236:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858643456 00000100:00100000:2.0:1746143131.924255:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858643456 00000100:00100000:2.0:1746143131.924293:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8163 00000100:00100000:2.0:1746143131.924300:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:30942:x1830962858643456:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143131.924317:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.924334:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe200/0x25aee876ca70d252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650244 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.924415:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.924429:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 205 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.924436:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.924442:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.924448:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.924475:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.924483:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 8 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.924495:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861253376:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.925531:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858643712 00000100:00100000:2.0:1746143131.925537:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858643712 00010000:00010000:2.0:1746143131.925559:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 30 pid: 8449 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.925584:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6544 00000100:00100000:2.0:1746143131.925590:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858643712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.925598:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143131.925614:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 30 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.925623:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 30 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.925640:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5497e00/0x25aee876ca70d1e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2011135) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f0 expref: 30 pid: 8449 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.925653:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.925654:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.925660:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.925668:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.925689:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.925697:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f21880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861253504:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.925738:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143131.925756:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858643584 00000100:00100000:2.0:1746143131.925759:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858643584 00000100:00100000:2.0:1746143131.925779:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12404 00000100:00100000:2.0:1746143131.925784:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30936:x1830962858643584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143131.925792:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.925799:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165024b expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.925813:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 20 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.925819:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143131.925820:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143131.925822:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 31 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.925837:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 20 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.926087:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 20 pid: 8448 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.926096:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861253632:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.926113:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.926120:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 14 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.926132:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861253760:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.926159:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 205 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.926167:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 205 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.926175:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861253888:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143131.926191:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143131.926209:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143131.929201:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.929216:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858643840 00000100:00100000:1.0:1746143131.929223:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858643840 00010000:00010000:1.0:1746143131.929257:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 9 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.929280:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6545 00000100:00100000:1.0:1746143131.929287:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858643840:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143131.929297:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143131.929302:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 9 pid: 14794 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.929311:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 9 pid: 14794 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.929327:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.929331:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143131.929338:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143131.929343:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143131.929377:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858643840:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 90us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.929383:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6545 00000100:00100000:1.0:1746143131.929422:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f21880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861253504:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143131.929437:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.929447:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.929452:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858643712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3862us (5263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.929457:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6544 00000100:00100000:1.0:1746143131.929468:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858643968 00000100:00100000:1.0:1746143131.929470:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858643968 00010000:00010000:1.0:1746143131.929479:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 15 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.929490:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.929491:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6546 00000100:00100000:1.0:1746143131.929495:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5317850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858643968:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143131.929501:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143131.929505:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 15 pid: 14794 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.929512:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 15 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.929522:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858644096 00010000:00010000:1.0:1746143131.929522:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00000100:00100000:3.0:1746143131.929525:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858644096 00010000:00010000:1.0:1746143131.929525:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143131.929530:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.929536:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 206 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143131.929537:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.929551:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6547 00000100:00100000:1.0:1746143131.929553:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5317850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858643968:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 58us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.929555:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:1970:x1830962858644096:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143131.929558:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6546 00010000:00010000:3.0:1746143131.929561:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.929564:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 206 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.929571:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 206 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.929581:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143131.929584:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.929590:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.929596:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14796 initiator: MDT0 00000100:00100000:1.0:1746143131.929598:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861253632:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143131.929608:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143131.929612:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 30 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143131.929620:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:1970:x1830962858644096:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 65us (131us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143131.929624:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbf400, rc 0) 00000100:00100000:3.0:1746143131.929625:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6547 00000100:00100000:1.0:1746143131.929639:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:30936:x1830962858643584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3855us (5424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143131.929644:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12404 00010000:00010000:1.0:1746143131.929673:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec50a00/0x25aee876ca70d221 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650213 expref: 8 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.929684:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861253376:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.929693:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245000/0x25aee876ca70d19c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501c6 expref: 14 pid: 14794 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.929700:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861253760:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.929706:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f400/0x25aee876ca70d179 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501bf expref: 205 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.929713:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861253888:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143131.929726:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143131.929733:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143131.929737:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:1.0:1746143131.929751:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143131.930064:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe200/0x25aee876ca70d252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.930075:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.930080:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143131.930083:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143131.930084:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbe800, rc 0) 00000100:00100000:1.0:1746143131.930140:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30942:x1830962858643456:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5840us (5987us total) trans 8589942369 rc 0/0 00000100:00100000:1.0:1746143131.930146:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8163 00000100:00100000:0.0:1746143131.934877:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.934907:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858644224 00000100:00100000:0.0:1746143131.934914:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858644224 00002000:00100000:0.0:1746143131.934953:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2646016->2723839) req@ffff8800a5ccad80 x1830962858644224/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.934962:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccad80 with x1830962858644224 ext(2646016->2723839) 00010000:00010000:0.0:1746143131.934971:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 21 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143131.934984:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 21 pid: 8448 timeout: 1013 lvb_type: 0 00002000:00010000:0.0:1746143131.934990:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ccad80 00000100:00100000:0.0:1746143131.935007:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1977 00000100:00100000:0.0:1746143131.935014:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858644224:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143131.954439:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.954465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.954490:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.954512:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858644608 00000100:00100000:1.0:1746143131.954518:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858644608 00000100:00100000:1.0:1746143131.954555:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8164 00000100:00100000:1.0:1746143131.954562:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30942:x1830962858644608:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143131.954585:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143131.954602:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ced800/0x25aee876ca70d26e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650252 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.954660:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143131.954673:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.954680:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143131.954706:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143131.954714:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 9 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143131.954725:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135180380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861254016:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143131.954784:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143131.954801:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858644224:12345-192.168.201.28@tcp:4:cat.0 Request processed in 19786us (19929us total) trans 17179872780 rc 0/0 00000100:00100000:2.0:1746143131.954809:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1977 00002000:00100000:2.0:1746143131.954817:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2646016->2723839) req@ffff8800a5ccad80 x1830962858644224/t17179872780(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/448 e 0 to 0 dl 1746143142 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.954825:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccad80 with x1830962858644224 ext(2646016->2723839) 00010000:00010000:2.0:1746143131.954832:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 23 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.954841:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 23 pid: 8448 timeout: 1013 lvb_type: 0 00002000:00010000:2.0:1746143131.954848:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ccad80 00000100:00100000:2.0:1746143131.954861:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858644480 00000100:00100000:2.0:1746143131.954865:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858644480 00000100:00100000:0.0:1746143131.954870:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858644864 00000100:00100000:0.0:1746143131.954874:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858644864 00002000:00100000:2.0:1746143131.954882:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880135183b80 x1830962858644480/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143131.954887:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880135183800 x1830962858644864/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/0 e 0 to 0 dl 1746143142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.954889:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135183b80 with x1830962858644480 ext(1048576->2097151) 00002000:00010000:2.0:1746143131.954892:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135183b80 00002000:00100000:0.0:1746143131.954893:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135183800 with x1830962858644864 ext(1048576->2097151) 00002000:00010000:0.0:1746143131.954896:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135183800 00000100:00100000:2.0:1746143131.954904:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6004 00000100:00100000:0.0:1746143131.954907:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6005 00000100:00100000:2.0:1746143131.954909:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858644480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143131.954912:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858644864:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143131.967367:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.967917:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135180380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861254016:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143131.967939:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:3.0:1746143131.969014:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858644992 00000100:00100000:3.0:1746143131.969021:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858644992 00010000:00010000:3.0:1746143131.969062:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 10 pid: 14796 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143131.969092:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6548 00000100:00100000:3.0:1746143131.969098:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858644992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143131.969109:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143131.969113:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 10 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.969124:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 10 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.969141:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbe800/0x25aee876ca70d259 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650244 expref: 10 pid: 14796 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143131.969154:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143131.969158:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.969166:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.969172:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:3.0:1746143131.969189:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143131.969233:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858644992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 133us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143131.969254:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6548 00010000:00010000:2.0:1746143131.969565:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.969572:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:2.0:1746143131.969608:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143131.969613:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143131.969626:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.969653:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ced800/0x25aee876ca70d26e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 9 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.969666:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.969672:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143131.969675:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143131.969678:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ceca00, rc 0) 00000100:00100000:2.0:1746143131.969704:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30942:x1830962858644608:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 15143us (15239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143131.969709:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8164 00000100:00100000:1.0:1746143131.975388:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858644864:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20467us (20890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143131.975399:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6005 00002000:00100000:1.0:1746143131.975410:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880135183800 x1830962858644864/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143131.975419:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135183800 with x1830962858644864 ext(1048576->2097151) 00002000:00010000:1.0:1746143131.975425:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135183800 00000100:00100000:0.0:1746143131.981153:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143131.981201:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143131.981382:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858645120 00000100:00100000:2.0:1746143131.981391:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858645120 00010000:00010000:2.0:1746143131.981426:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 25 pid: 8448 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143131.981450:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6549 00000100:00100000:2.0:1746143131.981457:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858645120:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143131.981468:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143131.981483:0:9869:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143128 -> 1746143130 00010000:00010000:2.0:1746143131.981489:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 25 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.981500:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 25 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.981518:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093462c00/0x25aee876ca70d0df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2646016->3145727] (req 2646016->2723839) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165013a expref: 25 pid: 8448 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143131.981530:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.981531:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143131.981538:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 29 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.981550:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 29 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.981575:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 29 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143131.981586:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861254144:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143131.981642:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143131.981657:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858645376 00000100:00100000:2.0:1746143131.981660:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858645376 00000100:00100000:2.0:1746143131.981682:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8165 00000100:00100000:2.0:1746143131.981686:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30944:x1830962858645376:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143131.981700:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143131.981711:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70d27c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650259 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.981790:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.981801:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.981808:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.981819:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.981828:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.981833:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.981917:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.981925:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.981931:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:2.0:1746143131.981938:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143131.982011:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982018:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982023:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982028:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009da34200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143131.982051:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982057:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982065:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143131.982068:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143131.982071:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982076:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34200/0x25aee876ca70d283 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982085:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982090:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982094:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982099:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009da34600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143131.982101:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982106:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982112:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5413400) 00010000:00010000:2.0:1746143131.982113:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143131.982115:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982119:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34600/0x25aee876ca70d28a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143131.982151:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f59e00/0x25aee876ca70d27c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 17 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.982166:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 16 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143131.982171:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143131.982173:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143131.982176:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009da34a00, rc 0) 00000100:00100000:2.0:1746143131.982202:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30944:x1830962858645376:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 515us (1000us total) trans 8589942370 rc 0/0 00000100:00100000:2.0:1746143131.982208:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8165 00000100:00100000:2.0:1746143131.986445:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858644480:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31528us (32006us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143131.986457:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6004 00002000:00100000:2.0:1746143131.986467:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880135183b80 x1830962858644480/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:282/0 lens 488/440 e 0 to 0 dl 1746143142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143131.986476:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135183b80 with x1830962858644480 ext(1048576->2097151) 00002000:00010000:2.0:1746143131.986481:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135183b80 00000100:00100000:1.0:1746143131.999412:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143131.999436:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143131.999701:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858645632 00000100:00100000:3.0:1746143131.999709:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858645632 00000100:00100000:3.0:1746143131.999747:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858645504 00000100:00100000:3.0:1746143131.999749:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858645504 00000100:00100000:3.0:1746143131.999765:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12405 00000100:00100000:3.0:1746143131.999774:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858645632:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143131.999792:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143131.999811:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650267 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143131.999836:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143131.999838:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.000097:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 11 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.000113:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 11 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.000124:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6798000, rc 0) 00000100:00100000:3.0:1746143132.000165:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858645632:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 390us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.000171:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12405 00000100:00100000:3.0:1746143132.000190:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12406 00000100:00100000:3.0:1746143132.000206:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858645504:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143132.000214:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.000224:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650260 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.000237:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.000239:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.000259:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 11 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.000271:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 11 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.000279:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6799200, rc 0) 00000100:00100000:3.0:1746143132.000303:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858645504:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 105us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.000309:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12406 00000100:00080000:3.0:1746143132.000331:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143132.000653:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861254144:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143132.000673:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.000698:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858645120:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 19240us (19551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.000706:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6549 00000100:00100000:2.0:1746143132.019992:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.020021:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.020070:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.020098:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858646144 00000100:00100000:2.0:1746143132.020107:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858646144 00002000:00100000:2.0:1746143132.020157:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880090f20700 x1830962858646144/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.020167:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20700 with x1830962858646144 ext(3145728->4194303) 00002000:00010000:2.0:1746143132.020172:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f20700 00000100:00100000:2.0:1746143132.020187:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858646016 00000100:00100000:2.0:1746143132.020190:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858646016 00002000:00100000:2.0:1746143132.020201:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880090f23800 x1830962858646016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.020208:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23800 with x1830962858646016 ext(2097152->3145727) 00002000:00010000:2.0:1746143132.020211:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f23800 00000100:00100000:2.0:1746143132.020221:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858646400 00000100:00100000:2.0:1746143132.020223:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858646400 00002000:00100000:2.0:1746143132.020236:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880090f21c00 x1830962858646400/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.020255:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21c00 with x1830962858646400 ext(3145728->4194303) 00002000:00010000:2.0:1746143132.020259:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21c00 00000100:00100000:2.0:1746143132.020276:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6006 00000100:00100000:2.0:1746143132.020284:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858646144:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143132.022172:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6007 00000100:00100000:2.0:1746143132.022180:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858646016:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143132.023727:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6008 00000100:00100000:2.0:1746143132.023735:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858646400:12345-192.168.201.28@tcp:3:cat.0 00000100:00080000:3.0:1746143132.029841:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143132.029849:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143132.043158:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.043186:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858646656 00000100:00100000:2.0:1746143132.043194:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858646656 00000100:00100000:2.0:1746143132.044023:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8166 00000100:00100000:2.0:1746143132.044045:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30942:x1830962858646656:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143132.044061:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.044076:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70d2ad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165026e expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.044150:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044162:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044171:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044180:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044185:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044190:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044194:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cc8c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143132.044197:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044202:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044210:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143132.044213:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143132.044216:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044219:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8c00/0x25aee876ca70d2b4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.044256:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70d2ad lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165026e expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.044262:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f58200/0x25aee876ca70d2ad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165026e expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.044269:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f58200, rc 0) 00000100:00100000:2.0:1746143132.044306:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30942:x1830962858646656:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 277us (1155us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143132.044311:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8166 00000100:00080000:1.0:1746143132.046362:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1746143132.047910:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872773 is committed 00000001:00080000:3.0:1746143132.047942:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872710 is committed 00000001:00080000:3.0:1746143132.047952:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872778 is committed 00000001:00080000:3.0:1746143132.047958:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872777 is committed 00000001:00080000:3.0:1746143132.047972:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872761 is committed 00000001:00080000:3.0:1746143132.047997:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872723 is committed 00000001:00080000:3.0:1746143132.048026:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872724 is committed 00000100:00100000:0.0:1746143132.053273:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.053429:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.053457:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858646912 00000100:00100000:2.0:1746143132.053465:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858646912 00000100:00100000:2.0:1746143132.053523:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8167 00000100:00100000:2.0:1746143132.053531:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:30946:x1830962858646912:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143132.053551:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.053566:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70d2bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165027c expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.053659:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053672:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053681:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053692:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053697:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053702:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053788:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053796:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053802:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:2.0:1746143132.053811:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143132.053880:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053886:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053891:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053899:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cc9600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143132.053902:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053908:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053916:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143132.053918:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143132.053921:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053926:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9600/0x25aee876ca70d2c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053940:0:14796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053944:0:14796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053948:0:14796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053952:0:14796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cc8a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143132.053954:0:14796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053958:0:14796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053962:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5413a00) 00010000:00010000:2.0:1746143132.053964:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143132.053966:0:14796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.053971:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8a00/0x25aee876ca70d2c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143132.054011:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc9400/0x25aee876ca70d2bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 208 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.054021:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 207 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.054027:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143132.054029:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143132.054052:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8600, rc 0) 00000100:00100000:2.0:1746143132.054092:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:30946:x1830962858646912:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 562us (663us total) trans 8589942371 rc 0/0 00000100:00100000:2.0:1746143132.054099:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8167 00000100:00080000:1.0:1746143132.054233:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143132.054454:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858647040 00000100:00100000:3.0:1746143132.054459:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858647040 00000100:00100000:3.0:1746143132.054485:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12407 00000100:00100000:3.0:1746143132.054491:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30944:x1830962858647040:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143132.054503:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143132.054506:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143132.054513:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650275 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.054548:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858647296 00000100:00100000:1.0:1746143132.054552:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858647296 00000100:00100000:1.0:1746143132.054576:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3447 00000100:00100000:1.0:1746143132.054582:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30942:x1830962858647296:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:1.0:1746143132.054675:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30942:x1830962858647296:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 92us (167us total) trans 8589942372 rc 0/0 00000100:00100000:1.0:1746143132.054682:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3447 00010000:00010000:3.0:1746143132.054775:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.054783:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 10 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.054789:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 16 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.054794:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.054795:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.054798:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [552960->987135] (req 552960->987135) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.054823:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 16 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.054834:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 16 pid: 20836 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143132.054845:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254272:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.054922:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 10 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.054936:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 10 pid: 22204 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143132.054944:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254400:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.054971:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.054980:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 21 pid: 8450 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143132.054988:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254528:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.055006:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143132.060992:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254272:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.061007:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254400:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.061016:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254528:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.061068:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [552960->987135] (req 552960->987135) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.061084:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c044c00, rc 0) 00000100:00100000:3.0:1746143132.061124:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30944:x1830962858647040:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6632us (7857us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.062320:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.062566:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.062589:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.062664:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12407 00000100:00100000:3.0:1746143132.062705:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858647552 00000100:00100000:3.0:1746143132.062712:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858647552 00010000:00010000:3.0:1746143132.062734:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 16 pid: 20836 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143132.062752:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858647680 00000100:00100000:3.0:1746143132.062754:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858647680 00010000:00010000:3.0:1746143132.062761:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 22 pid: 8450 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143132.062771:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858647424 00000100:00100000:3.0:1746143132.062772:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858647424 00010000:00010000:3.0:1746143132.062786:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 11 pid: 22204 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143132.062798:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6550 00000100:00100000:3.0:1746143132.062803:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858647552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.062813:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.062830:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 16 pid: 20836 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063086:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 16 pid: 20836 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063106:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5471600/0x25aee876ca70d12c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650180 expref: 16 pid: 20836 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063118:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.063138:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858647552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 335us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.063144:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6550 00000100:00100000:3.0:1746143132.063154:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6551 00000100:00100000:3.0:1746143132.063158:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858647680:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.063164:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.063171:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 22 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063178:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 22 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063188:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d0f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165014f expref: 22 pid: 8450 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063194:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.063206:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858647680:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 47us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.063210:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6551 00000100:00100000:3.0:1746143132.063218:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6552 00000100:00100000:3.0:1746143132.063222:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858647424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.063227:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.063233:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 11 pid: 22204 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063255:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 11 pid: 22204 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063269:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a529fc00/0x25aee876ca70d228 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165021a expref: 11 pid: 22204 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143132.063276:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.063278:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.063284:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 14 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.063291:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 14 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.063314:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 14 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.063326:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861254656:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143132.063497:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858646144:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43208us (43506us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.063505:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6006 00002000:00100000:2.0:1746143132.063514:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880090f20700 x1830962858646144/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.063523:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20700 with x1830962858646144 ext(3145728->4194303) 00002000:00010000:2.0:1746143132.063528:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f20700 00000100:00100000:3.0:1746143132.063845:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bc00 going to sleep for 11 seconds 00000100:00080000:3.0:1746143132.063858:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143132.070065:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.070600:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858646016:12345-192.168.201.28@tcp:3:cat.0 Request processed in 48418us (50577us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.070611:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6007 00002000:00100000:2.0:1746143132.070623:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880090f23800 x1830962858646016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.070632:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23800 with x1830962858646016 ext(2097152->3145727) 00002000:00010000:2.0:1746143132.070638:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f23800 00000100:00100000:2.0:1746143132.070660:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858647936 00000100:00100000:2.0:1746143132.070667:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858647936 00002000:00100000:2.0:1746143132.070692:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5ccaa00 x1830962858647936/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.070698:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccaa00 with x1830962858647936 ext(2097152->3145727) 00002000:00010000:2.0:1746143132.070701:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ccaa00 00000100:00100000:2.0:1746143132.070725:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6009 00000100:00100000:2.0:1746143132.070731:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858647936:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143132.075294:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861254656:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143132.075315:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.075367:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858647424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 12142us (12776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.075552:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6552 00000100:00100000:2.0:1746143132.087188:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858646400:12345-192.168.201.28@tcp:3:cat.0 Request processed in 63443us (67107us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.087201:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6008 00002000:00100000:2.0:1746143132.087214:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880090f21c00 x1830962858646400/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.087224:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21c00 with x1830962858646400 ext(3145728->4194303) 00002000:00010000:2.0:1746143132.087230:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21c00 00000100:00100000:0.0:1746143132.088748:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.089064:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858648192 00000100:00100000:2.0:1746143132.089072:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858648192 00002000:00100000:2.0:1746143132.089101:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fc:0x0] (983040->987135) req@ffff8800a5cc9f80 x1830962858648192/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.089110:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc9f80 with x1830962858648192 ext(983040->987135) 00002000:00010000:2.0:1746143132.089115:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5cc9f80 00000100:00100000:2.0:1746143132.089140:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6010 00000100:00100000:2.0:1746143132.089146:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858648192:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143132.089288:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858648192:12345-192.168.201.28@tcp:3:cat.0 Request processed in 142us (547us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143132.089294:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6010 00002000:00100000:2.0:1746143132.089299:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fc:0x0] (983040->987135) req@ffff8800a5cc9f80 x1830962858648192/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.089306:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc9f80 with x1830962858648192 ext(983040->987135) 00002000:00010000:2.0:1746143132.089309:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5cc9f80 00000100:00100000:0.0:1746143132.095228:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.095342:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858648448 00000100:00100000:3.0:1746143132.095352:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858648448 00000100:00100000:3.0:1746143132.095413:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3448 00000100:00100000:3.0:1746143132.095421:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30944:x1830962858648448:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143132.095630:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:30944:x1830962858648448:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 210us (409us total) trans 8589942373 rc 0/0 00000100:00100000:3.0:1746143132.095637:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3448 00000100:00080000:0.0:1746143132.095777:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143132.099566:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858647936:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28826us (29499us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.099576:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6009 00002000:00100000:2.0:1746143132.099587:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5ccaa00 x1830962858647936/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.099599:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccaa00 with x1830962858647936 ext(2097152->3145727) 00002000:00010000:2.0:1746143132.099605:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ccaa00 00000100:00100000:3.0:1746143132.112306:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.112339:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858648576 00000100:00100000:3.0:1746143132.112348:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858648576 00000100:00100000:3.0:1746143132.112388:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12408 00000100:00100000:3.0:1746143132.112395:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858648576:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143132.112412:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.112427:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6798c00/0x25aee876ca70d2e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650283 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.112459:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.112475:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254784:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143132.112525:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.112534:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858648704 00000100:00100000:3.0:1746143132.112538:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858648704 00000100:00100000:3.0:1746143132.112551:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858648832 00000100:00100000:3.0:1746143132.112553:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858648832 00000100:00100000:3.0:1746143132.112565:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12409 00000100:00100000:3.0:1746143132.112570:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858648704:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143132.112576:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12410 00010000:00010000:3.0:1746143132.112577:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143132.112582:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30939:x1830962858648832:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143132.112586:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165028a expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.112588:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.112594:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650291 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.112597:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.112598:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.112604:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.112605:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.112605:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.112610:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.112622:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.112622:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.112631:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6798400, rc 0) 00010000:00010000:1.0:1746143132.112633:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094df0800, rc 0) 00000100:00100000:3.0:1746143132.112661:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858648704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.112667:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12409 00000100:00100000:1.0:1746143132.113066:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30939:x1830962858648832:12345-192.168.201.28@tcp:101:cat.0 Request processed in 483us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.113072:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12410 00000100:00100000:3.0:1746143132.114247:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bc00 going to sleep for 11 seconds 00002000:00010000:3.0:1746143132.115879:0:10061:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143129 -> 1746143130 00002000:00010000:3.0:1746143132.115884:0:10061:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143126 -> 1746143131 00002000:00010000:3.0:1746143132.115886:0:10061:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143129 -> 1746143130 00000100:00100000:3.0:1746143132.115911:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254784:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143132.115936:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6798c00/0x25aee876ca70d2e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650283 expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.115947:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6798c00/0x25aee876ca70d2e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650283 expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.115969:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6798c00, rc 0) 00000100:00100000:3.0:1746143132.116008:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858648576:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3613us (3710us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143132.116016:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12408 00000100:00100000:0.0:1746143132.122295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.124680:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.124715:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.125157:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858648960 00000100:00100000:3.0:1746143132.125166:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858648960 00000100:00100000:3.0:1746143132.125202:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12411 00000100:00100000:3.0:1746143132.125210:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30946:x1830962858648960:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143132.125224:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.125249:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650298 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.125276:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 14 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.125283:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143132.125285:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143132.125287:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [245760->712703] (req 245760->712703) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.125313:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 14 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.125323:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 14 pid: 10061 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143132.125335:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254912:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.125396:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.125661:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.125780:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858649216 00000100:00100000:2.0:1746143132.125784:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858649216 00000100:00100000:2.0:1746143132.125794:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858649472 00000100:00100000:2.0:1746143132.125796:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858649472 00002000:00100000:2.0:1746143132.125822:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800a5cc8380 x1830962858649472/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.125831:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc8380 with x1830962858649472 ext(2097152->3145727) 00002000:00010000:2.0:1746143132.125835:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5cc8380 00000100:00100000:2.0:1746143132.125858:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858649728 00000100:00100000:2.0:1746143132.125860:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858649728 00002000:00100000:2.0:1746143132.125873:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094512680 x1830962858649728/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.125879:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512680 with x1830962858649728 ext(3145728->4194303) 00002000:00010000:2.0:1746143132.125883:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094512680 00000100:00100000:2.0:1746143132.125904:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6011 00000100:00100000:2.0:1746143132.125910:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858649472:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:2.0:1746143132.127154:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a5ccb480 x1830962858649216/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.127162:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccb480 with x1830962858649216 ext(4194304->5210111) 00002000:00010000:2.0:1746143132.127166:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ccb480 00000100:00100000:2.0:1746143132.127185:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6012 00000100:00100000:2.0:1746143132.127191:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858649728:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143132.127354:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6013 00000100:00100000:1.0:1746143132.127361:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858649216:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143132.129404:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.129421:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858649856 00000100:00100000:0.0:1746143132.129602:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858649856 00002000:00100000:0.0:1746143132.129623:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (552960->987135) req@ffff88012d3d4700 x1830962858649856/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.129631:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d4700 with x1830962858649856 ext(552960->987135) 00010000:00010000:0.0:1746143132.129639:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 17 pid: 10061 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143132.129650:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 17 pid: 10061 timeout: 1013 lvb_type: 0 00002000:00010000:0.0:1746143132.129656:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d3d4700 00000100:00100000:0.0:1746143132.129668:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1978 00000100:00100000:0.0:1746143132.129674:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858649856:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143132.130342:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861254912:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.130366:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [245760->712703] (req 245760->712703) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 21 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.130377:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6798e00, rc 0) 00000100:00100000:3.0:1746143132.130412:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30946:x1830962858648960:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5203us (8125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.130418:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12411 00000100:00100000:3.0:1746143132.143909:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858649472:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17991us (19185us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143132.143920:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6011 00002000:00100000:3.0:1746143132.143929:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800a5cc8380 x1830962858649472/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.143938:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc8380 with x1830962858649472 ext(2097152->3145727) 00002000:00010000:3.0:1746143132.143943:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5cc8380 00000100:00100000:2.0:1746143132.144325:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858649856:12345-192.168.201.28@tcp:4:cat.0 Request processed in 14648us (14921us total) trans 21474840041 rc 0/0 00000100:00100000:2.0:1746143132.144334:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1978 00002000:00100000:2.0:1746143132.144340:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (552960->987135) req@ffff88012d3d4700 x1830962858649856/t21474840041(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/448 e 0 to 0 dl 1746143143 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.144348:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d4700 with x1830962858649856 ext(552960->987135) 00010000:00010000:2.0:1746143132.144356:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 19 pid: 10061 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143132.144370:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 19 pid: 10061 timeout: 1013 lvb_type: 0 00002000:00010000:2.0:1746143132.144377:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d3d4700 00000100:00100000:2.0:1746143132.149268:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858649728:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22068us (23598us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.149279:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6012 00002000:00100000:2.0:1746143132.151846:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094512680 x1830962858649728/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.152627:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512680 with x1830962858649728 ext(3145728->4194303) 00002000:00010000:2.0:1746143132.152635:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094512680 00000100:00100000:0.0:1746143132.152960:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.153162:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858649984 00000100:00100000:3.0:1746143132.153170:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858649984 00010000:00010000:3.0:1746143132.153195:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 17 pid: 10061 timeout: 1013 lvb_type: 0 00000100:00100000:3.0:1746143132.153227:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6553 00000100:00100000:3.0:1746143132.153234:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5317450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858649984:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.153255:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.153275:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 17 pid: 10061 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143132.153287:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 17 pid: 10061 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143132.153307:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c044c00/0x25aee876ca70d2de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 552960->987135) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650275 expref: 17 pid: 10061 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143132.153329:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.153331:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.153338:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 21 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.153345:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 21 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.153379:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 21 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.153391:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861255040:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143132.153469:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.154166:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858649216:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 26805us (29490us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143132.154175:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6013 00002000:00100000:2.0:1746143132.154182:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a5ccb480 x1830962858649216/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.154189:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ccb480 with x1830962858649216 ext(4194304->5210111) 00002000:00010000:2.0:1746143132.154193:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ccb480 00000100:00100000:3.0:1746143132.159351:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861255040:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143132.159374:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.159415:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5317450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858649984:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6181us (6455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.159425:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6553 00000100:00100000:0.0:1746143132.160646:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.160721:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858650112 00000100:00100000:3.0:1746143132.160727:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858650112 00000100:00100000:1.0:1746143132.161395:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12412 00000100:00100000:1.0:1746143132.161404:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858650112:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143132.161419:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.161435:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094df1a00/0x25aee876ca70d301 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165029f expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.161477:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861255168:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143132.162303:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.165300:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.165384:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858650368 00000100:00100000:2.0:1746143132.165392:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858650368 00002000:00100000:2.0:1746143132.165426:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (245760->249855) req@ffff88012d3d5c00 x1830962858650368/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.165435:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d5c00 with x1830962858650368 ext(245760->249855) 00002000:00010000:2.0:1746143132.165440:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3d5c00 00000100:00100000:2.0:1746143132.165455:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6014 00000100:00100000:2.0:1746143132.165461:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858650368:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143132.166090:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858650368:12345-192.168.201.28@tcp:3:cat.0 Request processed in 628us (794us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143132.166096:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6014 00002000:00100000:2.0:1746143132.166102:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (245760->249855) req@ffff88012d3d5c00 x1830962858650368/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.166109:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d5c00 with x1830962858650368 ext(245760->249855) 00002000:00010000:2.0:1746143132.166111:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3d5c00 00000100:00100000:1.0:1746143132.166817:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861255168:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143132.166850:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094df1a00/0x25aee876ca70d301 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165029f expref: 17 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.166861:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094df1a00/0x25aee876ca70d301 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165029f expref: 17 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.166874:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094df1a00, rc 0) 00000100:00100000:1.0:1746143132.166914:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858650112:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5512us (6269us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143132.166921:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12412 00000100:00100000:0.0:1746143132.174634:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.174732:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858650624 00000100:00100000:2.0:1746143132.174955:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858650624 00002000:00100000:2.0:1746143132.174994:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (708608->712703) req@ffff88012d3d7480 x1830962858650624/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.175004:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d7480 with x1830962858650624 ext(708608->712703) 00002000:00010000:2.0:1746143132.175010:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3d7480 00000100:00100000:2.0:1746143132.175099:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6015 00000100:00100000:2.0:1746143132.175108:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858650624:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143132.175275:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858650624:12345-192.168.201.28@tcp:3:cat.0 Request processed in 167us (650us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143132.175282:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6015 00002000:00100000:2.0:1746143132.175288:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (708608->712703) req@ffff88012d3d7480 x1830962858650624/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.175295:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d7480 with x1830962858650624 ext(708608->712703) 00002000:00010000:2.0:1746143132.175297:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3d7480 00000100:00100000:0.0:1746143132.175366:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.175785:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858650752 00000100:00100000:1.0:1746143132.175789:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858650752 00000100:00100000:3.0:1746143132.175874:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12413 00000100:00100000:3.0:1746143132.175881:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858650752:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143132.175890:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.175905:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6799800/0x25aee876ca70d308 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502a6 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.175953:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861255296:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143132.176289:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143132.178306:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861255296:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143132.178332:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6799800/0x25aee876ca70d308 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502a6 expref: 17 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.178345:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6799800/0x25aee876ca70d308 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502a6 expref: 17 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.178363:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6799800, rc 0) 00000100:00100000:3.0:1746143132.178395:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858650752:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2514us (3029us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143132.178601:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12413 00000100:00100000:1.0:1746143132.178724:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.178825:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858651008 00000100:00100000:0.0:1746143132.178831:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858651008 00000100:00100000:0.0:1746143132.178861:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3449 00000100:00100000:0.0:1746143132.178868:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:30946:x1830962858651008:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:0.0:1746143132.179797:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:30946:x1830962858651008:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 927us (1071us total) trans 8589942374 rc 0/0 00000100:00100000:0.0:1746143132.179804:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3449 00000100:00100000:0.0:1746143132.181570:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.181670:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858651136 00000100:00100000:3.0:1746143132.181677:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858651136 00000100:00100000:3.0:1746143132.181717:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12414 00000100:00100000:3.0:1746143132.181723:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858651136:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143132.181736:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.181750:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d30f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502ad expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.181831:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861255424:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143132.181980:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b840 going to sleep for 11 seconds 00002000:00010000:3.0:1746143132.183877:0:10061:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143130 -> 1746143131 00002000:00010000:3.0:1746143132.183882:0:10061:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143130 -> 1746143131 00000100:00100000:3.0:1746143132.183901:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861255424:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143132.183925:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d30f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ad expref: 17 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.183935:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d30f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ad expref: 17 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.183944:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6799c00, rc 0) 00000100:00100000:3.0:1746143132.183974:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858651136:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2251us (2409us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143132.183981:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12414 00000100:00100000:1.0:1746143132.330391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.330965:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858651392 00000100:00100000:0.0:1746143132.330974:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858651392 00000100:00100000:0.0:1746143132.331016:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8168 00000100:00100000:0.0:1746143132.331024:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:30955:x1830962858651392:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143132.331827:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143132.331842:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28800/0x25aee876ca70d316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502b4 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.331919:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143132.331931:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.331939:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 16 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.331945:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 209 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.331951:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143132.331979:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 209 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.331989:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 209 pid: 14796 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.332001:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861255552:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143132.334444:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 16 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.334455:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 16 pid: 14796 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.334465:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861255680:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143132.334574:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 8 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.334581:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 8 pid: 14796 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.334588:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861255808:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143132.334604:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.337111:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861256320:0@lo:400:kworker.0 00000100:00100000:2.0:1746143132.337168:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143132.337194:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143132.337199:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3299:1830962861255936:0@lo:400:kworker.0 00000100:00100000:2.0:1746143132.337219:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143132.337246:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861256448:0@lo:400:kworker.0 00000100:00100000:2.0:1746143132.337264:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143132.337289:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861256320 00000100:00100000:2.0:1746143132.337295:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861256320 00000100:00100000:2.0:1746143132.337324:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861256448 00000100:00100000:2.0:1746143132.337325:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861256448 00000100:00100000:2.0:1746143132.337339:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1746143132.337345:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3299:x1830962861256320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143132.337383:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3299:x1830962861256320:12345-0@lo:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.337388:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1746143132.337405:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1746143132.337409:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861256448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143132.337430:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861256448:12345-0@lo:400:kworker.0 Request processed in 21us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.337435:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1746143132.337462:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872777 gen 2 00000004:00080000:2.0:1746143132.337467:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aed500, transno 17179872714 00000004:00080000:2.0:1746143132.337473:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aefb80, transno 17179872715 00000004:00080000:2.0:1746143132.337475:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aed880, transno 17179872716 00000004:00080000:2.0:1746143132.337477:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aece00, transno 17179872717 00000004:00080000:2.0:1746143132.337478:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aef800, transno 17179872718 00000004:00080000:2.0:1746143132.337480:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aeea00, transno 17179872719 00000004:00080000:2.0:1746143132.337483:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aef100, transno 17179872720 00000004:00080000:2.0:1746143132.337485:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aedc00, transno 17179872721 00000004:00080000:2.0:1746143132.337487:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ad59880, transno 17179872725 00000004:00080000:2.0:1746143132.337489:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b89c00, transno 17179872726 00000004:00080000:2.0:1746143132.337697:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb56a00, transno 17179872727 00000004:00080000:2.0:1746143132.337700:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb54e00, transno 17179872728 00000004:00080000:2.0:1746143132.337703:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b8b800, transno 17179872729 00000004:00080000:2.0:1746143132.337704:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aeca80, transno 17179872730 00000004:00080000:2.0:1746143132.337707:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b89880, transno 17179872731 00000004:00080000:2.0:1746143132.337708:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b89f80, transno 17179872732 00000004:00080000:2.0:1746143132.337710:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b80d500, transno 17179872733 00000004:00080000:2.0:1746143132.337712:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b80d880, transno 17179872734 00000004:00080000:2.0:1746143132.337714:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b80e300, transno 17179872735 00000004:00080000:2.0:1746143132.337715:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b80e680, transno 17179872736 00000004:00080000:2.0:1746143132.337716:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b80dc00, transno 17179872737 00000004:00080000:2.0:1746143132.337718:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b80ea00, transno 17179872738 00000004:00080000:2.0:1746143132.337720:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b80d180, transno 17179872739 00000004:00080000:2.0:1746143132.337722:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b80df80, transno 17179872740 00000004:00080000:2.0:1746143132.337725:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fdead80, transno 17179872745 00000004:00080000:2.0:1746143132.337727:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fde9880, transno 17179872746 00000004:00080000:2.0:1746143132.337729:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fdeb100, transno 17179872747 00000004:00080000:2.0:1746143132.337950:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fde9500, transno 17179872748 00000004:00080000:2.0:1746143132.337951:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fde8a80, transno 17179872749 00000004:00080000:2.0:1746143132.337953:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fdeb480, transno 17179872750 00000004:00080000:2.0:1746143132.337955:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fdeaa00, transno 17179872751 00000004:00080000:2.0:1746143132.337957:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fdeb800, transno 17179872752 00000004:00080000:2.0:1746143132.337959:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e6a00, transno 17179872753 00000004:00080000:2.0:1746143132.337961:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e7100, transno 17179872754 00000004:00080000:2.0:1746143132.337963:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e6d80, transno 17179872755 00000004:00080000:2.0:1746143132.337965:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e6680, transno 17179872756 00000004:00080000:2.0:1746143132.337968:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e7800, transno 17179872757 00000004:00080000:2.0:1746143132.337970:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e5f80, transno 17179872758 00000004:00080000:2.0:1746143132.337972:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e6300, transno 17179872759 00000004:00080000:2.0:1746143132.337974:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e7480, transno 17179872760 00000004:00080000:2.0:1746143132.337976:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b88a80, transno 17179872762 00000004:00080000:2.0:1746143132.337978:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b8bb80, transno 17179872763 00000004:00080000:2.0:1746143132.337980:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eaad180, transno 17179872764 00000004:00080000:2.0:1746143132.337982:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b8b480, transno 17179872765 00000004:00080000:2.0:1746143132.337984:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb75180, transno 17179872766 00000004:00080000:2.0:1746143132.337986:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb76680, transno 17179872767 00000004:00080000:2.0:1746143132.337988:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009535e680, transno 17179872768 00000004:00080000:2.0:1746143132.337990:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a70700, transno 17179872769 00000004:00080000:2.0:1746143132.337992:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009535c380, transno 17179872770 00000004:00080000:2.0:1746143132.337993:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fde8380, transno 17179872771 00000004:00080000:2.0:1746143132.337995:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fdea680, transno 17179872772 00000004:00080000:2.0:1746143132.337997:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fde8e00, transno 17179872773 00000004:00080000:2.0:1746143132.337999:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e4700, transno 17179872774 00000004:00080000:2.0:1746143132.338001:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fde8000, transno 17179872775 00000004:00080000:2.0:1746143132.338004:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fde9180, transno 17179872776 00000004:00080000:2.0:1746143132.338006:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009535c000, transno 17179872777 00000100:00100000:2.0:1746143132.338012:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861256448:0@lo:400:kworker.0 00000100:00100000:2.0:1746143132.338026:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861256320:0@lo:400:kworker.0 00000004:00080000:2.0:1746143132.338462:0:14837:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 56 done 00000100:00100000:1.0:1746143132.338626:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1830962861256192:0@lo:400:kworker.0 00000100:00100000:1.0:1746143132.338655:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143132.338673:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143132.338678:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1830962861256064:0@lo:400:kworker.0 00000100:00100000:1.0:1746143132.338692:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143132.338701:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830962861256576:0@lo:400:kworker.0 00000100:00100000:1.0:1746143132.338712:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143132.338730:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861256192 00000100:00100000:1.0:1746143132.338733:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861256192 00000100:00100000:1.0:1746143132.338756:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861256064 00000100:00100000:1.0:1746143132.338757:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861256064 00000100:00100000:1.0:1746143132.338766:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861256576 00000100:00100000:1.0:1746143132.338768:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861256576 00000100:00100000:1.0:1746143132.338776:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1746143132.338780:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1830962861256192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143132.338805:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1830962861256192:12345-0@lo:400:kworker.0 Request processed in 25us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.338810:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1746143132.338819:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1746143132.338823:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1830962861256064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143132.338863:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1830962861256064:12345-0@lo:400:kworker.0 Request processed in 40us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.338867:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1746143132.338874:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1746143132.338877:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1830962861256576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143132.338892:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1830962861256576:12345-0@lo:400:kworker.0 Request processed in 15us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.338896:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:1.0:1746143132.338906:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143132.338922:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1830962861256064:0@lo:400:kworker.0 00000100:00100000:1.0:1746143132.338928:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830962861256576:0@lo:400:kworker.0 00000100:00100000:1.0:1746143132.338933:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1830962861256192:0@lo:400:kworker.0 00000100:00100000:3.0:1746143132.339705:0:14792:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861255936 00000100:00100000:3.0:1746143132.339710:0:14792:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861255936 00000100:00100000:3.0:1746143132.339732:0:14792:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1746143132.339737:0:14792:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3299:x1830962861255936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143132.339778:0:14792:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3299:x1830962861255936:12345-0@lo:400:kworker.0 Request processed in 41us (2557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.339783:0:14792:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1746143132.341789:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.342232:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3299:1830962861255936:0@lo:400:kworker.0 00000100:00100000:0.0:1746143132.342976:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861255552:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143132.342988:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861255680:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.343001:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858651520 00000100:00100000:3.0:1746143132.343006:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858651520 00010000:00010000:3.0:1746143132.343046:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 210 pid: 14796 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.343068:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6554 00000100:00100000:3.0:1746143132.343074:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:1970:x1830962858651520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.343085:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.343089:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 210 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.343098:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 210 pid: 14796 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.343103:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143132.343117:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cc8600/0x25aee876ca70d2d0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165027c expref: 210 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.343129:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.343133:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143132.343140:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143132.343145:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.343184:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:1970:x1830962858651520:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 110us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.343190:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6554 00000100:00100000:3.0:1746143132.343201:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858651648 00000100:00100000:3.0:1746143132.343204:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858651648 00010000:00010000:3.0:1746143132.343213:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 17 pid: 14796 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.343226:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6555 00000100:00100000:3.0:1746143132.343231:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858651648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.343251:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.343256:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 17 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.343264:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 17 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.343274:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009da34a00/0x25aee876ca70d291 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650259 expref: 17 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.343282:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.343285:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143132.343290:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143132.343295:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.343310:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858651648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.343315:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6555 00000100:00100000:0.0:1746143132.348613:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.348738:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.348787:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861255808:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.348815:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143132.348836:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858652032 00000100:00100000:3.0:1746143132.348841:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858652032 00000100:00100000:3.0:1746143132.348873:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8169 00000100:00100000:3.0:1746143132.348879:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30959:x1830962858652032:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143132.348897:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.348910:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6798200/0x25aee876ca70d324 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502bb expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.349010:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349021:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143132.349081:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858651776 00000100:00100000:2.0:1746143132.349085:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858651776 00010000:00010000:2.0:1746143132.349101:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 9 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.349118:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143132.349120:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6556 00000100:00100000:2.0:1746143132.349125:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858651776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.349132:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.349137:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 9 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.349138:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349144:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143132.349146:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 9 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.349149:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143132.349160:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ceca00/0x25aee876ca70d275 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650252 expref: 9 pid: 14796 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.349170:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143132.349174:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.349180:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.349185:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.349199:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.349231:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858651776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 105us (493us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143132.349702:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349710:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349716:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143132.349723:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143132.349787:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349794:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349799:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349807:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6799c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143132.349810:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349816:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349823:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143132.349825:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143132.349828:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349832:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799c00/0x25aee876ca70d32b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349844:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349848:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349853:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349857:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6799800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143132.349859:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349863:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.349868:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531100) 00010000:00010000:3.0:1746143132.349869:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143132.349872:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.350089:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6799800/0x25aee876ca70d332 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.350120:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6798200/0x25aee876ca70d324 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 19 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.350129:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 18 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.350136:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.350138:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143132.350140:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b43b800, rc 0) 00000100:00100000:3.0:1746143132.350163:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30959:x1830962858652032:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1283us (1554us total) trans 8589942375 rc 0/0 00000100:00100000:3.0:1746143132.350169:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8169 00000100:00100000:2.0:1746143132.350485:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6556 00010000:00010000:2.0:1746143132.350709:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.350715:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143132.350725:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143132.350784:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28800/0x25aee876ca70d316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 210 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.350795:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 209 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.350800:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143132.350802:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143132.350804:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a28c00, rc 0) 00000100:00100000:2.0:1746143132.350842:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:30955:x1830962858651392:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 19818us (20458us total) trans 8589942376 rc 0/0 00000100:00100000:2.0:1746143132.350847:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8168 00000100:00100000:0.0:1746143132.353574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.353598:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858652288 00000100:00100000:0.0:1746143132.353605:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858652288 00000100:00100000:0.0:1746143132.353648:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3450 00000100:00100000:0.0:1746143132.353655:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:30959:x1830962858652288:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143132.354521:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30959:x1830962858652288:12345-192.168.201.28@tcp:35:cat.0 Request processed in 865us (950us total) trans 8589942377 rc 0/0 00000100:00100000:0.0:1746143132.354531:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3450 00000100:00100000:2.0:1746143132.354992:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861256704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143132.355027:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143132.355077:0:25353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861256704 00000100:00100000:2.0:1746143132.355080:0:25353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861256704 00000100:00100000:2.0:1746143132.355102:0:25353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1746143132.355107:0:25353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3302:x1830962861256704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746143132.355120:0:25353:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 493027328 pending 11927552 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746143132.355147:0:25353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3302:x1830962861256704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.355153:0:25353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1746143132.355187:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861256704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143132.359660:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.359815:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.359895:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858652416 00000100:00100000:2.0:1746143132.359903:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858652416 00000100:00100000:2.0:1746143132.359940:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12415 00000100:00100000:2.0:1746143132.359948:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858652416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143132.359963:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.360384:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70d34e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502c2 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143132.360433:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861256832:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143132.360500:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dd76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.360515:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858652672 00000100:00100000:2.0:1746143132.360518:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858652672 00000100:00100000:2.0:1746143132.360541:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8170 00000100:00100000:2.0:1746143132.360546:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:30958:x1830962858652672:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143132.360558:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.360569:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca70d355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502c9 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.361105:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361119:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361132:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361143:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361148:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361154:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361253:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d36a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361261:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d36a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361266:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d36a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143132.361273:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143132.361341:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361347:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361351:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361357:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093244c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143132.361360:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361366:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361376:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143132.361378:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143132.361381:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361385:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244c00/0x25aee876ca70d35c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361395:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361400:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361405:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361410:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093244e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143132.361412:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361416:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361421:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a497f500) 00010000:00010000:2.0:1746143132.361423:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143132.361425:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361429:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244e00/0x25aee876ca70d363 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.361461:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244600/0x25aee876ca70d355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502c9 expref: 22 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.361472:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d36a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502c9 expref: 21 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.361478:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143132.361480:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143132.361483:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245e00, rc 0) 00000100:00100000:2.0:1746143132.361564:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:30958:x1830962858652672:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1015us (1747us total) trans 8589942378 rc 0/0 00000100:00100000:2.0:1746143132.361570:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8170 00002000:00010000:2.0:1746143132.368297:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1997 -> 1999 00000100:00100000:2.0:1746143132.368310:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861256832:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143132.368339:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70d34e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502c2 expref: 17 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.368354:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093245000/0x25aee876ca70d34e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502c2 expref: 17 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.368363:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245000, rc 0) 00000100:00100000:2.0:1746143132.368408:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858652416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8457us (8752us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143132.368415:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12415 00000100:00100000:1.0:1746143132.370643:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.370665:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858652800 00000100:00100000:2.0:1746143132.370672:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858652800 00000100:00100000:2.0:1746143132.370712:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 612 00000100:00100000:2.0:1746143132.370719:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858652800:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.370732:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.370750:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245e00/0x25aee876ca70d36a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502c9 expref: 21 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.370763:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143132.370767:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.370795:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858652800:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.371027:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 612 00000100:00100000:0.0:1746143132.385805:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861256960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143132.385860:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1746143132.385867:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840039 is committed 00000001:00080000:2.0:1746143132.385889:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840021 is committed 00000001:00080000:2.0:1746143132.385901:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839981 is committed 00000001:00080000:2.0:1746143132.385936:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840000 is committed 00000001:00080000:2.0:1746143132.385962:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840041 is committed 00000001:00080000:2.0:1746143132.385966:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840040 is committed 00000100:00100000:3.0:1746143132.386106:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861256960 00000100:00100000:3.0:1746143132.386113:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861256960 00000100:00100000:3.0:1746143132.386147:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1746143132.386153:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861256960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746143132.386173:0:8451:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 516751360 pending 3407872 free 3851419648 avail 3837788160 00000100:00100000:3.0:1746143132.386210:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861256960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.386215:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1746143132.386786:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861256960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143132.386808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.386828:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858652928 00000100:00100000:0.0:1746143132.386831:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858652928 00000100:00100000:0.0:1746143132.386860:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12416 00000100:00100000:0.0:1746143132.386865:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:30959:x1830962858652928:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143132.386873:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143132.386887:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502d0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.386908:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.386915:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143132.386917:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143132.386920:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 9 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.386939:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.386949:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.386963:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861257088:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143132.387044:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.389162:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861257088:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.389188:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 9 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.389202:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c5b000, rc 0) 00000100:00100000:2.0:1746143132.389251:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30959:x1830962858652928:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2384us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.389259:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12416 00000100:00100000:0.0:1746143132.391391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.391411:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858653056 00000100:00100000:1.0:1746143132.391616:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858653056 00002000:00100000:1.0:1746143132.391650:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (245760->712703) req@ffff880092aef100 x1830962858653056/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.391658:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aef100 with x1830962858653056 ext(245760->712703) 00010000:00010000:1.0:1746143132.391665:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 14 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.391677:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 14 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:1.0:1746143132.391687:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092aef100 00000100:00100000:1.0:1746143132.391716:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1979 00000100:00100000:1.0:1746143132.391723:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858653056:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143132.395325:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.397122:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858653184 00000100:00100000:2.0:1746143132.397132:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858653184 00000100:00100000:2.0:1746143132.397173:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12417 00000100:00100000:2.0:1746143132.397181:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30958:x1830962858653184:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143132.397198:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.397214:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502d7 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.397253:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.397261:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 6 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.397268:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 10 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.397274:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.397275:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.397279:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.397313:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 10 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.397324:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 10 pid: 21048 timeout: 1014 lvb_type: 1 00000100:00100000:2.0:1746143132.397338:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861257216:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.397425:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 6 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.397435:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 6 pid: 8169 timeout: 1014 lvb_type: 1 00000100:00100000:2.0:1746143132.397444:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861257344:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.397682:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.397692:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 15 pid: 8450 timeout: 1014 lvb_type: 1 00000100:00100000:2.0:1746143132.397700:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861257472:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.397729:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.404998:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858653056:12345-192.168.201.28@tcp:4:cat.0 Request processed in 13266us (13602us total) trans 21474840042 rc 0/0 00000100:00100000:1.0:1746143132.405010:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1979 00002000:00100000:1.0:1746143132.405020:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (245760->712703) req@ffff880092aef100 x1830962858653056/t21474840042(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/448 e 0 to 0 dl 1746143143 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.405048:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aef100 with x1830962858653056 ext(245760->712703) 00010000:00010000:1.0:1746143132.405058:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 16 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.405073:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 16 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:1.0:1746143132.405079:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092aef100 00000100:00100000:0.0:1746143132.411248:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.411281:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.411282:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861257216:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.411292:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861257344:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.411299:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861257472:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143132.411319:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143132.411326:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.411342:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245800, rc 0) 00000100:00100000:2.0:1746143132.411389:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30958:x1830962858653184:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14208us (16069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.411399:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12417 00000100:00100000:3.0:1746143132.411489:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858653312 00000100:00100000:3.0:1746143132.411495:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858653312 00010000:00010000:3.0:1746143132.411520:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 10 pid: 21048 timeout: 1014 lvb_type: 1 00000100:00100000:3.0:1746143132.411538:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858653568 00000100:00100000:3.0:1746143132.411540:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858653568 00010000:00010000:3.0:1746143132.411549:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 16 pid: 8450 timeout: 1014 lvb_type: 1 00000100:00100000:3.0:1746143132.411560:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858653440 00000100:00100000:3.0:1746143132.411561:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858653440 00010000:00010000:3.0:1746143132.411576:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 7 pid: 8169 timeout: 1014 lvb_type: 1 00000100:00100000:3.0:1746143132.411591:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6557 00000100:00100000:3.0:1746143132.411597:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858653312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143132.411605:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6558 00010000:00010000:3.0:1746143132.411607:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143132.411614:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858653568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.411622:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.411626:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 10 pid: 21048 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.411633:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 16 pid: 8450 timeout: 1014 lvb_type: 1 00010000:00010000:3.0:1746143132.411635:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 10 pid: 21048 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.411644:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 16 pid: 8450 timeout: 1014 lvb_type: 1 00010000:00010000:3.0:1746143132.411667:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5496200/0x25aee876ca70d141 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650195 expref: 10 pid: 21048 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.411674:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba7b600/0x25aee876ca70d110 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650164 expref: 16 pid: 8450 timeout: 1014 lvb_type: 1 00010000:00010000:3.0:1746143132.411682:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143132.411689:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.411699:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858653312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 102us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.411708:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6557 00000100:00100000:1.0:1746143132.411709:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1971:x1830962858653568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 96us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.411714:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6558 00000100:00100000:3.0:1746143132.411720:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6559 00000100:00100000:3.0:1746143132.411725:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858653440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.411731:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.411739:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 7 pid: 8169 timeout: 1014 lvb_type: 1 00010000:00010000:3.0:1746143132.411747:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 7 pid: 8169 timeout: 1014 lvb_type: 1 00010000:00010000:3.0:1746143132.411759:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009490b200/0x25aee876ca70d23d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165022f expref: 7 pid: 8169 timeout: 1014 lvb_type: 1 00010000:00010000:3.0:1746143132.411772:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.411774:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.411780:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.411788:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.411813:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.411824:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861257600:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143132.411928:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eea300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.416542:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.416769:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861257600:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143132.416789:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.416824:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858653440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5097us (5503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.416833:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6559 00000100:00100000:3.0:1746143132.416883:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858653696 00000100:00100000:3.0:1746143132.416888:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858653696 00010000:00010000:3.0:1746143132.416908:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 15 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.416929:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6560 00000100:00100000:3.0:1746143132.416935:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858653696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.416944:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.416960:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 15 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.416969:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 15 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.416987:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6798e00/0x25aee876ca70d2fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->712703) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650298 expref: 15 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.417009:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.417011:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.417017:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.417029:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.417072:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.417083:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861257728:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143132.417123:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143132.418938:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861257728:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143132.418951:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.418975:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858653696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2040us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.418982:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6560 00000100:00100000:0.0:1746143132.421453:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.421558:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858653952 00000100:00100000:2.0:1746143132.421566:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858653952 00002000:00100000:2.0:1746143132.421604:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1916928->1921023) req@ffff880092aed180 x1830962858653952/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.421613:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aed180 with x1830962858653952 ext(1916928->1921023) 00002000:00010000:2.0:1746143132.421618:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aed180 00000100:00100000:2.0:1746143132.421645:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6016 00000100:00100000:2.0:1746143132.421652:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858653952:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143132.421840:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858653952:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 188us (393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143132.421846:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6016 00002000:00100000:2.0:1746143132.421852:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1916928->1921023) req@ffff880092aed180 x1830962858653952/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.421858:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aed180 with x1830962858653952 ext(1916928->1921023) 00002000:00010000:2.0:1746143132.421861:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aed180 00000100:00100000:0.0:1746143132.436539:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.436582:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.436611:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.437006:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858654336 00000100:00100000:3.0:1746143132.437016:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858654336 00000100:00100000:3.0:1746143132.437079:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8171 00000100:00100000:3.0:1746143132.437086:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:30962:x1830962858654336:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143132.437109:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.437123:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502de expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.437210:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.437221:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.437230:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.437251:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.437257:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.437262:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.437348:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.437355:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.437361:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143132.437368:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:2.0:1746143132.441774:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858654592 00000100:00100000:2.0:1746143132.441785:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858654592 00002000:00100000:2.0:1746143132.441830:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880092aec700 x1830962858654592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 504/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.441839:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec700 with x1830962858654592 ext(1048576->2097151) 00002000:00010000:2.0:1746143132.441844:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aec700 00000100:00100000:2.0:1746143132.441867:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6017 00000100:00100000:2.0:1746143132.441873:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858654592:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:3.0:1746143132.443379:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443390:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443396:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443402:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba7a000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143132.443405:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443411:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443424:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143132.443427:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143132.443430:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443435:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a000/0x25aee876ca70d38d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443669:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443675:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443680:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443684:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba7ac00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143132.443686:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443691:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443698:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531d00) 00010000:00010000:3.0:1746143132.443700:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143132.443702:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443706:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ac00/0x25aee876ca70d394 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.443748:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a400/0x25aee876ca70d386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 212 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.443760:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 211 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.443766:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.443768:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143132.443770:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7a200, rc 0) 00000100:00100000:3.0:1746143132.443821:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:30962:x1830962858654336:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6735us (7291us total) trans 8589942379 rc 0/0 00000100:00100000:3.0:1746143132.443828:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8171 00000100:00100000:3.0:1746143132.443859:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858654464 00000100:00100000:3.0:1746143132.443863:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858654464 00002000:00100000:3.0:1746143132.443882:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092aedf80 x1830962858654464/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.443890:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aedf80 with x1830962858654464 ext(0->1048575) 00002000:00010000:3.0:1746143132.443893:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aedf80 00000100:00100000:3.0:1746143132.443905:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6018 00000100:00100000:3.0:1746143132.443910:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858654464:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143132.444398:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.445503:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858654848 00000100:00100000:2.0:1746143132.445508:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858654848 00000100:00100000:2.0:1746143132.445553:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12418 00000100:00100000:2.0:1746143132.445560:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30955:x1830962858654848:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143132.445572:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.445585:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502e5 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.445608:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 22 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.445616:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.445623:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.445630:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 10 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.445636:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143132.445638:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143132.445641:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [3203072->3874815] (req 3203072->3874815) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 22 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.445667:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 10 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.445683:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 10 pid: 8448 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.445694:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861257856:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.445764:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 7 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.445773:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 7 pid: 22204 timeout: 1014 lvb_type: 1 00000100:00100000:2.0:1746143132.445781:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861257984:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.445804:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.445811:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.445818:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861258112:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.445837:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 22 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.445844:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 22 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.445856:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861258240:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.445870:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d4259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.445923:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.445945:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858655104 00000100:00100000:0.0:1746143132.445950:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858655104 00000100:00100000:0.0:1746143132.445976:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3451 00000100:00100000:0.0:1746143132.445982:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:30962:x1830962858655104:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143132.446134:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:30962:x1830962858655104:12345-192.168.201.28@tcp:35:cat.0 Request processed in 151us (211us total) trans 8589942380 rc 0/0 00000100:00100000:0.0:1746143132.446141:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3451 00000100:00100000:2.0:1746143132.461336:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861257856:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.461360:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861257984:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.461554:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861258112:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.461561:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861258240:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.461593:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [3203072->3874815] (req 3203072->3874815) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 22 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.461609:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093244600, rc 0) 00000100:00100000:2.0:1746143132.461663:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30955:x1830962858654848:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 16102us (17265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.461671:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12418 00000100:00100000:0.0:1746143132.463592:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.463648:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858655488 00000100:00100000:2.0:1746143132.463655:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858655488 00000100:00100000:2.0:1746143132.463695:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12419 00000100:00100000:2.0:1746143132.463703:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858655488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143132.463717:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.463732:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502ec expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.463749:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.463752:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.463759:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 15 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.463770:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 15 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.463778:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d522000, rc 0) 00000100:00100000:2.0:1746143132.463815:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858655488:12345-192.168.201.28@tcp:101:cat.0 Request processed in 114us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.463821:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12419 00000100:00100000:0.0:1746143132.465731:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.465758:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.465797:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.465820:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.466026:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.466073:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.466537:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858654592:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 24664us (29954us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746143132.466546:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6017 00002000:00100000:0.0:1746143132.466556:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880092aec700 x1830962858654592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 504/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.466564:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec700 with x1830962858654592 ext(1048576->2097151) 00002000:00010000:0.0:1746143132.466569:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aec700 00000100:00100000:0.0:1746143132.466653:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858655872 00000100:00100000:0.0:1746143132.466658:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858655872 00010000:00010000:0.0:1746143132.466681:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 22 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.466696:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858655360 00000100:00100000:0.0:1746143132.466698:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858655360 00010000:00010000:0.0:1746143132.466706:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 8 pid: 22204 timeout: 1014 lvb_type: 1 00000100:00100000:0.0:1746143132.466717:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858655232 00000100:00100000:0.0:1746143132.466718:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858655232 00010000:00010000:0.0:1746143132.466726:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 11 pid: 8448 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.466732:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858656000 00000100:00100000:0.0:1746143132.466734:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858656000 00010000:00010000:0.0:1746143132.466740:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 12 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.466752:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6561 00000100:00100000:0.0:1746143132.466758:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858655872:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143132.466767:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143132.466781:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 22 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.466790:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 22 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.466810:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dbf400/0x25aee876ca70d260 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165024b expref: 22 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.466824:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143132.466838:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858655872:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 81us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.466844:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6561 00000100:00100000:0.0:1746143132.466854:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6562 00000100:00100000:0.0:1746143132.466859:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858655360:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143132.466864:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143132.466870:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 8 pid: 22204 timeout: 1014 lvb_type: 1 00010000:00010000:0.0:1746143132.466876:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 8 pid: 22204 timeout: 1014 lvb_type: 1 00010000:00010000:0.0:1746143132.466889:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70d29f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650267 expref: 8 pid: 22204 timeout: 1014 lvb_type: 1 00010000:00010000:0.0:1746143132.466896:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143132.466907:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858655360:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 49us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.466912:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6562 00000100:00100000:0.0:1746143132.466920:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6563 00000100:00100000:0.0:1746143132.466924:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858655232:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143132.466929:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143132.466934:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 12 pid: 8448 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.466941:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 12 pid: 8448 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.466950:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x25aee876ca70d0ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650148 expref: 12 pid: 8448 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.466957:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143132.466967:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858655232:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 43us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.466972:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6563 00000100:00100000:0.0:1746143132.466979:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6564 00000100:00100000:0.0:1746143132.466982:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858656000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143132.466988:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143132.466994:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.467001:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.467010:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094df0800/0x25aee876ca70d2f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650291 expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.467017:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143132.467018:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143132.467024:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.467050:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.467077:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143132.467087:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861258368:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143132.467138:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.467295:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858655616 00000100:00100000:2.0:1746143132.467299:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858655616 00000100:00100000:2.0:1746143132.467322:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858655744 00000100:00100000:2.0:1746143132.467325:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858655744 00000100:00100000:2.0:1746143132.467339:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12420 00000100:00100000:2.0:1746143132.467343:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858655616:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143132.467360:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.467371:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c5a400/0x25aee876ca70d3b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502f3 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143132.467399:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861258496:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143132.467425:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d4259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.467615:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12421 00000100:00100000:1.0:1746143132.467624:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858655744:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143132.467631:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.467637:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b608600/0x25aee876ca70d3be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16502fa expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.467659:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861258624:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143132.467681:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfda80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.471973:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861258368:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143132.471991:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.472022:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858656000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5037us (5948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.472053:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6564 00000100:00100000:2.0:1746143132.473359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.473396:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858656256 00000100:00100000:1.0:1746143132.473402:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858656256 00002000:00100000:1.0:1746143132.473433:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3203072->3207167) req@ffff880094e94380 x1830962858656256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.473446:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e94380 with x1830962858656256 ext(3203072->3207167) 00002000:00010000:1.0:1746143132.473450:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e94380 00000100:00100000:1.0:1746143132.473991:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6019 00000100:00100000:1.0:1746143132.473999:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858656256:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143132.474283:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858656256:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 284us (926us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143132.474445:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6019 00002000:00100000:1.0:1746143132.474452:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3203072->3207167) req@ffff880094e94380 x1830962858656256/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.474459:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e94380 with x1830962858656256 ext(3203072->3207167) 00002000:00010000:1.0:1746143132.474462:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e94380 00000100:00100000:3.0:1746143132.474613:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858654464:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 30702us (38000us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143132.474620:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6018 00002000:00100000:3.0:1746143132.474625:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092aedf80 x1830962858654464/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.474637:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aedf80 with x1830962858654464 ext(0->1048575) 00000100:00100000:1.0:1746143132.474683:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:3.0:1746143132.474700:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aedf80 00000100:00100000:2.0:1746143132.474754:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858656384 00000100:00100000:2.0:1746143132.474758:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858656384 00000100:00100000:2.0:1746143132.474779:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12422 00000100:00100000:2.0:1746143132.474784:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30958:x1830962858656384:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143132.474810:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.474823:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650301 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.474843:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.474850:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.474857:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 16 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.474864:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.474865:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.474868:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->2277375] (req 2097152->2277375) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143132.474885:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143130 -> 1746143131 00002000:00010000:2.0:1746143132.474888:0:22204:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143128 -> 1746143131 00002000:00010000:1.0:1746143132.474888:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143127 -> 1746143131 00002000:00010000:2.0:1746143132.474890:0:22204:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143126 -> 1746143131 00002000:00010000:1.0:1746143132.474890:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143128 -> 1746143131 00002000:00010000:2.0:1746143132.474891:0:22204:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143128 -> 1746143131 00000100:00100000:2.0:1746143132.474899:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861258496:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143132.474899:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861258624:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143132.474916:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c5a400/0x25aee876ca70d3b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502f3 expref: 16 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.474916:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b608600/0x25aee876ca70d3be lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502fa expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.474925:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c5a400/0x25aee876ca70d3b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502f3 expref: 16 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.474925:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b608600/0x25aee876ca70d3be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502fa expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.474937:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b608600, rc 0) 00010000:00010000:2.0:1746143132.474938:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c5a400, rc 0) 00000100:00100000:1.0:1746143132.475024:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858655744:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7400us (9263us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143132.475046:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12421 00000100:00100000:2.0:1746143132.475982:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858655616:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8635us (10252us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143132.475987:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12420 00010000:00010000:2.0:1746143132.476025:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 14 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.476051:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 14 pid: 10061 timeout: 1014 lvb_type: 1 00000100:00100000:2.0:1746143132.476061:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861258752:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.476359:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.476369:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 5 pid: 8169 timeout: 1014 lvb_type: 1 00000100:00100000:2.0:1746143132.476377:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861258880:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.476403:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.476410:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.476421:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861259008:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.479653:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d4259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.497018:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.497132:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858656768 00000100:00100000:3.0:1746143132.497140:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858656768 00002000:00100000:3.0:1746143132.497181:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3870720->3874815) req@ffff88009314f480 x1830962858656768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.497190:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314f480 with x1830962858656768 ext(3870720->3874815) 00002000:00010000:3.0:1746143132.497195:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314f480 00000100:00100000:3.0:1746143132.497211:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6020 00000100:00100000:3.0:1746143132.497217:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858656768:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143132.497457:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861258752:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143132.497459:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.497467:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861258880:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143132.497496:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.497499:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858656640 00000100:00100000:1.0:1746143132.497503:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858656640 00000100:00100000:0.0:1746143132.497509:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143132.497520:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 6 pid: 8169 timeout: 1014 lvb_type: 1 00000100:00100000:0.0:1746143132.497536:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.497540:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858657408 00000100:00100000:1.0:1746143132.497542:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858657408 00010000:00010000:1.0:1746143132.497550:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 15 pid: 10061 timeout: 1014 lvb_type: 1 00000100:00100000:0.0:1746143132.497556:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858657024 00000100:00100000:0.0:1746143132.497559:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858657024 00000100:00100000:1.0:1746143132.497561:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6565 00000100:00100000:1.0:1746143132.497565:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858656640:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.497573:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746143132.497575:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009314d880 x1830962858657024/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.497581:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314d880 with x1830962858657024 ext(0->1048575) 00002000:00010000:0.0:1746143132.497585:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314d880 00010000:00010000:1.0:1746143132.497587:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 6 pid: 8169 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.497595:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 6 pid: 8169 timeout: 1014 lvb_type: 1 00000100:00100000:0.0:1746143132.497598:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858657280 00000100:00100000:0.0:1746143132.497600:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858657280 00002000:00100000:0.0:1746143132.497608:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009314ed80 x1830962858657280/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143132.497612:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093cedc00/0x25aee876ca70d24b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650236 expref: 6 pid: 8169 timeout: 1014 lvb_type: 1 00002000:00100000:0.0:1746143132.497614:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314ed80 with x1830962858657280 ext(1048576->2097151) 00002000:00010000:0.0:1746143132.497617:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314ed80 00010000:00010000:1.0:1746143132.497626:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143132.497630:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6021 00000100:00100000:0.0:1746143132.497635:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858657024:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143132.497655:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858656640:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.497661:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6565 00000100:00100000:1.0:1746143132.497675:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6566 00000100:00100000:1.0:1746143132.497679:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858657408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.497685:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.497692:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 16 pid: 10061 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.497700:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 16 pid: 10061 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.497712:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79a400/0x25aee876ca70d1c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501db expref: 16 pid: 10061 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.497719:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.497733:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1971:x1830962858657408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 54us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.497738:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6566 00000100:00100000:1.0:1746143132.497773:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6022 00000100:00100000:1.0:1746143132.497777:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858657280:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143132.501826:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858656768:12345-192.168.201.28@tcp:3:cat.0 Request processed in 4599us (4808us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143132.501837:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6020 00002000:00100000:3.0:1746143132.501849:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3870720->3874815) req@ffff88009314f480 x1830962858656768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.501858:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314f480 with x1830962858656768 ext(3870720->3874815) 00002000:00010000:3.0:1746143132.501863:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314f480 00000100:00100000:2.0:1746143132.504204:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861259008:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.504248:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->2277375] (req 2097152->2277375) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.504264:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81dc00, rc 0) 00000100:00100000:2.0:1746143132.504317:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30958:x1830962858656384:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 29531us (29633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.504326:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12422 00000100:00100000:0.0:1746143132.504641:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.504697:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858657536 00000100:00100000:2.0:1746143132.504703:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858657536 00000100:00100000:2.0:1746143132.504731:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12423 00000100:00100000:2.0:1746143132.504738:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30959:x1830962858657536:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143132.504752:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.504764:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650308 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.504779:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.504784:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->2277375] (req 2097152->2277375) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 11 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.504794:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143132.504797:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 11 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.504818:0:10061:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->2277375] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 11 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.504826:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 11 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.504833:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81ca00, rc 0) 00000100:00100000:2.0:1746143132.504851:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30959:x1830962858657536:12345-192.168.201.28@tcp:101:cat.0 Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.504856:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12423 00000100:00100000:0.0:1746143132.512565:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.512639:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858657664 00000100:00100000:2.0:1746143132.512648:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858657664 00010000:00010000:2.0:1746143132.512676:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.512704:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6567 00000100:00100000:2.0:1746143132.512711:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858657664:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.512722:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.512742:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.512760:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.512780:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79ae00/0x25aee876ca70d14f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501aa expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.512799:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.512801:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.512808:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.512816:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.512848:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.512858:0:7111:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.512870:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861259264:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143132.513331:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d4259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.514285:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858657024:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16646us (16785us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143132.514295:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6021 00002000:00100000:0.0:1746143132.514304:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009314d880 x1830962858657024/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.514312:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314d880 with x1830962858657024 ext(0->1048575) 00002000:00010000:0.0:1746143132.514316:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314d880 00000100:00100000:2.0:1746143132.515160:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861259264:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143132.515176:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.515210:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858657664:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2499us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.515219:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6567 00000100:00100000:1.0:1746143132.515776:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858657280:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17996us (18263us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143132.515783:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6022 00002000:00100000:1.0:1746143132.515788:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009314ed80 x1830962858657280/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.515800:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314ed80 with x1830962858657280 ext(1048576->2097151) 00002000:00010000:1.0:1746143132.515804:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009314ed80 00000100:00100000:0.0:1746143132.516951:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.516997:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858657920 00000100:00100000:1.0:1746143132.517003:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858657920 00002000:00100000:1.0:1746143132.517052:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2273280->2277375) req@ffff88009314ca80 x1830962858657920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.517060:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314ca80 with x1830962858657920 ext(2273280->2277375) 00010000:00010000:1.0:1746143132.517068:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.517080:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:1.0:1746143132.517087:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314ca80 00000100:00100000:1.0:1746143132.517100:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1980 00000100:00100000:1.0:1746143132.517107:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858657920:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143132.517228:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858657920:12345-192.168.201.28@tcp:3:cat.0 Request processed in 122us (277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143132.517247:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1980 00002000:00100000:1.0:1746143132.517252:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2273280->2277375) req@ffff88009314ca80 x1830962858657920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.517259:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314ca80 with x1830962858657920 ext(2273280->2277375) 00010000:00010000:1.0:1746143132.517264:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.517279:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:1.0:1746143132.517285:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314ca80 00010000:00010000:1.0:1746143132.525007:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143132.528170:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.528287:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.528565:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858658432 00000100:00100000:2.0:1746143132.528574:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858658432 00000100:00100000:2.0:1746143132.528631:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3452 00000100:00100000:2.0:1746143132.528639:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:30958:x1830962858658432:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143132.529025:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:30958:x1830962858658432:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 386us (862us total) trans 8589942381 rc 0/0 00000100:00100000:2.0:1746143132.529059:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3452 00000100:00100000:1.0:1746143132.529183:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858658176 00000100:00100000:1.0:1746143132.529187:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858658176 00002000:00100000:1.0:1746143132.529214:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2277375) req@ffff88009314c000 x1830962858658176/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.529222:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c000 with x1830962858658176 ext(2097152->2277375) 00010000:00010000:1.0:1746143132.529230:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.529258:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 10 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:1.0:1746143132.529265:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314c000 00000100:00100000:1.0:1746143132.529281:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1981 00000100:00100000:1.0:1746143132.529287:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858658176:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143132.530731:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.530807:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858658560 00000100:00100000:2.0:1746143132.530812:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858658560 00000100:00100000:2.0:1746143132.530850:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12424 00000100:00100000:2.0:1746143132.530856:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:30962:x1830962858658560:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143132.530877:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.530890:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165030f expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.530911:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 11 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.530918:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143132.530920:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143132.530923:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.530948:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 11 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.530963:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 11 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.530980:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861259392:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.531705:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d4259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.538156:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.538264:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861259392:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.538291:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.538307:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81da00, rc 0) 00000100:00100000:3.0:1746143132.538345:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:30962:x1830962858658560:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7488us (7617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.538354:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12424 00000100:00100000:0.0:1746143132.538847:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858658688 00000100:00100000:1.0:1746143132.538970:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858658176:12345-192.168.201.28@tcp:4:cat.0 Request processed in 9681us (10680us total) trans 21474840043 rc 0/0 00000100:00100000:1.0:1746143132.538978:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1981 00002000:00100000:1.0:1746143132.538987:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->2277375) req@ffff88009314c000 x1830962858658176/t21474840043(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/448 e 0 to 0 dl 1746143143 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.539003:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c000 with x1830962858658176 ext(2097152->2277375) 00010000:00010000:1.0:1746143132.539011:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 12 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.539022:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 12 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:1.0:1746143132.539046:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314c000 00000100:00100000:0.0:1746143132.539141:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858658688 00002000:00100000:0.0:1746143132.539202:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fe:0x0] (1916928->2097151) req@ffff880094e97100 x1830962858658688/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.539211:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97100 with x1830962858658688 ext(1916928->2097151) 00010000:00010000:0.0:1746143132.539221:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 12 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.539229:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 12 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:0.0:1746143132.539249:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e97100 00000100:00100000:0.0:1746143132.539276:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1982 00000100:00100000:0.0:1746143132.539283:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858658688:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143132.542789:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.544738:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858658816 00000100:00100000:3.0:1746143132.544747:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858658816 00010000:00010000:3.0:1746143132.544779:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 16 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.544807:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6568 00000100:00100000:3.0:1746143132.544814:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858658816:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.544826:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143132.544832:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858658688:12345-192.168.201.28@tcp:4:cat.0 Request processed in 5549us (6682us total) trans 21474840044 rc 0/0 00002000:00010000:3.0:1746143132.544837:0:7111:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143130 -> 1746143131 00002000:00010000:3.0:1746143132.544840:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143130 -> 1746143131 00000100:00100000:1.0:1746143132.544840:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1982 00010000:00010000:3.0:1746143132.544844:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 15 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00100000:1.0:1746143132.544848:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fe:0x0] (1916928->2097151) req@ffff880094e97100 x1830962858658688/t21474840044(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/448 e 0 to 0 dl 1746143143 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.545068:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97100 with x1830962858658688 ext(1916928->2097151) 00010000:00010000:1.0:1746143132.545075:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 15 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.545085:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 15 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:1.0:1746143132.545091:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e97100 00010000:00010000:3.0:1746143132.545177:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 14 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.545196:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81dc00/0x25aee876ca70d3c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2277375) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650301 expref: 14 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.545211:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.545213:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.545219:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.545226:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.545271:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.545282:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861259520:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143132.545338:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143132.549546:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861259520:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143132.549561:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.549600:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858658816:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4786us (6817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.549614:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6568 00000100:00100000:0.0:1746143132.555222:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.555329:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.555363:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858659072 00000100:00100000:3.0:1746143132.555371:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858659072 00010000:00010000:3.0:1746143132.555404:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.555406:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858659200 00000100:00100000:1.0:1746143132.555410:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858659200 00002000:00100000:1.0:1746143132.555438:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009a709180 x1830962858659200/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143132.555440:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6569 00000100:00100000:3.0:1746143132.555446:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858659072:12345-192.168.201.28@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746143132.555452:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a709180 with x1830962858659200 ext(2097152->3145727) 00010000:00010000:3.0:1746143132.555456:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143132.555456:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a709180 00000100:00100000:1.0:1746143132.555469:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6023 00010000:00010000:3.0:1746143132.555474:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 14 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.555474:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858659200:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:3.0:1746143132.555485:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 14 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.555507:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093245800/0x25aee876ca70d37f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d7 expref: 14 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.555593:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.555660:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.555666:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.555674:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.555702:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 14 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.555714:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861259648:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143132.556073:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143132.561686:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861259648:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143132.561707:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.561742:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858659072:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6295us (6528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.561751:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6569 00000100:00100000:0.0:1746143132.564876:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.564902:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858659456 00000100:00100000:2.0:1746143132.564910:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858659456 00002000:00100000:2.0:1746143132.564946:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009a70b100 x1830962858659456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.564954:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70b100 with x1830962858659456 ext(1048576->2097151) 00002000:00010000:2.0:1746143132.564958:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a70b100 00000100:00100000:2.0:1746143132.564977:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6024 00000100:00100000:2.0:1746143132.564983:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858659456:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143132.567066:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858659200:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11586us (11732us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143132.567075:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6023 00002000:00100000:1.0:1746143132.567082:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009a709180 x1830962858659200/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.567088:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a709180 with x1830962858659200 ext(2097152->3145727) 00002000:00010000:1.0:1746143132.567093:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a709180 00000100:00100000:2.0:1746143132.576395:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858659456:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11401us (11515us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.576405:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6024 00002000:00100000:2.0:1746143132.576416:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009a70b100 x1830962858659456/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.576424:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70b100 with x1830962858659456 ext(1048576->2097151) 00002000:00010000:2.0:1746143132.576430:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a70b100 00000100:00100000:0.0:1746143132.577226:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.577309:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858659584 00000100:00100000:2.0:1746143132.577316:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858659584 00000100:00100000:2.0:1746143132.577493:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12425 00000100:00100000:2.0:1746143132.577501:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30959:x1830962858659584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143132.577516:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.577531:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650316 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.577558:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.577566:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143132.577568:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143132.577571:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.577601:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.577715:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 20 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.577730:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861259776:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.578078:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.579557:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861259776:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143132.579576:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.579587:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f22000, rc 0) 00000100:00100000:2.0:1746143132.579626:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30959:x1830962858659584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2125us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.579632:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12425 00000100:00100000:0.0:1746143132.582684:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.582779:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858659712 00000100:00100000:2.0:1746143132.582786:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858659712 00002000:00100000:2.0:1746143132.582823:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3203072->3874815) req@ffff88009a70bb80 x1830962858659712/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.582831:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70bb80 with x1830962858659712 ext(3203072->3874815) 00010000:00010000:2.0:1746143132.582838:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 21 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.582850:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 21 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:2.0:1746143132.582857:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a70bb80 00000100:00100000:2.0:1746143132.582945:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1983 00000100:00100000:2.0:1746143132.582953:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858659712:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143132.588542:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.588755:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858659840 00000100:00100000:3.0:1746143132.588763:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858659840 00000100:00100000:0.0:1746143132.589069:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12426 00000100:00100000:0.0:1746143132.589080:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:30962:x1830962858659840:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143132.589097:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143132.589112:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165031d expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.589133:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143132.589135:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143132.589142:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.589156:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.589167:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050800, rc 0) 00000100:00100000:0.0:1746143132.589216:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30962:x1830962858659840:12345-192.168.201.28@tcp:101:cat.0 Request processed in 138us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.589222:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12426 00000100:00100000:0.0:1746143132.590201:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.590525:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858659968 00000100:00100000:3.0:1746143132.590529:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858659968 00000100:00100000:3.0:1746143132.590570:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8172 00000100:00100000:3.0:1746143132.590576:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:30965:x1830962858659968:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143132.590591:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.590603:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70d3e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650324 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.590648:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.590659:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.590668:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.590679:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.590685:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.590692:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.590787:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.590796:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 211 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.590803:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.590830:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 211 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.590840:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 211 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.590851:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861259904:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.591164:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.595372:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858659712:12345-192.168.201.28@tcp:4:cat.0 Request processed in 12413us (12686us total) trans 17179872781 rc 0/0 00000100:00100000:2.0:1746143132.595383:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1983 00002000:00100000:2.0:1746143132.595392:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3203072->3874815) req@ffff88009a70bb80 x1830962858659712/t17179872781(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/448 e 0 to 0 dl 1746143143 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.595402:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a70bb80 with x1830962858659712 ext(3203072->3874815) 00010000:00010000:2.0:1746143132.595411:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 23 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.595424:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 23 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:2.0:1746143132.595431:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a70bb80 00000100:00100000:2.0:1746143132.598247:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.598289:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861259904:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.598310:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143132.599294:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.599570:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858660480 00000100:00100000:3.0:1746143132.599576:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858660480 00002000:00100000:3.0:1746143132.599611:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094e97800 x1830962858660480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.599620:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97800 with x1830962858660480 ext(2097152->3145727) 00002000:00010000:3.0:1746143132.599624:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e97800 00000100:00100000:3.0:1746143132.599657:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6025 00000100:00100000:3.0:1746143132.599664:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858660480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143132.599805:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858660224 00000100:00100000:0.0:1746143132.599809:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858660224 00000100:00100000:0.0:1746143132.599832:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3453 00000100:00100000:0.0:1746143132.599837:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009386ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:26840:x1830962858660224:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143132.599997:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009386ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:26840:x1830962858660224:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 158us (1764us total) trans 8589942382 rc 0/0 00000100:00100000:0.0:1746143132.600004:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3453 00000100:00100000:0.0:1746143132.600143:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.600355:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858660608 00000100:00100000:3.0:1746143132.600359:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858660608 00010000:00010000:3.0:1746143132.600378:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 23 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.600407:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6570 00000100:00100000:3.0:1746143132.600413:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858660608:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.600425:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.600609:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 23 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.600619:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 23 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.600638:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093244600/0x25aee876ca70d3a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3203072->3874815) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502e5 expref: 23 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.601172:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.601175:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.601182:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 9 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.601190:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 9 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.601220:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 9 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.601242:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861260032:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143132.601520:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.601731:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.602149:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858660736 00000100:00100000:3.0:1746143132.602153:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858660736 00010000:00010000:3.0:1746143132.602169:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 213 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.602270:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6571 00000100:00100000:3.0:1746143132.602276:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:1968:x1830962858660736:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.602285:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.602290:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 213 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.602433:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 213 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.602449:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28c00/0x25aee876ca70d31d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502b4 expref: 213 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.602460:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.602465:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602473:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602478:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602494:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.602517:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:1968:x1830962858660736:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 241us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.602524:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6571 00010000:00010000:3.0:1746143132.602545:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602555:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143132.602582:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143132.602585:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143132.602597:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602605:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602612:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602618:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602623:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602628:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4aa9000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143132.602632:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602637:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602645:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143132.602647:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143132.602650:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602654:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70d3ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602664:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602669:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602674:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602678:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4aa8400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143132.602680:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602684:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602691:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531d00) 00010000:00010000:3.0:1746143132.602693:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143132.602696:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602700:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70d3f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.602729:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70d3e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.602739:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.602744:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.602747:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143132.602749:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57ec00, rc 0) 00000100:00100000:3.0:1746143132.602770:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30965:x1830962858659968:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 12194us (12571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.602777:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8172 00000100:00100000:3.0:1746143132.608792:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861260032:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143132.609005:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.609083:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858660608:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8668us (8937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.609092:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6570 00000100:00100000:0.0:1746143132.616725:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858660480:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17049us (17421us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143132.616742:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6025 00002000:00100000:0.0:1746143132.616755:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094e97800 x1830962858660480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.616765:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97800 with x1830962858660480 ext(2097152->3145727) 00002000:00010000:0.0:1746143132.616770:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e97800 00000100:00100000:1.0:1746143132.617098:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.617191:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.617753:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.618022:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858660864 00000100:00100000:3.0:1746143132.618104:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858660992 00000100:00100000:3.0:1746143132.618109:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858660992 00000100:00100000:0.0:1746143132.618188:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858660864 00000100:00100000:1.0:1746143132.618246:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858661120 00000100:00100000:1.0:1746143132.618249:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858661120 00000100:00100000:3.0:1746143132.618322:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12427 00000100:00100000:3.0:1746143132.618330:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858660992:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143132.618343:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.618358:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650332 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.618379:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.618381:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.618389:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.618604:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.618615:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57e400, rc 0) 00000100:00100000:0.0:1746143132.618828:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12428 00000100:00100000:0.0:1746143132.618835:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858660864:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143132.618842:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143132.618849:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165032b expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.618859:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143132.618860:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143132.618865:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143132.618874:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143132.618881:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132051200, rc 0) 00000100:00100000:1.0:1746143132.619316:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12429 00000100:00100000:1.0:1746143132.619323:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858661120:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143132.619330:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.619337:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650339 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.619347:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.619349:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.619354:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.619363:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.619370:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df5e00, rc 0) 00000100:00100000:3.0:1746143132.619817:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858660992:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1487us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.619823:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12427 00000100:00100000:0.0:1746143132.619909:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858660864:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1073us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.619914:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12428 00000100:00100000:1.0:1746143132.620201:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858661120:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 877us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.620206:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12429 00000100:00100000:1.0:1746143132.620261:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.620299:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.620327:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.620342:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858661504 00000100:00100000:1.0:1746143132.620347:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858661504 00002000:00100000:1.0:1746143132.620370:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094511180 x1830962858661504/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.620379:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511180 with x1830962858661504 ext(2097152->3145727) 00002000:00010000:1.0:1746143132.620384:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094511180 00000100:00100000:1.0:1746143132.620402:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858661760 00000100:00100000:1.0:1746143132.620404:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858661760 00002000:00100000:1.0:1746143132.620414:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094510700 x1830962858661760/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.620421:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510700 with x1830962858661760 ext(3145728->4194303) 00002000:00010000:1.0:1746143132.620423:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094510700 00000100:00100000:2.0:1746143132.620579:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.620919:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858662016 00000100:00100000:1.0:1746143132.620923:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858662016 00002000:00100000:1.0:1746143132.620939:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094e95180 x1830962858662016/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143132.620947:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95180 with x1830962858662016 ext(3145728->4194303) 00002000:00010000:1.0:1746143132.620950:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e95180 00000100:00100000:1.0:1746143132.620969:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6026 00000100:00100000:1.0:1746143132.620975:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858661504:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143132.622959:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6027 00000100:00100000:2.0:1746143132.622971:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858661760:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143132.623848:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.624270:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6028 00000100:00100000:0.0:1746143132.624280:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858662016:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143132.625189:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858661248 00000100:00100000:1.0:1746143132.625196:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858661248 00000100:00100000:1.0:1746143132.625221:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858662144 00000100:00100000:1.0:1746143132.625223:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858662144 00000100:00100000:1.0:1746143132.625250:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12430 00000100:00100000:1.0:1746143132.625256:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858661248:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143132.625266:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.625281:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650340 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.625297:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.625299:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.625306:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 8 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.625320:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 8 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.625330:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd0c00, rc 0) 00000100:00100000:1.0:1746143132.625367:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858661248:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 110us (5105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.625373:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12430 00000100:00100000:1.0:1746143132.625387:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12431 00000100:00100000:1.0:1746143132.625391:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30962:x1830962858662144:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143132.625398:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.625403:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650347 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.625414:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.625416:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.625419:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 23 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.625426:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 23 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.625433:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd0a00, rc 0) 00000100:00100000:1.0:1746143132.625446:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30962:x1830962858662144:12345-192.168.201.28@tcp:101:cat.0 Request processed in 55us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.625451:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12431 00000100:00100000:0.0:1746143132.631341:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.632524:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858662400 00000100:00100000:3.0:1746143132.632533:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858662400 00000100:00100000:3.0:1746143132.632583:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8173 00000100:00100000:3.0:1746143132.632591:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:30965:x1830962858662400:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143132.632608:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.632622:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409600/0x25aee876ca70d427 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165034e expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.632703:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.632715:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.632722:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.632751:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.632763:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 10 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.632775:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861260160:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.633167:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143132.638595:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.638635:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.638666:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.638690:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858662656 00000100:00100000:3.0:1746143132.638698:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858662656 00002000:00100000:3.0:1746143132.638736:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008eaac700 x1830962858662656/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.638747:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaac700 with x1830962858662656 ext(2097152->3145727) 00002000:00010000:3.0:1746143132.638752:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaac700 00000100:00100000:3.0:1746143132.639645:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858662912 00000100:00100000:3.0:1746143132.639649:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858662912 00002000:00100000:3.0:1746143132.639665:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eaadf80 x1830962858662912/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.639675:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaadf80 with x1830962858662912 ext(3145728->4194303) 00002000:00010000:3.0:1746143132.639678:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaadf80 00000100:00100000:0.0:1746143132.639737:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858663168 00000100:00100000:0.0:1746143132.639741:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858663168 00000100:00100000:2.0:1746143132.639745:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6029 00000100:00100000:2.0:1746143132.639753:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858662656:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:0.0:1746143132.639758:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008eaae680 x1830962858663168/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.639764:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaae680 with x1830962858663168 ext(3145728->4194303) 00002000:00010000:0.0:1746143132.639767:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaae680 00000100:00100000:0.0:1746143132.639786:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6030 00000100:00100000:0.0:1746143132.639791:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858662912:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143132.639792:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6031 00000100:00100000:2.0:1746143132.639796:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858663168:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143132.642880:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861260160:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.642902:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143132.643355:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.643985:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858663296 00000100:00100000:3.0:1746143132.643992:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858663296 00010000:00010000:3.0:1746143132.644017:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 11 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.644269:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6572 00000100:00100000:3.0:1746143132.644278:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858663296:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.644289:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.644295:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 11 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.644307:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 11 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.644326:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e57ec00/0x25aee876ca70d3fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650324 expref: 11 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143132.644348:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.644353:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.644362:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.644367:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.644380:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.644413:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858663296:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.644419:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6572 00010000:00010000:3.0:1746143132.644439:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.644444:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143132.644460:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143132.644566:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409600/0x25aee876ca70d427 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.644583:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.644589:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.644591:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143132.644593:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d408600, rc 0) 00000100:00100000:3.0:1746143132.644613:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30965:x1830962858662400:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 12023us (13281us total) trans 8589942383 rc 0/0 00000100:00100000:3.0:1746143132.644619:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8173 00000100:00100000:0.0:1746143132.645506:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858662016:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21226us (24924us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143132.645514:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6028 00002000:00100000:0.0:1746143132.645522:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094e95180 x1830962858662016/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.645531:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95180 with x1830962858662016 ext(3145728->4194303) 00002000:00010000:0.0:1746143132.645535:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e95180 00000100:00100000:3.0:1746143132.656816:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858661760:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33840us (36479us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143132.656828:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6027 00002000:00100000:3.0:1746143132.656840:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094510700 x1830962858661760/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.656849:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510700 with x1830962858661760 ext(3145728->4194303) 00002000:00010000:3.0:1746143132.656855:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094510700 00000100:00100000:2.0:1746143132.664133:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858661504:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43149us (43824us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.664145:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6026 00002000:00100000:2.0:1746143132.664156:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094511180 x1830962858661504/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.664166:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511180 with x1830962858661504 ext(2097152->3145727) 00002000:00010000:2.0:1746143132.664171:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094511180 00000100:00100000:0.0:1746143132.668988:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.669142:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858663552 00000100:00100000:3.0:1746143132.669151:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858663552 00000100:00100000:3.0:1746143132.669199:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8174 00000100:00100000:3.0:1746143132.669207:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:30967:x1830962858663552:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143132.669242:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.669259:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5a00/0x25aee876ca70d43c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650355 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.669352:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669366:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669375:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669387:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669392:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669397:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669489:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4c00/0x25aee876ca70d451 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669497:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4c00/0x25aee876ca70d451 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669503:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4c00/0x25aee876ca70d451 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143132.669510:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143132.669584:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669590:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669595:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669604:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012caa5c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143132.669607:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669612:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669621:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143132.669623:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143132.669627:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669631:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5c00/0x25aee876ca70d443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669644:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669649:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669653:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669657:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012caa5200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143132.669660:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669664:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669669:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531b00) 00010000:00010000:3.0:1746143132.669671:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143132.669674:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669678:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5200/0x25aee876ca70d44a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.669709:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5a00/0x25aee876ca70d43c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650355 expref: 215 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.669720:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4c00/0x25aee876ca70d451 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650355 expref: 214 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.669726:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.669728:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143132.669730:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa4c00, rc 0) 00000100:00100000:3.0:1746143132.669771:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:30967:x1830962858663552:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 564us (791us total) trans 8589942384 rc 0/0 00000100:00100000:3.0:1746143132.669777:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8174 00000100:00100000:0.0:1746143132.670564:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858662912:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30771us (31926us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143132.670571:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6030 00002000:00100000:0.0:1746143132.670578:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eaadf80 x1830962858662912/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.670588:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaadf80 with x1830962858662912 ext(3145728->4194303) 00002000:00010000:0.0:1746143132.670592:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaadf80 00000100:00100000:2.0:1746143132.678845:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858663168:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39040us (40170us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.678858:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6031 00002000:00100000:2.0:1746143132.678868:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008eaae680 x1830962858663168/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.678877:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaae680 with x1830962858663168 ext(3145728->4194303) 00002000:00010000:2.0:1746143132.678881:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaae680 00000100:00100000:0.0:1746143132.684695:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.684747:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.684765:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858663680 00000100:00100000:1.0:1746143132.684773:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858663680 00000100:00100000:1.0:1746143132.684817:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858663936 00000100:00100000:1.0:1746143132.684820:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858663936 00000100:00100000:3.0:1746143132.684824:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8175 00000100:00100000:3.0:1746143132.684835:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30965:x1830962858663680:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:1.0:1746143132.684843:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8176 00000100:00100000:1.0:1746143132.684848:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:30969:x1830962858663936:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143132.684858:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.684860:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.684873:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650363 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.684874:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d45f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165035c expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.684934:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.684956:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.684964:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143132.684968:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.684972:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.684982:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.684993:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143132.684996:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.684999:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685004:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143132.685006:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 11 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.685018:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861260288:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143132.685260:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5800/0x25aee876ca70d482 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685269:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5800/0x25aee876ca70d482 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685275:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5800/0x25aee876ca70d482 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:1.0:1746143132.685282:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143132.685355:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685364:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685369:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685374:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009acd1200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143132.685377:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685383:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685392:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143132.685395:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143132.685398:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685403:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685417:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685422:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685426:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685430:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009acd0e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143132.685432:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685440:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685446:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e924100) 00010000:00010000:1.0:1746143132.685448:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143132.685450:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685455:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0e00/0x25aee876ca70d47b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.685487:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650363 expref: 24 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.685498:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5800/0x25aee876ca70d482 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650363 expref: 23 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.685503:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.685505:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143132.685507:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.685512:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.685517:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df5800, rc 0) 00000100:00100000:1.0:1746143132.685547:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:30969:x1830962858663936:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 698us (805us total) trans 8589942385 rc 0/0 00000100:00100000:1.0:1746143132.685554:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8176 00000100:00100000:3.0:1746143132.685894:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.687318:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.687599:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858664064 00000100:00100000:1.0:1746143132.687606:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858664064 00000100:00100000:1.0:1746143132.687807:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12432 00000100:00100000:1.0:1746143132.687815:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858664064:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143132.687827:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.687840:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165036a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.687860:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.687862:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.687869:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.687880:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.687889:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df4000, rc 0) 00000100:00100000:2.0:1746143132.690321:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858662656:12345-192.168.201.28@tcp:3:cat.0 Request processed in 50560us (51725us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.690333:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6029 00002000:00100000:2.0:1746143132.690343:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008eaac700 x1830962858662656/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.690352:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaac700 with x1830962858662656 ext(2097152->3145727) 00002000:00010000:2.0:1746143132.690357:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaac700 00000100:00100000:1.0:1746143132.690591:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858664064:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2775us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.690598:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12432 00000100:00100000:0.0:1746143132.691103:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.691168:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.691194:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.691256:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858664320 00000100:00100000:1.0:1746143132.691262:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858664320 00010000:00010000:1.0:1746143132.691286:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 12 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.691303:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858664192 00000100:00100000:1.0:1746143132.691305:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858664192 00000100:00100000:1.0:1746143132.691318:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858664448 00000100:00100000:1.0:1746143132.691320:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858664448 00000100:00100000:1.0:1746143132.691332:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6573 00000100:00100000:1.0:1746143132.691338:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858664320:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.691348:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.691352:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 12 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.691363:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 12 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.691381:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.691385:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.691394:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.691400:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.691414:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.691444:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858664320:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 105us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.691449:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6573 00000100:00100000:1.0:1746143132.691483:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 613 00000100:00100000:1.0:1746143132.691487:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:1969:x1830962858664192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.691494:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.691502:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4c00/0x25aee876ca70d451 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650355 expref: 214 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.691513:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.691516:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.691528:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:1969:x1830962858664192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 41us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.691533:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 613 00000100:00100000:1.0:1746143132.691541:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 614 00000100:00100000:1.0:1746143132.691545:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858664448:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.691550:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.691558:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5800/0x25aee876ca70d482 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650363 expref: 23 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.691565:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.691568:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.691580:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858664448:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 34us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.691584:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 614 00010000:00010000:3.0:1746143132.691774:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408600/0x25aee876ca70d42e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165034e expref: 11 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.691797:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861260288:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.691813:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.691819:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.691824:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143132.691857:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143132.691861:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143132.691874:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143132.691902:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d45f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.691914:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.691919:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143132.691921:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143132.691923:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa4400, rc 0) 00000100:00100000:3.0:1746143132.691947:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30965:x1830962858663680:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7116us (7260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.691952:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8175 00000100:00100000:2.0:1746143132.709737:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.710746:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.710955:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858664960 00000100:00100000:3.0:1746143132.710964:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858664960 00002000:00100000:3.0:1746143132.711004:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094e96a00 x1830962858664960/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.711014:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e96a00 with x1830962858664960 ext(4194304->5210111) 00002000:00010000:3.0:1746143132.711019:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e96a00 00000100:00100000:3.0:1746143132.711061:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6032 00000100:00100000:3.0:1746143132.711069:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858664960:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143132.711125:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858664704 00000100:00100000:0.0:1746143132.711130:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858664704 00000100:00100000:0.0:1746143132.711158:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8177 00000100:00100000:0.0:1746143132.711164:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30965:x1830962858664704:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143132.711175:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143132.711191:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132051400/0x25aee876ca70d497 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650371 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.711274:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711287:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711296:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711306:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711311:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711320:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711325:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132051a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143132.711328:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711333:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711340:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143132.711343:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143132.711346:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711350:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132051a00/0x25aee876ca70d49e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.711374:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051400/0x25aee876ca70d497 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650371 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.711381:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132051400/0x25aee876ca70d497 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650371 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.711387:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132051400, rc 0) 00000100:00100000:0.0:1746143132.711423:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30965:x1830962858664704:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 260us (678us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143132.711429:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8177 00000100:00100000:0.0:1746143132.713447:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.713471:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858665216 00000100:00100000:0.0:1746143132.713477:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858665216 00002000:00100000:0.0:1746143132.713501:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009314c700 x1830962858665216/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143132.713509:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c700 with x1830962858665216 ext(4194304->5210111) 00002000:00010000:0.0:1746143132.713513:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314c700 00000100:00100000:0.0:1746143132.713530:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6033 00000100:00100000:0.0:1746143132.713535:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858665216:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143132.716609:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.716685:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858665472 00000100:00100000:2.0:1746143132.716692:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858665472 00000100:00100000:2.0:1746143132.716726:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3454 00000100:00100000:2.0:1746143132.716733:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:30965:x1830962858665472:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:2.0:1746143132.716921:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30965:x1830962858665472:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 186us (318us total) trans 8589942386 rc 0/0 00000100:00100000:2.0:1746143132.716927:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3454 00000100:00100000:2.0:1746143132.741102:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858665216:12345-192.168.201.28@tcp:3:cat.0 Request processed in 27555us (27647us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143132.741114:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6033 00002000:00100000:2.0:1746143132.741128:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009314c700 x1830962858665216/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.741137:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314c700 with x1830962858665216 ext(4194304->5210111) 00002000:00010000:2.0:1746143132.741142:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314c700 00000100:00100000:3.0:1746143132.744654:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858664960:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33576us (34914us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143132.744664:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6032 00002000:00100000:3.0:1746143132.744674:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094e96a00 x1830962858664960/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.744690:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e96a00 with x1830962858664960 ext(4194304->5210111) 00002000:00010000:3.0:1746143132.744696:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e96a00 00000100:00100000:0.0:1746143132.809640:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.809716:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858665600 00000100:00100000:3.0:1746143132.809725:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858665600 00000100:00100000:3.0:1746143132.810072:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12433 00000100:00100000:3.0:1746143132.810081:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:30967:x1830962858665600:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143132.810097:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.810112:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650378 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.810138:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 12 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.810146:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.810153:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 17 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.810158:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.810160:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.810163:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 17 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.810191:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 17 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.810206:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 17 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.810218:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861260416:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.810323:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.811454:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 7 pid: 4758 timeout: 1014 lvb_type: 1 00000100:00100000:3.0:1746143132.811465:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861260544:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.811974:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 12 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.811984:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 12 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.811992:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861260672:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.812344:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143132.815784:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861260416:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143132.826280:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.826327:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.826327:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858665728 00000100:00100000:0.0:1746143132.826336:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858665728 00000100:00100000:1.0:1746143132.826351:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858665856 00000100:00100000:1.0:1746143132.826354:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858665856 00010000:00010000:1.0:1746143132.826376:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 8 pid: 4758 timeout: 1014 lvb_type: 1 00010000:00010000:0.0:1746143132.826376:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 18 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.826475:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861260544:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.826485:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861260672:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.826512:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 18 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.826527:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa4000, rc 0) 00000100:00100000:1.0:1746143132.826670:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6574 00000100:00100000:0.0:1746143132.826675:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6575 00000100:00100000:1.0:1746143132.826678:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858665856:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143132.826680:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858665728:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.826690:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143132.826690:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.826711:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 8 pid: 4758 timeout: 1014 lvb_type: 1 00010000:00010000:0.0:1746143132.826711:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 18 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.826720:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 8 pid: 4758 timeout: 1014 lvb_type: 1 00010000:00010000:0.0:1746143132.826727:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 18 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.826753:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30967:x1830962858665600:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 16673us (17121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.826759:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12433 00010000:00010000:1.0:1746143132.827007:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d412 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650339 expref: 8 pid: 4758 timeout: 1014 lvb_type: 1 00010000:00010000:0.0:1746143132.827010:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132050800/0x25aee876ca70d3e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165031d expref: 17 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.827022:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143132.827022:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.827053:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858665856:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 376us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.827053:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858665728:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 373us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.827058:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6574 00000100:00100000:0.0:1746143132.827061:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6575 00000100:00100000:2.0:1746143132.833511:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.834173:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858665984 00000100:00100000:1.0:1746143132.834185:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858665984 00010000:00010000:1.0:1746143132.834223:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.834262:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6576 00000100:00100000:1.0:1746143132.834268:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858665984:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.834284:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.834307:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.834319:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.834345:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70d3cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650308 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.834372:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.834374:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.834381:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.834389:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.834418:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.834429:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861260800:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143132.834511:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.849247:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.849296:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.849321:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858666368 00000100:00100000:0.0:1746143132.849329:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858666368 00000100:00100000:0.0:1746143132.849373:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8178 00000100:00100000:0.0:1746143132.849381:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30973:x1830962858666368:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143132.849402:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143132.849417:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70d4ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165037f expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.849457:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858666240 00010000:00010000:0.0:1746143132.849466:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00000100:00100000:3.0:1746143132.849468:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858666240 00010000:00010000:0.0:1746143132.849478:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849488:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849500:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849506:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849512:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00002000:00100000:3.0:1746143132.849515:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3710976->3715071) req@ffff88008eb21880 x1830962858666240/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.849527:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21880 with x1830962858666240 ext(3710976->3715071) 00002000:00010000:3.0:1746143132.849533:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21880 00000100:00100000:3.0:1746143132.849574:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6034 00000100:00100000:3.0:1746143132.849583:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858666240:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:0.0:1746143132.849615:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d4c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849625:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849632:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:0.0:1746143132.849656:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143132.849659:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143132.849670:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849678:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849684:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849689:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849696:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849701:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132050c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143132.849704:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849710:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849718:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143132.849721:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143132.849723:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849729:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132050c00/0x25aee876ca70d4b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849744:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849750:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849755:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849759:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132050800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143132.849761:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849766:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143132.849772:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449e00) 00010000:00010000:0.0:1746143132.849774:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143132.849776:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00000100:00100000:3.0:1746143132.849777:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858666240:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 195us (537us total) trans 0 rc 4096/4096 00010000:00010000:0.0:1746143132.849781:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132050800/0x25aee876ca70d4ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00000100:00100000:3.0:1746143132.849784:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6034 00002000:00100000:3.0:1746143132.849790:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3710976->3715071) req@ffff88008eb21880 x1830962858666240/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.849799:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21880 with x1830962858666240 ext(3710976->3715071) 00002000:00010000:3.0:1746143132.849802:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21880 00010000:00010000:0.0:1746143132.849806:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70d4ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165037f expref: 13 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.849817:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165037f expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.849828:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143132.849830:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143132.849832:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132051c00, rc 0) 00000100:00100000:0.0:1746143132.849865:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30973:x1830962858666368:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 485us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.849872:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8178 00000100:00100000:1.0:1746143132.850242:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861260800:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143132.850258:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.850301:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858665984:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 16032us (16802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.850309:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6576 00000100:00100000:0.0:1746143132.854363:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.854466:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.857347:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858666496 00000100:00100000:3.0:1746143132.857357:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858666496 00000100:00100000:3.0:1746143132.857409:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12434 00000100:00100000:3.0:1746143132.857418:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858666496:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143132.857435:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.857450:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa5600/0x25aee876ca70d4c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650386 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.857499:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861260928:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143132.857585:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.858340:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858666624 00000100:00100000:1.0:1746143132.858345:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858666624 00000100:00100000:1.0:1746143132.858374:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 615 00000100:00100000:1.0:1746143132.858379:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858666624:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.858388:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.858405:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d4c1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165037f expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.858429:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.858433:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.858465:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858666624:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 85us (3999us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.858471:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 615 00002000:00010000:3.0:1746143132.861828:0:22204:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143130 -> 1746143131 00000100:00100000:3.0:1746143132.861851:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861260928:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143132.861874:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa5600/0x25aee876ca70d4c8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650386 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.861887:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa5600/0x25aee876ca70d4c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650386 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.861908:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa5600, rc 0) 00000100:00100000:3.0:1746143132.861938:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858666496:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4522us (7721us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143132.861945:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12434 00000100:00100000:0.0:1746143132.865350:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.865390:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.865654:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858667008 00000100:00100000:1.0:1746143132.865663:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858667008 00000100:00100000:1.0:1746143132.865700:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8179 00000100:00100000:1.0:1746143132.865706:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:30973:x1830962858667008:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143132.865723:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.865739:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d4cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650394 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.866004:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.866018:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.866025:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.866068:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.866084:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 12 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.866096:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861261056:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143132.866157:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143132.866538:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858666752 00000100:00100000:3.0:1746143132.866543:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858666752 00000100:00100000:3.0:1746143132.866779:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12435 00000100:00100000:3.0:1746143132.866786:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30967:x1830962858666752:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143132.866794:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.866804:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165038d expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.866823:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 9 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.866831:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 24 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.866838:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 7 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.866844:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.866846:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143132.866849:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 6/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->3350527] (req 3145728->3350527) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.866865:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 7 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.866874:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 7 pid: 10061 timeout: 1014 lvb_type: 1 00000100:00100000:3.0:1746143132.866883:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861261184:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.867822:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 24 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.867832:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 24 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.867841:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861261312:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143132.868842:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 9 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.868851:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 9 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.868860:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861261440:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.868881:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.869066:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.869240:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858667136 00000100:00100000:0.0:1746143132.869245:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858667136 00010000:00010000:0.0:1746143132.869267:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 13 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.869285:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6577 00000100:00100000:0.0:1746143132.869290:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858667136:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143132.869299:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143132.869304:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 13 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.869313:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 13 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:0.0:1746143132.869331:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143132.869335:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143132.869344:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143132.869349:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143132.869362:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143132.869381:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858667136:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 90us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.869387:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6577 00000100:00100000:0.0:1746143132.869444:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.869458:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858667264 00000100:00100000:0.0:1746143132.869461:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858667264 00010000:00010000:1.0:1746143132.870116:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caa4400/0x25aee876ca70d46d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165035c expref: 12 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.870136:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861261056:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143132.870150:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.870156:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.870161:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:1.0:1746143132.870175:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143132.870311:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d4cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.870322:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.870328:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.870331:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143132.870333:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df5e00, rc 0) 00000100:00100000:1.0:1746143132.870358:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30973:x1830962858667008:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4652us (4967us total) trans 8589942387 rc 0/0 00000100:00100000:1.0:1746143132.870364:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8179 00000100:00100000:0.0:1746143132.871625:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12436 00000100:00100000:0.0:1746143132.871635:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30969:x1830962858667264:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143132.871646:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143132.871655:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165039b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.871672:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.871679:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143132.871686:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.871696:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143132.871698:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143132.871701:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1466368->2097151] (req 1466368->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.871722:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.871731:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.871741:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861261568:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143132.871787:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143132.871796:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 7 pid: 8449 timeout: 1014 lvb_type: 1 00000100:00100000:0.0:1746143132.871804:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861261696:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143132.871829:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.871838:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 24 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:0.0:1746143132.871851:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861261824:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143132.871868:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.872165:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.872260:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861261184:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143132.872269:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861261312:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143132.872574:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858667392 00000100:00100000:1.0:1746143132.872580:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858667392 00010000:00010000:1.0:1746143132.872599:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 8 pid: 10061 timeout: 1014 lvb_type: 1 00000100:00100000:1.0:1746143132.872626:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6578 00000100:00100000:1.0:1746143132.872631:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858667392:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.872639:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.872655:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 8 pid: 10061 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.872663:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 8 pid: 10061 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.872676:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009acd0c00/0x25aee876ca70d419 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650340 expref: 8 pid: 10061 timeout: 1014 lvb_type: 1 00010000:00010000:1.0:1746143132.872686:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.872705:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858667392:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 73us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.872711:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6578 00000100:00100000:1.0:1746143132.877495:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861261568:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143132.877528:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861261696:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143132.877547:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861261824:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143132.877582:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1466368->2097151] (req 1466368->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.877598:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132051a00, rc 0) 00000100:00100000:1.0:1746143132.877646:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30969:x1830962858667264:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6013us (8200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.877654:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12436 00000100:00100000:0.0:1746143132.877721:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861261440:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143132.877745:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->3350527] (req 3145728->3350527) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143132.877755:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa4c00, rc 0) 00000100:00100000:0.0:1746143132.877773:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30967:x1830962858666752:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10988us (12430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143132.877779:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12435 00000100:00100000:3.0:1746143132.878096:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.878208:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858667520 00000100:00100000:1.0:1746143132.878214:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858667520 00000100:00100000:1.0:1746143132.878261:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8180 00000100:00100000:1.0:1746143132.878268:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30973:x1830962858667520:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143132.878285:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.878298:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d4f2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503a2 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.878358:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.878371:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.878378:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.878402:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.878417:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 13 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.878434:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861261952:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143132.878490:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.880148:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.880248:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858667776 00000100:00100000:2.0:1746143132.880256:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858667776 00010000:00010000:2.0:1746143132.880289:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 7 pid: 8449 timeout: 1014 lvb_type: 1 00000100:00100000:2.0:1746143132.880327:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6579 00000100:00100000:2.0:1746143132.880335:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858667776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.880350:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.880373:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 7 pid: 8449 timeout: 1014 lvb_type: 1 00010000:00010000:2.0:1746143132.880384:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 7 pid: 8449 timeout: 1014 lvb_type: 1 00010000:00010000:2.0:1746143132.880411:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3dea00/0x25aee876ca70d236 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650221 expref: 7 pid: 8449 timeout: 1014 lvb_type: 1 00010000:00010000:2.0:1746143132.880445:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.880492:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858667776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 157us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.880503:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6579 00000100:00100000:1.0:1746143132.883262:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861261952:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143132.883283:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143132.884829:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.885136:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858667648 00000100:00100000:1.0:1746143132.885145:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858667648 00010000:00010000:1.0:1746143132.885178:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.885222:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6580 00000100:00100000:1.0:1746143132.885241:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858667648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.885253:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143132.885273:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.885283:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.885304:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d74c00/0x25aee876ca70d1fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650205 expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.885340:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.885598:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858667648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 358us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.885605:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6580 00000100:00100000:0.0:1746143132.885970:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.886006:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.886866:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858667904 00000100:00100000:2.0:1746143132.886872:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858667904 00010000:00010000:2.0:1746143132.886890:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 24 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.886922:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858668032 00000100:00100000:2.0:1746143132.886925:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858668032 00010000:00010000:2.0:1746143132.886936:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 14 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.886950:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6581 00000100:00100000:2.0:1746143132.886956:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858667904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.886963:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.886973:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 24 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.886983:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 24 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.886996:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d74e00/0x25aee876ca70d1f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501f7 expref: 24 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.887016:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.887018:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.887024:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.887053:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.887083:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143132.887094:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861262080:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143132.887154:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.887178:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6582 00000100:00100000:2.0:1746143132.887184:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858668032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.887192:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.887197:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 14 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.887205:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 14 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.887217:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5e00/0x25aee876ca70d4d6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650394 expref: 14 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.889360:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143132.889368:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.889381:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.889392:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143132.889426:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.889473:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1969:x1830962858668032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2286us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.889481:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6582 00010000:00010000:1.0:1746143132.889690:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.889698:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:1.0:1746143132.889733:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143132.889737:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143132.889751:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.889986:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1200/0x25aee876ca70d4f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143132.889991:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143132.890001:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.890008:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.890011:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143132.890013:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd0800, rc 0) 00000100:00100000:1.0:1746143132.890074:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30973:x1830962858667520:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 11806us (11978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.890081:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8180 00000100:00100000:2.0:1746143132.890150:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858668160 00000100:00100000:2.0:1746143132.890156:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858668160 00010000:00010000:2.0:1746143132.890172:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 24 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.890191:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6583 00000100:00100000:2.0:1746143132.890197:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858668160:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.890207:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.890220:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 24 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.890263:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 24 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.890278:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009acd0a00/0x25aee876ca70d420 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650347 expref: 24 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.890289:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.890321:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858668160:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 124us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.890331:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6583 00000100:00100000:0.0:1746143132.891665:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.891864:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858668544 00000100:00100000:1.0:1746143132.891870:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858668544 00000100:00100000:1.0:1746143132.891909:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8181 00000100:00100000:1.0:1746143132.891915:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:30976:x1830962858668544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143132.891931:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.891943:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1c00/0x25aee876ca70d500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503a9 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.892018:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892028:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892064:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892076:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892082:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892088:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892168:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892177:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892183:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:1.0:1746143132.892194:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143132.892279:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892286:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892292:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892298:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009acd1a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143132.892301:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892307:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892315:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143132.892318:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143132.892321:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892326:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1a00/0x25aee876ca70d507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892335:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892340:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892345:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892353:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009acd0c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143132.892355:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892360:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892366:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094755700) 00010000:00010000:1.0:1746143132.892368:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143132.892370:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892374:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0c00/0x25aee876ca70d50e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.892399:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd1c00/0x25aee876ca70d500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 25 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.892409:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 24 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.892415:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.892417:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143132.892419:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df5000, rc 0) 00000100:00100000:1.0:1746143132.893329:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30976:x1830962858668544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1410us (1664us total) trans 8589942388 rc 0/0 00000100:00100000:1.0:1746143132.893336:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8181 00000100:00100000:2.0:1746143132.896025:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861262080:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143132.896065:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.896119:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858667904:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9161us (10148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.896128:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6581 00000100:00100000:0.0:1746143132.896271:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.896324:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858668288 00000100:00100000:2.0:1746143132.896330:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858668288 00010000:00010000:2.0:1746143132.896354:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143132.896635:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6584 00000100:00100000:2.0:1746143132.896643:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858668288:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.896654:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.896672:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.896682:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.896700:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f22000/0x25aee876ca70d3da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650316 expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143132.896712:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.896714:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.896720:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.896728:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.896755:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143132.896766:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861262208:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143132.896842:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.900644:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.900685:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.900710:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.900712:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858668800 00000100:00100000:2.0:1746143132.900721:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858668800 00000100:00100000:0.0:1746143132.900724:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.900752:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858668928 00000100:00100000:1.0:1746143132.900758:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858668928 00002000:00100000:2.0:1746143132.900760:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1466368->1470463) req@ffff88008eb23100 x1830962858668800/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746143132.900760:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143132.900770:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb23100 with x1830962858668800 ext(1466368->1470463) 00002000:00010000:2.0:1746143132.900775:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb23100 00000100:00100000:0.0:1746143132.900783:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858669440 00000100:00100000:1.0:1746143132.900786:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858669184 00000100:00100000:1.0:1746143132.900789:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858669184 00000100:00100000:0.0:1746143132.900790:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858669440 00000100:00100000:2.0:1746143132.900791:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6035 00000100:00100000:2.0:1746143132.900798:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858668800:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143132.900798:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858669056 00000100:00100000:1.0:1746143132.900800:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858669056 00000100:00100000:0.0:1746143132.901007:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3455 00000100:00100000:1.0:1746143132.901012:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12437 00000100:00100000:0.0:1746143132.901014:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:30976:x1830962858669440:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:1.0:1746143132.901020:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858668928:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143132.901055:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.901070:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4200/0x25aee876ca70d523 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503b0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.901115:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861262336:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143132.901184:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.901187:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858668800:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 388us (801us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143132.901194:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6035 00002000:00100000:2.0:1746143132.901199:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1466368->1470463) req@ffff88008eb23100 x1830962858668800/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143132.901201:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12438 00002000:00100000:2.0:1746143132.901206:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb23100 with x1830962858668800 ext(1466368->1470463) 00000100:00100000:1.0:1746143132.901206:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858669184:12345-192.168.201.28@tcp:101:lfs.0 00002000:00010000:2.0:1746143132.901209:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb23100 00010000:00010000:1.0:1746143132.901213:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.901219:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca70d52a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503be expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143132.901251:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30976:x1830962858669440:12345-192.168.201.28@tcp:35:cat.0 Request processed in 237us (489us total) trans 8589942389 rc 0/0 00000100:00100000:1.0:1746143132.901257:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861262464:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143132.901258:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3455 00000100:00100000:3.0:1746143132.901365:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12439 00000100:00100000:3.0:1746143132.901375:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858669056:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143132.901385:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.901401:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d531 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503b7 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.901441:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861262592:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143132.901670:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.901760:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.902777:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861262208:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143132.902791:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.903996:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858668288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7351us (7729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.904005:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6584 00000100:00100000:0.0:1746143132.906007:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00010000:1.0:1746143132.906096:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143130 -> 1746143131 00002000:00010000:1.0:1746143132.906102:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143126 -> 1746143131 00002000:00010000:1.0:1746143132.906104:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143130 -> 1746143131 00000100:00100000:3.0:1746143132.906120:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858669696 00000100:00100000:1.0:1746143132.906125:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861262336:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143132.906126:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858669696 00002000:00100000:3.0:1746143132.906155:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3346432->3350527) req@ffff8800a5842680 x1830962858669696/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143132.906159:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4200/0x25aee876ca70d523 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503b0 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746143132.906165:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5842680 with x1830962858669696 ext(3346432->3350527) 00002000:00010000:3.0:1746143132.906170:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5842680 00010000:00010000:1.0:1746143132.906177:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4200/0x25aee876ca70d523 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503b0 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143132.906185:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6036 00000100:00100000:3.0:1746143132.906190:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858669696:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:1.0:1746143132.906197:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df4200, rc 0) 00000100:00100000:2.0:1746143132.906303:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861262592:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143132.906324:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d531 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503b7 expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.906336:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d531 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503b7 expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.906346:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa5e00, rc 0) 00000100:00100000:2.0:1746143132.906372:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858669056:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5000us (5646us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143132.906379:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12439 00000100:00100000:1.0:1746143132.906984:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858668928:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5962us (6295us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143132.906992:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12437 00000100:00100000:1.0:1746143132.907070:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861262464:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143132.907090:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca70d52a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503be expref: 7 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.907099:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009533ce00/0x25aee876ca70d52a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503be expref: 7 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.907108:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009533ce00, rc 0) 00000100:00100000:1.0:1746143132.907126:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858669184:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5919us (6415us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143132.907131:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12438 00000100:00100000:3.0:1746143132.907134:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858669696:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 942us (1128us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143132.907140:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6036 00002000:00100000:3.0:1746143132.907146:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3346432->3350527) req@ffff8800a5842680 x1830962858669696/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.907154:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5842680 with x1830962858669696 ext(3346432->3350527) 00002000:00010000:3.0:1746143132.907157:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5842680 00000100:00100000:0.0:1746143132.908891:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.910150:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.910180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.910851:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858670080 00000100:00100000:1.0:1746143132.910863:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858670080 00000100:00100000:2.0:1746143132.911099:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858669952 00000100:00100000:2.0:1746143132.911106:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858669952 00000100:00100000:1.0:1746143132.911698:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12440 00000100:00100000:1.0:1746143132.911709:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30969:x1830962858670080:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143132.911727:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.911745:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503c5 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.911779:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.911789:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.911797:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 5 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.911804:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.911806:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143132.911810:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.911842:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 5 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.911854:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 5 pid: 22204 timeout: 1014 lvb_type: 1 00000100:00100000:1.0:1746143132.911865:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861262720:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.912187:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3456 00000100:00100000:2.0:1746143132.912195:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:30967:x1830962858669952:12345-192.168.201.28@tcp:35:multiop.0 00010000:00010000:1.0:1746143132.914342:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143132.914357:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 21 pid: 8169 timeout: 1014 lvb_type: 1 00000100:00100000:1.0:1746143132.914377:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861262848:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143132.914879:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:30967:x1830962858669952:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 2679us (5985us total) trans 8589942390 rc 0/0 00000100:00100000:2.0:1746143132.914888:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3456 00010000:00010000:1.0:1746143132.914946:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.914957:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.914967:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861262976:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143132.914989:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.914992:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.915018:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858670336 00000100:00100000:1.0:1746143132.915025:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858670336 00000100:00100000:2.0:1746143132.915044:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858670464 00000100:00100000:2.0:1746143132.915049:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858670464 00000100:00100000:2.0:1746143132.915081:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12441 00000100:00100000:2.0:1746143132.915087:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858670464:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143132.915088:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8182 00000100:00100000:1.0:1746143132.915095:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30973:x1830962858670336:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143132.915099:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.915108:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.915113:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70d53f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503d3 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.915122:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70d546 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503cc expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143132.915140:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.915163:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861263104:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143132.915205:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00000100:00100000:2.0:1746143132.915551:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.915569:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858670592 00000100:00100000:2.0:1746143132.915571:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858670592 00000100:00100000:2.0:1746143132.915590:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12442 00000100:00100000:2.0:1746143132.915595:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858670592:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143132.915601:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.915609:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7c400/0x25aee876ca70d554 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503da expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143132.915629:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861263232:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143132.915654:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d4259c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143132.915830:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915847:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915861:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915868:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915874:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915880:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe82400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143132.915883:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915889:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915899:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.915902:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143132.915905:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915910:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82400/0x25aee876ca70d54d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143132.915939:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70d546 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503cc expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.915946:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70d546 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503cc expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.915953:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82c00, rc 0) 00000100:00100000:1.0:1746143132.915979:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30973:x1830962858670336:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 884us (5797us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143132.915985:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8182 00000100:00100000:0.0:1746143132.920820:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.920854:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.920868:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.920973:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858670720 00000100:00100000:3.0:1746143132.920989:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858670720 00000100:00100000:2.0:1746143132.921001:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861263232:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143132.921027:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a7c400/0x25aee876ca70d554 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503da expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.921065:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 6 pid: 22204 timeout: 1014 lvb_type: 1 00010000:00010000:2.0:1746143132.921067:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a7c400/0x25aee876ca70d554 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503da expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.921077:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7c400, rc 0) 00000100:00100000:2.0:1746143132.921113:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858670592:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5517us (5974us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143132.921120:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12442 00000100:00100000:2.0:1746143132.921166:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861263104:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143132.921178:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70d53f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503d3 expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.921186:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70d53f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503d3 expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.921192:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7ce00, rc 0) 00000100:00100000:3.0:1746143132.921199:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858670848 00000100:00100000:3.0:1746143132.921203:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858670848 00000100:00100000:2.0:1746143132.921205:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858670464:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6119us (6220us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143132.921209:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12441 00010000:00010000:3.0:1746143132.921217:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 22 pid: 8169 timeout: 1014 lvb_type: 1 00000100:00100000:2.0:1746143132.921237:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858670976 00000100:00100000:2.0:1746143132.921242:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858670976 00000100:00100000:3.0:1746143132.921254:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6585 00010000:00010000:2.0:1746143132.921257:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143132.921262:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858670720:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143132.921276:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143132.921277:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6586 00000100:00100000:2.0:1746143132.921282:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858670848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143132.921292:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143132.921297:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 6 pid: 22204 timeout: 1014 lvb_type: 1 00010000:00010000:2.0:1746143132.921301:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 22 pid: 8169 timeout: 1014 lvb_type: 1 00010000:00010000:3.0:1746143132.921309:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 6 pid: 22204 timeout: 1014 lvb_type: 1 00000100:00100000:1.0:1746143132.921353:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6587 00000100:00100000:1.0:1746143132.921360:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858670976:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143132.921369:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143132.921390:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 22 pid: 8169 timeout: 1014 lvb_type: 1 00010000:00010000:3.0:1746143132.921417:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143132.921680:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858670720:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 418us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143132.921687:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6585 00010000:00010000:1.0:1746143132.921796:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.921806:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 11 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.921822:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143132.921840:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858670976:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 481us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.921846:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6587 00010000:00010000:1.0:1746143132.922120:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799200/0x25aee876ca70d2a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650260 expref: 5 pid: 22204 timeout: 1014 lvb_type: 1 00000100:00100000:1.0:1746143132.922128:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861262720:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143132.922136:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861262848:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143132.922143:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d75400/0x25aee876ca70d205 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165020c expref: 10 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143132.922149:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861262976:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143132.922167:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 9 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.922179:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009533de00, rc 0) 00000100:00100000:1.0:1746143132.922193:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:30969:x1830962858670080:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10488us (12046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143132.922198:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12440 00010000:00010000:2.0:1746143132.922265:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798400/0x25aee876ca70d2ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165028a expref: 22 pid: 8169 timeout: 1014 lvb_type: 1 00010000:00010000:2.0:1746143132.922273:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.922275:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143132.922280:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.922287:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143132.922309:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 8 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143132.922318:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861263360:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143132.922543:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.923101:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.923681:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858671232 00000100:00100000:2.0:1746143132.923686:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858671232 00000100:00100000:2.0:1746143132.923712:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3457 00000100:00100000:2.0:1746143132.923717:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:30973:x1830962858671232:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:2.0:1746143132.923858:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:30973:x1830962858671232:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 140us (757us total) trans 8589942391 rc 0/0 00000100:00100000:2.0:1746143132.923864:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3457 00000100:00100000:2.0:1746143132.924907:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861263360:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143132.924920:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143132.924940:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858670848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3658us (4085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143132.924947:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6586 00000100:00100000:0.0:1746143132.929190:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.929249:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.929335:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858671488 00000100:00100000:3.0:1746143132.929343:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858671488 00002000:00100000:3.0:1746143132.929383:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1171456->1175551) req@ffff8800a5840380 x1830962858671488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.929393:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840380 with x1830962858671488 ext(1171456->1175551) 00002000:00010000:3.0:1746143132.929398:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840380 00000100:00100000:3.0:1746143132.929423:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858671744 00000100:00100000:3.0:1746143132.929426:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858671744 00002000:00100000:3.0:1746143132.929435:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1466367) req@ffff8800a5840700 x1830962858671744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.929442:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840700 with x1830962858671744 ext(1048576->1466367) 00002000:00010000:3.0:1746143132.929445:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840700 00000100:00100000:3.0:1746143132.929456:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6037 00000100:00100000:3.0:1746143132.929462:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858671488:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143132.929539:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6038 00000100:00100000:2.0:1746143132.929546:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858671744:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143132.929887:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858671488:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 423us (702us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143132.929897:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6037 00002000:00100000:3.0:1746143132.929903:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1171456->1175551) req@ffff8800a5840380 x1830962858671488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.929909:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840380 with x1830962858671488 ext(1171456->1175551) 00002000:00010000:3.0:1746143132.929912:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840380 00000100:00100000:0.0:1746143132.935351:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.935798:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858672000 00000100:00100000:2.0:1746143132.935807:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858672000 00000100:00100000:2.0:1746143132.935853:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3458 00000100:00100000:2.0:1746143132.935861:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:30969:x1830962858672000:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143132.936624:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858671744:12345-192.168.201.28@tcp:3:cat.0 Request processed in 7076us (7372us total) trans 0 rc 417792/417792 00000100:00100000:3.0:1746143132.936633:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6038 00002000:00100000:3.0:1746143132.936641:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1466367) req@ffff8800a5840700 x1830962858671744/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 417792/417792 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.936650:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5840700 with x1830962858671744 ext(1048576->1466367) 00002000:00010000:3.0:1746143132.936655:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5840700 00000100:00100000:2.0:1746143132.936977:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30969:x1830962858672000:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 862us (1379us total) trans 8589942392 rc 0/0 00000100:00100000:2.0:1746143132.936984:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3458 00000100:00100000:0.0:1746143132.944990:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.946040:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858672256 00000100:00100000:3.0:1746143132.946049:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858672256 00002000:00100000:3.0:1746143132.946090:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1175552->2097151) req@ffff8800a5842d80 x1830962858672256/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.946100:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5842d80 with x1830962858672256 ext(1175552->2097151) 00002000:00010000:3.0:1746143132.946105:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5842d80 00000100:00100000:3.0:1746143132.946136:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6039 00000100:00100000:3.0:1746143132.946143:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858672256:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143132.946295:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.946377:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858672512 00000100:00100000:2.0:1746143132.946381:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858672512 00002000:00100000:2.0:1746143132.946403:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800942c4e00 x1830962858672512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/0 e 0 to 0 dl 1746143143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.946412:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4e00 with x1830962858672512 ext(1048576->2097151) 00002000:00010000:2.0:1746143132.946415:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c4e00 00000100:00100000:2.0:1746143132.946436:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6040 00000100:00100000:2.0:1746143132.946647:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858672512:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143132.957447:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858672256:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11297us (12455us total) trans 0 rc 921600/921600 00000100:00100000:3.0:1746143132.957458:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6039 00002000:00100000:3.0:1746143132.957469:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1175552->2097151) req@ffff8800a5842d80 x1830962858672256/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 921600/921600 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143132.957478:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5842d80 with x1830962858672256 ext(1175552->2097151) 00002000:00010000:3.0:1746143132.957483:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5842d80 00000100:00100000:2.0:1746143132.963343:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858672512:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16891us (17040us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143132.963355:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6040 00002000:00100000:2.0:1746143132.963544:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800942c4e00 x1830962858672512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:283/0 lens 488/440 e 0 to 0 dl 1746143143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143132.963559:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4e00 with x1830962858672512 ext(1048576->2097151) 00002000:00010000:2.0:1746143132.963564:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c4e00 00000100:00100000:0.0:1746143132.977282:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.978703:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143132.980533:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858672640 00000100:00100000:1.0:1746143132.980543:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858672640 00000100:00100000:1.0:1746143132.980586:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858672768 00000100:00100000:1.0:1746143132.980588:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858672768 00000100:00100000:1.0:1746143132.980603:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12443 00000100:00100000:1.0:1746143132.980609:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858672640:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143132.980625:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143132.980637:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12444 00010000:00010000:1.0:1746143132.980640:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009533c600/0x25aee876ca70d55b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503e1 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.980646:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858672768:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143132.980654:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.980664:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012caa4200/0x25aee876ca70d562 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503e8 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.980685:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861263488:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143132.980690:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861263616:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143132.980769:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143132.981234:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.986188:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.986400:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861263616:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143132.986431:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012caa4200/0x25aee876ca70d562 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503e8 expref: 10 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.986447:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4200/0x25aee876ca70d562 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503e8 expref: 10 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143132.986469:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa4200, rc 0) 00000100:00100000:3.0:1746143132.986507:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858672768:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5862us (7807us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143132.986515:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12444 00000100:00100000:1.0:1746143132.987093:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858673024 00000100:00100000:1.0:1746143132.987099:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858673024 00000100:00100000:1.0:1746143132.987138:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8183 00000100:00100000:1.0:1746143132.987144:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:30982:x1830962858673024:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143132.987163:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143132.987176:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70d569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503ef expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.987276:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987288:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987297:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987308:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987314:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987319:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987411:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987419:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987425:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:1.0:1746143132.987433:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143132.987679:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987686:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987691:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987700:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132051000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143132.987703:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987709:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987718:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143132.987721:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143132.987724:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987729:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70d570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987741:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987746:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987751:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987755:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132051c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143132.987757:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987762:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987767:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4fb2500) 00010000:00010000:1.0:1746143132.987769:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143132.987772:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987776:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132051c00/0x25aee876ca70d577 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143132.987807:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70d569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 217 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.987816:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 216 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143132.987822:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143132.987824:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143132.987826:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050000, rc 0) 00000100:00100000:1.0:1746143132.987846:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:30982:x1830962858673024:12345-192.168.201.28@tcp:101:cat.0 Request processed in 703us (1665us total) trans 8589942393 rc 0/0 00000100:00100000:1.0:1746143132.987851:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8183 00000100:00100000:2.0:1746143132.990774:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143132.990836:0:14797:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858673280 00000100:00100000:3.0:1746143132.990842:0:14797:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858673280 00000100:00100000:3.0:1746143132.990888:0:14797:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3459 00000100:00100000:3.0:1746143132.990895:0:14797:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009386e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:30982:x1830962858673280:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:2.0:1746143132.990897:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861263488:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143132.990922:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009533c600/0x25aee876ca70d55b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503e1 expref: 13 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.990932:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009533c600/0x25aee876ca70d55b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503e1 expref: 13 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143132.990943:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009533c600, rc 0) 00000100:00100000:2.0:1746143132.990969:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858672640:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10360us (13696us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143132.990975:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12443 00000100:00100000:3.0:1746143132.991001:0:14797:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009386e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+217:30982:x1830962858673280:12345-192.168.201.28@tcp:35:cat.0 Request processed in 106us (231us total) trans 8589942394 rc 0/0 00000100:00100000:3.0:1746143132.991007:0:14797:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3459 00000100:00100000:0.0:1746143132.995852:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143132.995891:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.995917:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858673536 00000100:00100000:2.0:1746143132.995926:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858673536 00000100:00100000:2.0:1746143132.995958:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858673408 00000100:00100000:2.0:1746143132.995959:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858673408 00000100:00100000:0.0:1746143132.995964:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143132.996531:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858673664 00000100:00100000:2.0:1746143132.996534:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858673664 00000100:00100000:3.0:1746143132.997331:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12445 00000100:00100000:3.0:1746143132.997342:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30976:x1830962858673536:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143132.997359:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.997376:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503fd expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.997400:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143132.997589:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143132.997591:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143132.997601:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 13 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.997626:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12446 00010000:00010000:3.0:1746143132.997633:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143132.997634:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858673408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143132.997642:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143132.997644:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 15 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143132.997651:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132050800/0x25aee876ca70d593 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16503f6 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143132.997657:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861263744:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143132.997678:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861263872:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143132.997737:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143132.997853:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a341840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143132.997859:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12447 00000100:00100000:2.0:1746143132.997865:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858673664:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143132.997871:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143132.997878:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7cc00/0x25aee876ca70d59a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650404 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143132.997903:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861264000:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143132.997935:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00002000:00010000:3.0:1746143133.000263:0:10061:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143130 -> 1746143131 00002000:00010000:3.0:1746143133.000269:0:10061:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143130 -> 1746143131 00002000:00010000:3.0:1746143133.000271:0:10061:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143130 -> 1746143131 00000100:00100000:3.0:1746143133.000288:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10061:1830962861264000:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143133.000296:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861263744:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.000312:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a7cc00/0x25aee876ca70d59a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650404 expref: 24 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.000313:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 13 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.000324:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a7cc00/0x25aee876ca70d59a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650404 expref: 24 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.000325:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa5e00, rc 0) 00010000:00010000:3.0:1746143133.000332:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7cc00, rc 0) 00000100:00100000:3.0:1746143133.000355:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858673664:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2490us (4390us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143133.000355:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30976:x1830962858673536:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3016us (4508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.000362:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12447 00000100:00100000:0.0:1746143133.000693:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.000820:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861263872:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143133.000836:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132050800/0x25aee876ca70d593 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503f6 expref: 22 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.000846:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132050800/0x25aee876ca70d593 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503f6 expref: 22 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.000858:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050800, rc 0) 00000100:00100000:0.0:1746143133.000879:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858673408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3246us (4987us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143133.000997:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12445 00000100:00100000:3.0:1746143133.001079:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858673792 00000100:00100000:3.0:1746143133.001085:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858673792 00002000:00100000:3.0:1746143133.001116:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3710976->4194303) req@ffff8800942c5880 x1830962858673792/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.001125:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5880 with x1830962858673792 ext(3710976->4194303) 00010000:00010000:3.0:1746143133.001132:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 16 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143133.001144:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 16 pid: 22204 timeout: 1014 lvb_type: 0 00002000:00010000:3.0:1746143133.001150:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c5880 00000100:00100000:3.0:1746143133.001167:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1984 00000100:00100000:3.0:1746143133.001174:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858673792:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143133.001475:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12446 00000100:00100000:0.0:1746143133.009714:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.010057:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858673920 00000100:00100000:1.0:1746143133.010070:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858673920 00000100:00100000:1.0:1746143133.010115:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12448 00000100:00100000:1.0:1746143133.010123:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30982:x1830962858673920:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143133.010144:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.010160:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165040b expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.010186:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.010193:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143133.010194:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143133.010198:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 22 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.010236:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 8 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.010246:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 8 pid: 4758 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143133.010258:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861264128:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143133.010313:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.012407:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.012499:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861264128:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.012522:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 22 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.012536:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050c00, rc 0) 00000100:00100000:1.0:1746143133.012565:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:30982:x1830962858673920:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2442us (2858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.012572:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12448 00000100:00100000:2.0:1746143133.012645:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858674048 00000100:00100000:2.0:1746143133.012650:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858674048 00002000:00100000:2.0:1746143133.012682:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1466368->2097151) req@ffff8800942c7100 x1830962858674048/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.012690:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7100 with x1830962858674048 ext(1466368->2097151) 00010000:00010000:2.0:1746143133.012697:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 9 pid: 4758 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.012706:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 9 pid: 4758 timeout: 1014 lvb_type: 0 00002000:00010000:2.0:1746143133.012713:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c7100 00000100:00100000:2.0:1746143133.012728:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1985 00000100:00100000:2.0:1746143133.012735:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858674048:12345-192.168.201.28@tcp:4:cat.0 00000100:00080000:1.0:1746143133.013615:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143133.022589:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858673792:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 21406us (21888us total) trans 21474840045 rc 0/0 00000100:00100000:2.0:1746143133.022601:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1984 00002000:00100000:2.0:1746143133.022613:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3710976->4194303) req@ffff8800942c5880 x1830962858673792/t21474840045(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.022623:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5880 with x1830962858673792 ext(3710976->4194303) 00010000:00010000:2.0:1746143133.022632:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 18 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.022645:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 18 pid: 22204 timeout: 1014 lvb_type: 0 00002000:00010000:2.0:1746143133.022652:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c5880 00000100:00100000:2.0:1746143133.026964:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858674048:12345-192.168.201.28@tcp:4:cat.0 Request processed in 14222us (14553us total) trans 17179872782 rc 0/0 00000100:00100000:2.0:1746143133.026975:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1985 00002000:00100000:2.0:1746143133.026985:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1466368->2097151) req@ffff8800942c7100 x1830962858674048/t17179872782(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.026995:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7100 with x1830962858674048 ext(1466368->2097151) 00010000:00010000:2.0:1746143133.027004:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 11 pid: 4758 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.027015:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 11 pid: 4758 timeout: 1014 lvb_type: 0 00002000:00010000:2.0:1746143133.027028:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c7100 00000100:00100000:0.0:1746143133.029476:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.029540:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858674176 00000100:00100000:2.0:1746143133.029547:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858674176 00010000:00010000:2.0:1746143133.029583:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 18 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143133.029603:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6588 00000100:00100000:2.0:1746143133.029609:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858674176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.029619:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.029634:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 18 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.029649:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 18 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.029754:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa4000/0x25aee876ca70d4a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650378 expref: 18 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.030753:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.030756:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.030763:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.030772:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.030808:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 12 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.031051:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861264256:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143133.031119:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.033843:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.034002:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858674304 00000100:00100000:2.0:1746143133.034010:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858674304 00010000:00010000:2.0:1746143133.034061:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 11 pid: 4758 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143133.034090:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861264256:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143133.034108:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.034126:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6589 00000100:00100000:2.0:1746143133.034135:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858674304:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143133.034142:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1971:x1830962858674176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4532us (4668us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143133.034146:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143133.034151:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6588 00010000:00010000:2.0:1746143133.034164:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 11 pid: 4758 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.034175:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 11 pid: 4758 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.034193:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132051a00/0x25aee876ca70d4eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165039b expref: 11 pid: 4758 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.034203:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.034204:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.034210:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.034218:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.034254:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.034265:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861264384:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143133.034310:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.035934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.036025:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861264384:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143133.036053:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.036316:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858674560 00000100:00100000:3.0:1746143133.036321:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858674560 00000100:00100000:2.0:1746143133.036447:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858674304:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2312us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.036455:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6589 00002000:00100000:3.0:1746143133.036609:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800942c7b80 x1830962858674560/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.036620:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7b80 with x1830962858674560 ext(2097152->3145727) 00002000:00010000:3.0:1746143133.036629:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c7b80 00000100:00100000:3.0:1746143133.036648:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6041 00000100:00100000:3.0:1746143133.036656:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858674560:12345-192.168.201.28@tcp:3:cat.0 00000100:00080000:1.0:1746143133.036704:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143133.039266:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.039329:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858674816 00000100:00100000:2.0:1746143133.039335:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858674816 00002000:00100000:2.0:1746143133.039358:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800942c5180 x1830962858674816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.039366:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5180 with x1830962858674816 ext(1048576->2097151) 00002000:00010000:2.0:1746143133.039370:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c5180 00000100:00100000:2.0:1746143133.039384:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6042 00000100:00100000:2.0:1746143133.039389:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858674816:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143133.050676:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858674560:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14011us (14735us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.050688:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6041 00002000:00100000:3.0:1746143133.050700:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800942c7b80 x1830962858674560/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.050709:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7b80 with x1830962858674560 ext(2097152->3145727) 00002000:00010000:3.0:1746143133.050715:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c7b80 00000100:00100000:2.0:1746143133.055085:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858674816:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15685us (15812us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143133.055101:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6042 00002000:00100000:2.0:1746143133.055114:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800942c5180 x1830962858674816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.055124:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5180 with x1830962858674816 ext(1048576->2097151) 00002000:00010000:2.0:1746143133.055130:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c5180 00000100:00100000:0.0:1746143133.056374:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.056611:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858674944 00000100:00100000:1.0:1746143133.056618:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858674944 00000100:00100000:1.0:1746143133.056661:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12449 00000100:00100000:1.0:1746143133.056669:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:30976:x1830962858674944:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143133.057545:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.057561:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650412 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.057587:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.057710:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143133.057712:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143133.057716:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.057746:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.057756:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 21 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143133.057769:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861264512:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143133.058619:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.066780:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861264512:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.066808:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.066825:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbec00, rc 0) 00000100:00100000:1.0:1746143133.067125:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:30976:x1830962858674944:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10455us (10752us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.067134:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12449 00000100:00100000:0.0:1746143133.067604:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.067671:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858675072 00000100:00100000:3.0:1746143133.067678:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858675072 00002000:00100000:3.0:1746143133.067713:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3350527) req@ffff8800942c5500 x1830962858675072/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.067722:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5500 with x1830962858675072 ext(3145728->3350527) 00010000:00010000:3.0:1746143133.067729:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 22 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143133.067742:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 22 pid: 22204 timeout: 1014 lvb_type: 0 00002000:00010000:3.0:1746143133.067749:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c5500 00000100:00100000:3.0:1746143133.067774:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1986 00000100:00100000:3.0:1746143133.067780:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858675072:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143133.069828:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.070152:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858675200 00000100:00100000:1.0:1746143133.070159:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858675200 00000100:00100000:1.0:1746143133.070198:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12450 00000100:00100000:1.0:1746143133.070206:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:30982:x1830962858675200:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143133.070217:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.070241:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650419 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.070287:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.070295:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143133.070297:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143133.070300:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.070328:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.070343:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 10 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143133.070356:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861264640:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143133.073176:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.076284:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861264640:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.076312:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 25 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.076324:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbe000, rc 0) 00000100:00100000:1.0:1746143133.076365:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:30982:x1830962858675200:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6159us (6540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.076374:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12450 00000100:00100000:0.0:1746143133.076738:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.077069:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858675328 00000100:00100000:2.0:1746143133.077076:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858675328 00002000:00100000:2.0:1746143133.077109:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1175551) req@ffff88009c1e8000 x1830962858675328/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.077119:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8000 with x1830962858675328 ext(1048576->1175551) 00010000:00010000:2.0:1746143133.077126:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 11 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.077136:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 11 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:2.0:1746143133.077142:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1e8000 00000100:00100000:2.0:1746143133.077163:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1987 00000100:00100000:2.0:1746143133.077170:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858675328:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143133.083548:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858675328:12345-192.168.201.28@tcp:4:cat.0 Request processed in 6368us (6800us total) trans 17179872783 rc 0/0 00000100:00100000:2.0:1746143133.083560:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1987 00002000:00100000:2.0:1746143133.083572:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1175551) req@ffff88009c1e8000 x1830962858675328/t17179872783(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.083588:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8000 with x1830962858675328 ext(1048576->1175551) 00010000:00010000:2.0:1746143133.083597:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.083611:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00002000:00010000:2.0:1746143133.083617:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1e8000 00000100:00100000:0.0:1746143133.084213:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.084335:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858675584 00000100:00100000:1.0:1746143133.084343:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858675584 00000100:00100000:1.0:1746143133.084377:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8184 00000100:00100000:1.0:1746143133.084384:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:30984:x1830962858675584:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143133.084403:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.084417:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbf800/0x25aee876ca70d5b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650420 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.084496:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143133.084511:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.084519:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 27 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.084525:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 216 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.084531:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143133.084558:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 216 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.084569:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 216 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143133.084581:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861264768:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.084714:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858675072:12345-192.168.201.28@tcp:4:cat.0 Request processed in 16933us (17110us total) trans 17179872784 rc 0/0 00000100:00100000:3.0:1746143133.084722:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1986 00002000:00100000:3.0:1746143133.084729:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->3350527) req@ffff8800942c5500 x1830962858675072/t17179872784(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.084737:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5500 with x1830962858675072 ext(3145728->3350527) 00010000:00010000:3.0:1746143133.084744:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 25 pid: 22204 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143133.084753:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 25 pid: 22204 timeout: 1014 lvb_type: 0 00002000:00010000:3.0:1746143133.084760:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c5500 00010000:00010000:1.0:1746143133.084824:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 27 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.084832:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 27 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143133.084840:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861264896:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.084871:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.084879:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 12 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143133.084888:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861265024:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143133.084907:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.087752:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.087913:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858675712 00000100:00100000:2.0:1746143133.087921:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858675712 00010000:00010000:2.0:1746143133.087960:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143133.088637:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6590 00000100:00100000:2.0:1746143133.088646:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858675712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.088658:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.088676:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.088687:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.088710:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009533de00/0x25aee876ca70d538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503c5 expref: 13 pid: 10061 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.088743:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.088745:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.088754:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.088762:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.088793:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 24 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.088810:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861265152:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143133.089644:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.089795:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861264768:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.090628:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.090698:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.090727:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.090747:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858675840 00000100:00100000:3.0:1746143133.090753:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858675840 00010000:00010000:3.0:1746143133.090779:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 217 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143133.090801:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858676096 00000100:00100000:3.0:1746143133.090803:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858676096 00010000:00010000:3.0:1746143133.090813:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 13 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143133.090852:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858676224 00000100:00100000:1.0:1746143133.090856:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858676224 00010000:00010000:1.0:1746143133.090874:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 25 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:1.0:1746143133.090890:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6591 00000100:00100000:1.0:1746143133.090896:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+217:1968:x1830962858675840:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143133.090906:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143133.090911:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 217 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143133.090921:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 217 pid: 17079 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143133.090937:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132050000/0x25aee876ca70d57e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503ef expref: 217 pid: 17079 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143133.090942:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6592 00000100:00100000:3.0:1746143133.090950:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858676096:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143133.090953:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143133.090958:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.090962:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143133.090967:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 13 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:1.0:1746143133.090968:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143133.090977:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143133.090985:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 13 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:3.0:1746143133.090997:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143133.091001:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.091007:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.091011:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.091054:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861264896:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.091063:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858676096:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 112us (362us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143133.091067:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd0800/0x25aee876ca70d4f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a2 expref: 13 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:3.0:1746143133.091071:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6592 00000100:00100000:2.0:1746143133.091078:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861265024:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.091086:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6593 00000100:00100000:3.0:1746143133.091091:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858676224:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.091097:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.091098:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143133.091114:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 25 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143133.091118:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861265152:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143133.091126:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143133.091131:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 25 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143133.091145:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858675712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2501us (3401us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143133.091149:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012caa4c00/0x25aee876ca70d4dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165038d expref: 25 pid: 22204 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143133.091155:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6590 00010000:00010000:3.0:1746143133.091163:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.091165:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.091170:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.091177:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.091200:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.091210:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861265280:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143133.091332:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a341840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.091683:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:1968:x1830962858675840:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 787us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.091690:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6591 00000100:00100000:0.0:1746143133.091903:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.092060:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858675968 00000100:00100000:2.0:1746143133.092064:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858675968 00010000:00010000:2.0:1746143133.092079:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 28 pid: 14794 timeout: 1014 lvb_type: 0 00000100:00100000:2.0:1746143133.092108:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6594 00000100:00100000:2.0:1746143133.092113:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858675968:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.092120:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.092124:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 28 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.092132:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 28 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.092144:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5df5000/0x25aee876ca70d515 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503a9 expref: 28 pid: 14794 timeout: 1014 lvb_type: 0 00010000:00010000:2.0:1746143133.092154:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143133.092158:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143133.092164:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143133.092171:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143133.092198:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143133.092217:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:2.0:1746143133.092220:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1971:x1830962858675968:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.092237:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6594 00010000:00010000:3.0:1746143133.092240:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:3.0:1746143133.092256:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143133.092365:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbf800/0x25aee876ca70d5b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 28 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.092378:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 27 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.092385:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143133.092387:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143133.092390:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbfc00, rc 0) 00000100:00100000:3.0:1746143133.092412:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:30984:x1830962858675584:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8029us (8201us total) trans 8589942395 rc 0/0 00000100:00100000:3.0:1746143133.092418:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8184 00000100:00100000:0.0:1746143133.094142:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.094596:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858676480 00000100:00100000:3.0:1746143133.094602:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858676480 00002000:00100000:3.0:1746143133.094630:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009c1ea300 x1830962858676480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.094639:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1ea300 with x1830962858676480 ext(1048576->2097151) 00002000:00010000:3.0:1746143133.094643:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1ea300 00000100:00100000:3.0:1746143133.094665:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6043 00000100:00100000:3.0:1746143133.094675:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858676480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.095543:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861265280:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143133.095559:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.095586:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858676224:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4494us (4858us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.095594:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6593 00000100:00100000:3.0:1746143133.113797:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858676480:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19113us (19649us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.113812:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6043 00002000:00100000:3.0:1746143133.113824:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009c1ea300 x1830962858676480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.114093:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1ea300 with x1830962858676480 ext(1048576->2097151) 00002000:00010000:3.0:1746143133.114099:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1ea300 00000100:00100000:0.0:1746143133.119685:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.119728:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.119769:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.120117:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858676736 00000100:00100000:3.0:1746143133.120126:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858676736 00002000:00100000:3.0:1746143133.120163:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009c1e9c00 x1830962858676736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.120175:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9c00 with x1830962858676736 ext(2097152->3145727) 00002000:00010000:3.0:1746143133.120180:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1e9c00 00000100:00100000:3.0:1746143133.120199:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858676992 00000100:00100000:3.0:1746143133.120201:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858676992 00002000:00100000:3.0:1746143133.120210:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009c1e8700 x1830962858676992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.120218:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8700 with x1830962858676992 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.120220:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1e8700 00000100:00100000:3.0:1746143133.120240:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858677248 00000100:00100000:3.0:1746143133.120242:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858677248 00002000:00100000:3.0:1746143133.120251:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009c1e8e00 x1830962858677248/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.120259:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8e00 with x1830962858677248 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.120262:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e8e00 00000100:00100000:3.0:1746143133.120272:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6044 00000100:00100000:3.0:1746143133.120280:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858676736:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143133.121737:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6045 00000100:00100000:3.0:1746143133.121745:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858676992:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143133.122153:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6046 00000100:00100000:0.0:1746143133.122162:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858677248:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143133.149324:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.149372:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.149827:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858677376 00000100:00100000:2.0:1746143133.149837:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858677376 00000100:00100000:2.0:1746143133.149872:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858677504 00000100:00100000:2.0:1746143133.149874:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858677504 00000100:00100000:2.0:1746143133.149891:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12451 00000100:00100000:2.0:1746143133.149898:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858677376:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.149916:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.149933:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650427 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.149954:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.149956:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.149964:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 18 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.149979:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 18 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.149988:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2cc00, rc 0) 00000100:00100000:2.0:1746143133.150058:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858677376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 160us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.150066:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12451 00000100:00100000:2.0:1746143133.150085:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12452 00000100:00100000:2.0:1746143133.150090:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858677504:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.150097:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.150106:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165042e expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.150118:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.150120:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.150125:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 25 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.150136:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 25 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.150144:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2d600, rc 0) 00000100:00100000:2.0:1746143133.150160:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858677504:12345-192.168.201.28@tcp:101:cat.0 Request processed in 70us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.150166:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12452 00000100:00100000:2.0:1746143133.153099:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858677248:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30933us (33323us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143133.153111:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6046 00002000:00100000:2.0:1746143133.153121:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009c1e8e00 x1830962858677248/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.153130:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8e00 with x1830962858677248 ext(3145728->4194303) 00002000:00010000:2.0:1746143133.153136:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e8e00 00000100:00100000:3.0:1746143133.153315:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858676736:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33035us (33637us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.153322:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6044 00002000:00100000:3.0:1746143133.153328:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009c1e9c00 x1830962858676736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.153335:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9c00 with x1830962858676736 ext(2097152->3145727) 00002000:00010000:3.0:1746143133.153339:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1e9c00 00000100:00100000:3.0:1746143133.159820:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858676992:12345-192.168.201.28@tcp:3:cat.0 Request processed in 38072us (40087us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.159836:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6045 00000100:00100000:2.0:1746143133.159840:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:3.0:1746143133.159847:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009c1e8700 x1830962858676992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.159857:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e8700 with x1830962858676992 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.159863:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1e8700 00000100:00100000:3.0:1746143133.159891:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858677760 00000100:00100000:3.0:1746143133.159897:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858677760 00000100:00100000:3.0:1746143133.159939:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8185 00000100:00100000:3.0:1746143133.159947:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:30986:x1830962858677760:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143133.160142:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.160159:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f12200/0x25aee876ca70d5d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650435 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.160261:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.160276:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.160288:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:3.0:1746143133.160299:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143133.160387:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f12200/0x25aee876ca70d5d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 219 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.160410:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 218 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.160418:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143133.160422:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143133.160425:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f13000, rc 0) 00000100:00100000:3.0:1746143133.160459:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+218:30986:x1830962858677760:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 512us (1015us total) trans 8589942396 rc 0/0 00000100:00100000:3.0:1746143133.160591:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8185 00000100:00100000:0.0:1746143133.170429:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.170470:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.170791:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.170873:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858678400 00000100:00100000:3.0:1746143133.170881:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858678400 00000100:00100000:1.0:1746143133.170881:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858677888 00000100:00100000:1.0:1746143133.170886:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858677888 00002000:00100000:3.0:1746143133.170920:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009c1e9500 x1830962858678400/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143133.170946:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858678144 00000100:00100000:1.0:1746143133.170949:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858678144 00000100:00100000:2.0:1746143133.170959:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12453 00000100:00100000:1.0:1746143133.170966:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12454 00000100:00100000:2.0:1746143133.170968:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858677888:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143133.170973:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858678144:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.170980:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.170981:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.171005:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165043c expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.171005:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650443 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.171024:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.171024:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.171026:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.171026:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.171057:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.171058:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 15 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.171075:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.171075:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 15 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.171084:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d76000, rc 0) 00010000:00010000:1.0:1746143133.171084:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0c7200, rc 0) 00000100:00100000:2.0:1746143133.171127:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858677888:12345-192.168.201.28@tcp:101:cat.0 Request processed in 159us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.171127:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858678144:12345-192.168.201.28@tcp:101:cat.0 Request processed in 153us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.171133:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12453 00000100:00100000:1.0:1746143133.171136:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12454 00002000:00100000:3.0:1746143133.171207:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9500 with x1830962858678400 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.171212:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e9500 00000100:00100000:3.0:1746143133.171258:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6047 00000100:00100000:3.0:1746143133.171265:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858678400:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143133.178678:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.179302:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.179595:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858678784 00000100:00100000:3.0:1746143133.179603:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858678784 00002000:00100000:3.0:1746143133.179641:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009c1eb800 x1830962858678784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.179652:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1eb800 with x1830962858678784 ext(2097152->3145727) 00002000:00010000:3.0:1746143133.179656:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1eb800 00000100:00100000:3.0:1746143133.180071:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858679040 00000100:00100000:3.0:1746143133.180075:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858679040 00002000:00100000:3.0:1746143133.180096:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009c1e9180 x1830962858679040/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.180105:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9180 with x1830962858679040 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.180108:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1e9180 00000100:00100000:2.0:1746143133.180158:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6048 00000100:00100000:2.0:1746143133.180168:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858678784:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143133.182516:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6049 00000100:00100000:3.0:1746143133.182526:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858679040:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143133.184889:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.184995:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858678272 00000100:00100000:1.0:1746143133.185004:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858678272 00002000:00100000:1.0:1746143133.185057:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880093b59c00 x1830962858678272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.185067:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59c00 with x1830962858678272 ext(2097152->3145727) 00002000:00010000:1.0:1746143133.185072:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59c00 00000100:00100000:1.0:1746143133.185088:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6050 00000100:00100000:1.0:1746143133.185096:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858678272:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143133.195576:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858678400:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24301us (24775us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.195587:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6047 00002000:00100000:3.0:1746143133.195598:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009c1e9500 x1830962858678400/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.195608:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9500 with x1830962858678400 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.195613:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e9500 00000100:00100000:2.0:1746143133.196660:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858678784:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 16491us (17986us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143133.196669:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6048 00002000:00100000:2.0:1746143133.196677:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009c1eb800 x1830962858678784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.196687:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1eb800 with x1830962858678784 ext(2097152->3145727) 00002000:00010000:2.0:1746143133.196690:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1eb800 00000100:00100000:0.0:1746143133.197608:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.197723:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858679296 00000100:00100000:2.0:1746143133.197732:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858679296 00002000:00100000:2.0:1746143133.197762:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093b59880 x1830962858679296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.197771:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59880 with x1830962858679296 ext(4194304->5210111) 00002000:00010000:2.0:1746143133.197776:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59880 00000100:00100000:2.0:1746143133.197802:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6051 00000100:00100000:2.0:1746143133.197809:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858679296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143133.205570:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858679040:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 22860us (26082us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.205583:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6049 00002000:00100000:3.0:1746143133.205595:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009c1e9180 x1830962858679040/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.205605:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9180 with x1830962858679040 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.205611:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1e9180 00000100:00100000:1.0:1746143133.212827:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858678272:12345-192.168.201.28@tcp:3:cat.0 Request processed in 27723us (27935us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143133.212838:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6050 00002000:00100000:1.0:1746143133.212849:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880093b59c00 x1830962858678272/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.212859:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59c00 with x1830962858678272 ext(2097152->3145727) 00002000:00010000:1.0:1746143133.212865:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59c00 00000100:00100000:2.0:1746143133.217350:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858679296:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19534us (19736us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143133.217361:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6051 00002000:00100000:2.0:1746143133.217371:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093b59880 x1830962858679296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.217380:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59880 with x1830962858679296 ext(4194304->5210111) 00002000:00010000:2.0:1746143133.217385:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59880 00000100:00100000:0.0:1746143133.222826:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.222979:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858679424 00000100:00100000:2.0:1746143133.222988:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858679424 00000100:00100000:2.0:1746143133.223026:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12455 00000100:00100000:2.0:1746143133.223058:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30986:x1830962858679424:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143133.223074:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.223894:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165044a expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.223929:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.223937:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 19 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.223943:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.223945:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.223948:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.223977:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 19 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.223988:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 19 pid: 754 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.224000:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861265408:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.224132:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.224141:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 12 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.224150:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861265536:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.224171:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.230936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.231152:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858679680 00000100:00100000:2.0:1746143133.231161:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858679680 00002000:00100000:2.0:1746143133.231206:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093b59180 x1830962858679680/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.231216:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59180 with x1830962858679680 ext(4194304->5210111) 00010000:00010000:2.0:1746143133.231238:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 20 pid: 754 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.231250:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 20 pid: 754 timeout: 1015 lvb_type: 1 00002000:00010000:2.0:1746143133.231258:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093b59180 00000100:00100000:2.0:1746143133.231292:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1988 00000100:00100000:2.0:1746143133.231300:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858679680:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.237553:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861265408:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.237564:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861265536:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.237593:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 21 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.237609:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b430fe00, rc 0) 00000100:00100000:2.0:1746143133.237649:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30986:x1830962858679424:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14591us (14830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.237658:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12455 00000100:00100000:0.0:1746143133.243126:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.243193:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858679808 00000100:00100000:2.0:1746143133.243202:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858679808 00010000:00010000:2.0:1746143133.243249:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 13 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.243287:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6595 00000100:00100000:2.0:1746143133.243293:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858679808:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.243302:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.243317:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 13 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.243325:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 13 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.243341:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa5e00/0x25aee876ca70d58c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16503fd expref: 13 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.243361:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.243397:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858679808:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.243402:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6595 00000100:00100000:2.0:1746143133.249680:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858679680:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18372us (18743us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143133.249691:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1988 00002000:00100000:2.0:1746143133.249702:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880093b59180 x1830962858679680/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.249711:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59180 with x1830962858679680 ext(4194304->5210111) 00010000:00010000:2.0:1746143133.249721:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 19 pid: 754 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.249735:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 19 pid: 754 timeout: 1015 lvb_type: 1 00002000:00010000:2.0:1746143133.249742:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093b59180 00000100:00100000:0.0:1746143133.258961:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.259598:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858679936 00000100:00100000:2.0:1746143133.259607:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858679936 00000100:00100000:2.0:1746143133.259659:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12456 00000100:00100000:2.0:1746143133.259667:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858679936:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.259682:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.259697:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5350a00/0x25aee876ca70d603 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650451 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.259715:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.259724:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5350a00/0x25aee876ca70d603 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650451 expref: 20 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.259734:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5350a00/0x25aee876ca70d603 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650451 expref: 20 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.259757:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5350a00, rc 0) 00000100:00100000:2.0:1746143133.259794:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858679936:12345-192.168.201.28@tcp:101:cat.0 Request processed in 128us (840us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143133.259800:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12456 00000100:00100000:0.0:1746143133.262421:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.262670:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858680064 00000100:00100000:2.0:1746143133.262677:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858680064 00000100:00100000:2.0:1746143133.262794:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12457 00000100:00100000:2.0:1746143133.262802:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30982:x1830962858680064:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.262816:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.262830:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650458 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.262849:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.262851:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.262857:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.262870:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.262880:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5350c00, rc 0) 00000100:00100000:2.0:1746143133.262916:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30982:x1830962858680064:12345-192.168.201.28@tcp:101:cat.0 Request processed in 114us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.262922:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12457 00000100:00100000:2.0:1746143133.267824:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.267865:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858680192 00000100:00100000:2.0:1746143133.267867:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.267874:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858680192 00010000:00010000:0.0:1746143133.267907:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 20 pid: 754 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.267941:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6596 00000100:00100000:0.0:1746143133.267949:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858680192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.267962:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.267980:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 20 pid: 754 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.267991:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 20 pid: 754 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.268011:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e2cc00/0x25aee876ca70d5cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650427 expref: 20 pid: 754 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.268111:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.268114:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.268121:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.268129:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 19 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.268157:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 19 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.268264:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858680320 00000100:00100000:3.0:1746143133.268269:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858680320 00000100:00100000:3.0:1746143133.268292:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12458 00000100:00100000:3.0:1746143133.268298:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858680320:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.268309:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.268319:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d611 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165045f expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.268336:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d611 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165045f expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.268344:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d611 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165045f expref: 21 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.268359:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f12c00, rc 0) 00000100:00100000:3.0:1746143133.268676:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858680320:12345-192.168.201.28@tcp:101:cat.0 Request processed in 377us (807us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143133.268682:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12458 00000100:00100000:0.0:1746143133.268794:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861265664:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143133.268861:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.273576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.273747:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861265664:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143133.273775:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143133.273819:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858680192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5870us (6002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.273828:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6596 00000100:00100000:2.0:1746143133.274067:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858680576 00000100:00100000:2.0:1746143133.274074:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858680576 00002000:00100000:2.0:1746143133.274106:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff880093b59f80 x1830962858680576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.274114:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59f80 with x1830962858680576 ext(5206016->5210111) 00002000:00010000:2.0:1746143133.274118:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59f80 00000100:00100000:2.0:1746143133.274144:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6052 00000100:00100000:2.0:1746143133.274151:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858680576:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.274889:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858680576:12345-192.168.201.28@tcp:3:cat.0 Request processed in 736us (1546us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143133.274896:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6052 00002000:00100000:2.0:1746143133.274901:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff880093b59f80 x1830962858680576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.274907:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59f80 with x1830962858680576 ext(5206016->5210111) 00002000:00010000:2.0:1746143133.274910:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59f80 00000100:00100000:0.0:1746143133.274940:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.275179:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858680832 00000100:00100000:2.0:1746143133.275184:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858680832 00002000:00100000:2.0:1746143133.275200:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3756032->3760127) req@ffff880093b58e00 x1830962858680832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.275208:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58e00 with x1830962858680832 ext(3756032->3760127) 00002000:00010000:2.0:1746143133.275211:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b58e00 00000100:00100000:2.0:1746143133.275255:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6053 00000100:00100000:2.0:1746143133.275261:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858680832:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.275346:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858680832:12345-192.168.201.28@tcp:3:cat.0 Request processed in 84us (409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143133.275352:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6053 00002000:00100000:2.0:1746143133.275357:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3756032->3760127) req@ffff880093b58e00 x1830962858680832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.275363:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58e00 with x1830962858680832 ext(3756032->3760127) 00002000:00010000:2.0:1746143133.275366:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b58e00 00000100:00100000:0.0:1746143133.282150:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.282253:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858681088 00000100:00100000:2.0:1746143133.282265:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858681088 00002000:00100000:2.0:1746143133.282312:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3903488->3907583) req@ffff880093b5ad80 x1830962858681088/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.282320:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5ad80 with x1830962858681088 ext(3903488->3907583) 00002000:00010000:2.0:1746143133.282325:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5ad80 00000100:00100000:2.0:1746143133.282360:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6054 00000100:00100000:2.0:1746143133.282368:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858681088:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.282533:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858681088:12345-192.168.201.28@tcp:3:cat.0 Request processed in 166us (395us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143133.282538:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6054 00002000:00100000:2.0:1746143133.282542:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3903488->3907583) req@ffff880093b5ad80 x1830962858681088/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.282547:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5ad80 with x1830962858681088 ext(3903488->3907583) 00002000:00010000:2.0:1746143133.282549:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5ad80 00000100:00100000:0.0:1746143133.373277:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.373388:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858681216 00000100:00100000:3.0:1746143133.373397:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858681216 00000100:00100000:3.0:1746143133.373499:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12459 00000100:00100000:3.0:1746143133.373506:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30984:x1830962858681216:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143133.373526:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.373543:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650466 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.373571:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.373581:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.373588:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.373590:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.373593:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3895296->4194303] (req 3895296->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.373623:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.373636:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 24 pid: 754 timeout: 1015 lvb_type: 1 00000100:00100000:3.0:1746143133.373648:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861265792:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.374155:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 15 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.374170:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 15 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.374180:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861265920:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.374203:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1f76900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.388689:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861265792:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.388703:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861265920:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.388732:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3895296->4194303] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.388749:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f13400, rc 0) 00000100:00100000:3.0:1746143133.388817:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30984:x1830962858681216:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 15310us (15551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.388825:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12459 00000100:00100000:0.0:1746143133.392192:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.392451:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858681344 00000100:00100000:1.0:1746143133.392461:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858681344 00010000:00010000:1.0:1746143133.392498:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 25 pid: 754 timeout: 1015 lvb_type: 1 00000100:00100000:1.0:1746143133.393007:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6597 00000100:00100000:1.0:1746143133.393017:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858681344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143133.393145:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143133.393303:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 25 pid: 754 timeout: 1015 lvb_type: 1 00010000:00010000:1.0:1746143133.393314:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 25 pid: 754 timeout: 1015 lvb_type: 1 00010000:00010000:1.0:1746143133.393337:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e2d600/0x25aee876ca70d5d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165042e expref: 25 pid: 754 timeout: 1015 lvb_type: 1 00010000:00010000:1.0:1746143133.393689:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143133.393742:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858681344:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 725us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.393750:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6597 00000100:00100000:0.0:1746143133.394251:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.394274:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858681472 00000100:00100000:0.0:1746143133.394277:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858681472 00010000:00010000:0.0:1746143133.394294:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 15 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.394321:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6598 00000100:00100000:0.0:1746143133.394326:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858681472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.394334:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.394343:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 15 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.394351:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 15 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.394365:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dbec00/0x25aee876ca70d5a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650412 expref: 15 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.394379:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.394381:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.394388:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 14 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.394396:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 14 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.394440:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 14 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.394754:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861266048:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143133.395278:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.397578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.397590:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861266048:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143133.397614:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.397644:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858681472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3317us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.397644:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858681728 00000100:00100000:1.0:1746143133.397648:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858681728 00000100:00100000:3.0:1746143133.397653:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6598 00002000:00100000:1.0:1746143133.397684:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3895296->3899391) req@ffff88009310df80 x1830962858681728/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.397694:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310df80 with x1830962858681728 ext(3895296->3899391) 00002000:00010000:1.0:1746143133.397698:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310df80 00000100:00100000:1.0:1746143133.398134:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6055 00000100:00100000:1.0:1746143133.398140:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858681728:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143133.398435:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858681728:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 293us (861us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143133.398445:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6055 00002000:00100000:1.0:1746143133.398451:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3895296->3899391) req@ffff88009310df80 x1830962858681728/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.398458:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310df80 with x1830962858681728 ext(3895296->3899391) 00002000:00010000:1.0:1746143133.398461:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310df80 00000100:00100000:0.0:1746143133.403262:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.403331:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858681856 00000100:00100000:3.0:1746143133.403339:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858681856 00000100:00100000:3.0:1746143133.403392:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12460 00000100:00100000:3.0:1746143133.403399:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:30984:x1830962858681856:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143133.403420:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.403439:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165046d expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.403472:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.403479:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143133.403481:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143133.403485:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4886527] (req 4194304->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 13 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.403514:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.403527:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 18 pid: 8169 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.403539:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861266176:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.403684:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5263000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.407972:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861266176:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.408007:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4886527] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 13 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.408026:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f12c00, rc 0) 00000100:00100000:3.0:1746143133.408110:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30984:x1830962858681856:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4709us (4857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.408121:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12460 00000100:00100000:0.0:1746143133.409212:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.409458:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858681984 00000100:00100000:3.0:1746143133.409465:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858681984 00010000:00010000:3.0:1746143133.409490:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 19 pid: 8169 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.409518:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6599 00000100:00100000:3.0:1746143133.409524:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858681984:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143133.409536:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143133.409556:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 19 pid: 8169 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.409567:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 19 pid: 8169 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.409588:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5350c00/0x25aee876ca70d60a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3907584->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650458 expref: 19 pid: 8169 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.409609:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.409611:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.409617:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.409625:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 12 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.409655:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 12 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.409665:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861266304:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143133.409717:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5263000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.411996:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861266304:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143133.412015:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.412091:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858681984:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2564us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.412101:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6599 00000100:00100000:0.0:1746143133.420412:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.420486:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858682240 00000100:00100000:1.0:1746143133.420496:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858682240 00002000:00100000:1.0:1746143133.420539:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4882432->4886527) req@ffff88009310dc00 x1830962858682240/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.420549:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310dc00 with x1830962858682240 ext(4882432->4886527) 00002000:00010000:1.0:1746143133.420556:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310dc00 00000100:00100000:1.0:1746143133.420586:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6056 00000100:00100000:1.0:1746143133.420594:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858682240:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143133.420788:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858682240:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 194us (386us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143133.420795:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6056 00002000:00100000:1.0:1746143133.420800:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4882432->4886527) req@ffff88009310dc00 x1830962858682240/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.420807:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310dc00 with x1830962858682240 ext(4882432->4886527) 00002000:00010000:1.0:1746143133.421011:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310dc00 00000100:00100000:0.0:1746143133.481191:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.482479:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858682368 00000100:00100000:3.0:1746143133.482491:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858682368 00000100:00100000:3.0:1746143133.482560:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12461 00000100:00100000:3.0:1746143133.482569:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858682368:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.482587:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.482606:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f12a00/0x25aee876ca70d626 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650474 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.482666:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861266432:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143133.482751:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5263000 going to sleep for 11 seconds 00002000:00010000:3.0:1746143133.485738:0:754:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143131 -> 1746143132 00002000:00010000:3.0:1746143133.485746:0:754:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143131 -> 1746143132 00002000:00010000:3.0:1746143133.485749:0:754:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143131 -> 1746143132 00000100:00100000:3.0:1746143133.485775:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861266432:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143133.485806:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f12a00/0x25aee876ca70d626 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650474 expref: 14 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.485821:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f12a00/0x25aee876ca70d626 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650474 expref: 14 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.485847:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f12a00, rc 0) 00000100:00100000:3.0:1746143133.486270:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858682368:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3700us (5088us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143133.486280:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12461 00000100:00100000:0.0:1746143133.515487:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.515550:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.515646:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858682624 00000100:00100000:1.0:1746143133.515655:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858682624 00002000:00100000:1.0:1746143133.515696:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009310f100 x1830962858682624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.515712:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310f100 with x1830962858682624 ext(1048576->2097151) 00002000:00010000:1.0:1746143133.515717:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310f100 00000100:00100000:1.0:1746143133.515954:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858682880 00000100:00100000:1.0:1746143133.515957:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858682880 00002000:00100000:1.0:1746143133.515971:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009310f480 x1830962858682880/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.515977:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310f480 with x1830962858682880 ext(1048576->2097151) 00002000:00010000:1.0:1746143133.515981:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310f480 00000100:00100000:1.0:1746143133.515994:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6057 00000100:00100000:1.0:1746143133.516001:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858682624:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.516185:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6058 00000100:00100000:2.0:1746143133.516194:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858682880:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:0.0:1746143133.528643:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143133.530235:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.536629:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.537687:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858683008 00000100:00100000:3.0:1746143133.537697:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858683008 00000100:00100000:3.0:1746143133.537758:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12462 00000100:00100000:3.0:1746143133.537768:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:30996:x1830962858683008:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143133.537785:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.537800:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165047b expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.537825:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 17 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.537832:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143133.537833:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143133.537837:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3657728->3674111] (req 3657728->3674111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 25 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.537863:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 17 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.537875:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.537888:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861266560:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.537969:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5263000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.538719:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.539916:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858683136 00000100:00100000:0.0:1746143133.539922:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858683136 00000100:00100000:3.0:1746143133.542162:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858682880:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25965us (26608us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.542172:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6058 00002000:00100000:3.0:1746143133.542182:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009310f480 x1830962858682880/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.542191:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310f480 with x1830962858682880 ext(1048576->2097151) 00002000:00010000:3.0:1746143133.542196:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310f480 00000100:00100000:3.0:1746143133.542242:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858683264 00000100:00100000:3.0:1746143133.542246:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858683264 00000100:00100000:3.0:1746143133.542268:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12463 00000100:00100000:3.0:1746143133.542274:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858683136:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.542285:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.542298:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5337a00/0x25aee876ca70d634 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650482 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.542348:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861266688:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143133.542395:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.542497:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12464 00000100:00100000:3.0:1746143133.542503:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858683264:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.542510:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.542517:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094df1a00/0x25aee876ca70d63b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650489 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.542538:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861266816:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143133.542560:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.543264:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.543279:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858683392 00000100:00100000:1.0:1746143133.543282:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858683392 00002000:00100000:1.0:1746143133.543301:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3895296->4194303) req@ffff880094511500 x1830962858683392/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.543308:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511500 with x1830962858683392 ext(3895296->4194303) 00010000:00010000:1.0:1746143133.543313:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.543323:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:1.0:1746143133.543329:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094511500 00000100:00100000:1.0:1746143133.543340:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1989 00000100:00100000:1.0:1746143133.543344:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858683392:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143133.543680:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861266560:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.543698:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3657728->3674111] (req 3657728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.543707:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f12600, rc 0) 00000100:00100000:3.0:1746143133.543730:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:30996:x1830962858683008:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5965us (13514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.543736:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12462 00000100:00100000:1.0:1746143133.545020:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858682624:12345-192.168.201.28@tcp:3:cat.0 Request processed in 29017us (29538us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143133.545130:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6057 00002000:00100000:1.0:1746143133.545139:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88009310f100 x1830962858682624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.545148:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310f100 with x1830962858682624 ext(1048576->2097151) 00002000:00010000:1.0:1746143133.545152:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310f100 00000100:00100000:3.0:1746143133.548309:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861266688:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143133.548340:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5337a00/0x25aee876ca70d634 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650482 expref: 19 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.548354:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5337a00/0x25aee876ca70d634 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650482 expref: 19 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.548367:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5337a00, rc 0) 00000100:00100000:3.0:1746143133.548401:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858683136:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6126us (11951us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143133.548409:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12463 00002000:00010000:2.0:1746143133.549577:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143131 -> 1746143132 00002000:00010000:2.0:1746143133.549581:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143131 -> 1746143132 00002000:00010000:2.0:1746143133.549583:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143131 -> 1746143132 00000100:00100000:2.0:1746143133.549593:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861266816:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143133.549610:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094df1a00/0x25aee876ca70d63b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650489 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.549625:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094df1a00/0x25aee876ca70d63b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650489 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.549642:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094df1a00, rc 0) 00000100:00100000:2.0:1746143133.549663:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858683264:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7160us (10946us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143133.549668:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12464 00000100:00100000:0.0:1746143133.562691:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.562733:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.562807:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858683520 00000100:00100000:3.0:1746143133.562819:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858683520 00000100:00100000:3.0:1746143133.562858:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858683648 00000100:00100000:3.0:1746143133.562860:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858683648 00000100:00100000:3.0:1746143133.562879:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12465 00000100:00100000:3.0:1746143133.562887:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858683520:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.562902:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.562916:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70d642 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650490 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.562962:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861266944:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143133.563059:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.563078:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12466 00000100:00100000:3.0:1746143133.563084:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858683648:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.563091:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.563100:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a472c800/0x25aee876ca70d649 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650497 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.563121:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861267072:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143133.563148:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.564056:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858683392:12345-192.168.201.28@tcp:4:cat.0 Request processed in 20707us (20789us total) trans 17179872785 rc 0/0 00000100:00100000:1.0:1746143133.564066:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1989 00002000:00100000:1.0:1746143133.564076:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3895296->4194303) req@ffff880094511500 x1830962858683392/t17179872785(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.564085:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511500 with x1830962858683392 ext(3895296->4194303) 00010000:00010000:1.0:1746143133.564092:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.564104:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:1.0:1746143133.564111:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094511500 00000100:00100000:0.0:1746143133.565742:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861267072:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143133.565760:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861266944:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143133.565776:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a472c800/0x25aee876ca70d649 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650497 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.565788:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70d642 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650490 expref: 19 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.565790:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a472c800/0x25aee876ca70d649 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650497 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.565800:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70d642 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650490 expref: 19 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.565811:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a472c800, rc 0) 00010000:00010000:3.0:1746143133.565843:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f13200, rc 0) 00000100:00100000:0.0:1746143133.565851:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858683648:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2766us (3118us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143133.565858:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12466 00000100:00100000:3.0:1746143133.565872:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858683520:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2985us (3194us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143133.565880:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12465 00000100:00100000:0.0:1746143133.575077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.576909:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858683776 00000100:00100000:2.0:1746143133.576922:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858683776 00000100:00100000:2.0:1746143133.576982:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12467 00000100:00100000:2.0:1746143133.576990:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:30993:x1830962858683776:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.577010:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.577053:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165049e expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.577083:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.577085:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.577093:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 14 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.577107:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 14 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.577117:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fcea00, rc 0) 00000100:00100000:2.0:1746143133.577173:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30993:x1830962858683776:12345-192.168.201.28@tcp:101:cat.0 Request processed in 183us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.577183:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12467 00000100:00100000:0.0:1746143133.578577:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.578642:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858683904 00000100:00100000:0.0:1746143133.578651:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.578654:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858683904 00000100:00100000:3.0:1746143133.578709:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12468 00000100:00100000:3.0:1746143133.578716:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30998:x1830962858683904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.578732:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.578747:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504a5 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.578767:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.578769:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.578776:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 19 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.578789:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 19 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.578797:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a472c800, rc 0) 00000100:00100000:3.0:1746143133.578850:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30998:x1830962858683904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 134us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.578856:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12468 00000100:00100000:2.0:1746143133.579175:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858684032 00000100:00100000:2.0:1746143133.579181:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858684032 00010000:00010000:2.0:1746143133.579209:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.579255:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6600 00000100:00100000:2.0:1746143133.579261:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858684032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.579273:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.579309:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.579322:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.579342:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f13400/0x25aee876ca70d618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650466 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.579367:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.579368:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.579374:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.579383:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 24 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.579609:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 24 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.583687:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.583759:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858684288 00000100:00100000:1.0:1746143133.583770:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858684288 00002000:00100000:1.0:1746143133.583818:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880091949880 x1830962858684288/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.583829:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949880 with x1830962858684288 ext(2097152->3145727) 00002000:00010000:1.0:1746143133.583835:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091949880 00000100:00100000:1.0:1746143133.584728:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6059 00000100:00100000:1.0:1746143133.584740:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858684288:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143133.586832:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.586863:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858684544 00000100:00100000:0.0:1746143133.586870:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858684544 00002000:00100000:0.0:1746143133.586913:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009194bb80 x1830962858684544/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143133.586923:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194bb80 with x1830962858684544 ext(2097152->3145727) 00002000:00010000:0.0:1746143133.586929:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194bb80 00000100:00100000:0.0:1746143133.586955:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6060 00000100:00100000:0.0:1746143133.586962:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858684544:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.589841:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861267200:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143133.590312:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.601259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.601620:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861267200:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143133.601641:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.601694:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858684032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 22432us (23042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.601705:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6600 00000100:00100000:1.0:1746143133.605318:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858684288:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20574us (21633us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143133.605329:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6059 00002000:00100000:1.0:1746143133.605340:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880091949880 x1830962858684288/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.605349:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949880 with x1830962858684288 ext(2097152->3145727) 00002000:00010000:1.0:1746143133.605355:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091949880 00000100:00100000:2.0:1746143133.605868:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858684800 00000100:00100000:2.0:1746143133.605876:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858684800 00002000:00100000:2.0:1746143133.606113:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3657728->3661823) req@ffff880091948e00 x1830962858684800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.606122:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948e00 with x1830962858684800 ext(3657728->3661823) 00002000:00010000:2.0:1746143133.606125:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091948e00 00000100:00100000:2.0:1746143133.606143:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6061 00000100:00100000:2.0:1746143133.606148:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858684800:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.606267:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858684800:12345-192.168.201.28@tcp:3:cat.0 Request processed in 119us (5016us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143133.606273:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6061 00002000:00100000:2.0:1746143133.606277:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3657728->3661823) req@ffff880091948e00 x1830962858684800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.606285:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948e00 with x1830962858684800 ext(3657728->3661823) 00002000:00010000:2.0:1746143133.606287:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091948e00 00000100:00100000:0.0:1746143133.612485:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.612847:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858685056 00000100:00100000:1.0:1746143133.612856:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858685056 00002000:00100000:1.0:1746143133.613110:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3670016->3674111) req@ffff880091948a80 x1830962858685056/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.613120:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948a80 with x1830962858685056 ext(3670016->3674111) 00002000:00010000:1.0:1746143133.613125:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091948a80 00000100:00100000:1.0:1746143133.613159:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6062 00000100:00100000:1.0:1746143133.613166:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858685056:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143133.613310:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858685056:12345-192.168.201.28@tcp:3:cat.0 Request processed in 144us (833us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143133.613317:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6062 00002000:00100000:1.0:1746143133.613324:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3670016->3674111) req@ffff880091948a80 x1830962858685056/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.613335:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948a80 with x1830962858685056 ext(3670016->3674111) 00002000:00010000:1.0:1746143133.613337:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091948a80 00000100:00100000:2.0:1746143133.613620:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858684544:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26656us (26793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143133.613628:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6060 00002000:00100000:2.0:1746143133.613636:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009194bb80 x1830962858684544/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.613643:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194bb80 with x1830962858684544 ext(2097152->3145727) 00002000:00010000:2.0:1746143133.613647:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194bb80 00000100:00100000:0.0:1746143133.616391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.616477:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858685312 00000100:00100000:2.0:1746143133.616483:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858685312 00002000:00100000:2.0:1746143133.616518:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009194b480 x1830962858685312/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.616528:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194b480 with x1830962858685312 ext(2097152->3145727) 00002000:00010000:2.0:1746143133.616532:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009194b480 00000100:00100000:2.0:1746143133.616563:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6063 00000100:00100000:2.0:1746143133.616570:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858685312:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143133.621251:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.621422:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858685440 00000100:00100000:2.0:1746143133.621431:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858685440 00000100:00100000:2.0:1746143133.621525:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12469 00000100:00100000:2.0:1746143133.621534:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30993:x1830962858685440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.621548:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.621565:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504ac expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.621590:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 26 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.621597:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143133.621599:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143133.621602:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.621629:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 26 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.621645:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 26 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.621657:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861267328:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.621980:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.637239:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.637272:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858685568 00000100:00100000:3.0:1746143133.637282:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858685568 00002000:00100000:3.0:1746143133.637321:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3657728->3674111) req@ffff880091949500 x1830962858685568/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 16872/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.637331:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949500 with x1830962858685568 ext(3657728->3674111) 00010000:00010000:3.0:1746143133.637339:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.637352:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:3.0:1746143133.637359:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091949500 00000100:00100000:3.0:1746143133.637375:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1990 00000100:00100000:3.0:1746143133.637382:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858685568:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143133.637662:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861267328:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.637685:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.637697:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fcf800, rc 0) 00000100:00100000:2.0:1746143133.637748:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:30993:x1830962858685440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 16215us (16508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.637755:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12469 00000100:00100000:3.0:1746143133.638008:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858685568:12345-192.168.201.28@tcp:4:cat.0 Request processed in 624us (791us total) trans 17179872786 rc 0/0 00000100:00100000:3.0:1746143133.638015:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1990 00002000:00100000:3.0:1746143133.638021:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3657728->3674111) req@ffff880091949500 x1830962858685568/t17179872786(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 16872/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.638049:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949500 with x1830962858685568 ext(3657728->3674111) 00010000:00010000:3.0:1746143133.638054:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 29 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.638064:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 29 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:3.0:1746143133.638070:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091949500 00000100:00100000:3.0:1746143133.638905:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858685312:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22332us (22517us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.638912:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6063 00002000:00100000:3.0:1746143133.638917:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009194b480 x1830962858685312/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.638924:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194b480 with x1830962858685312 ext(2097152->3145727) 00010000:00010000:3.0:1746143133.638929:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.638938:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:3.0:1746143133.638943:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009194b480 00000100:00100000:0.0:1746143133.646886:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.646998:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858685696 00000100:00100000:2.0:1746143133.647007:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858685696 00000100:00100000:2.0:1746143133.647105:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12470 00000100:00100000:2.0:1746143133.647113:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30998:x1830962858685696:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.647130:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.647145:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504b3 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.647171:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.647183:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143133.647185:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143133.647188:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.647229:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.647237:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 20 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.647247:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861267456:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.648493:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.681493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.681538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.681593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.681647:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861267456:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143133.681674:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.681695:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5337600, rc 0) 00000100:00100000:0.0:1746143133.681737:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30998:x1830962858685696:12345-192.168.201.28@tcp:101:cat.0 Request processed in 34625us (34860us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.681745:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12470 00000100:00100000:0.0:1746143133.681770:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858685952 00000100:00100000:0.0:1746143133.681775:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858685952 00000100:00100000:0.0:1746143133.681800:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12471 00000100:00100000:0.0:1746143133.681806:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31002:x1830962858685952:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143133.681817:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143133.681830:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504ba expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.681848:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 19 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.681856:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 15 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.681862:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 6 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.681868:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.681869:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.681872:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1216512->1605631] (req 1216512->1605631) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.681898:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 6 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.681907:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 6 pid: 22204 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.681917:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861267584:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143133.681974:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 15 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.681980:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 15 pid: 4758 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.681988:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861267712:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143133.682005:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 19 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.682011:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 19 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.682018:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861267840:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.682047:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.682076:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858686080 00000100:00100000:0.0:1746143133.682079:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858686080 00002000:00100000:0.0:1746143133.682101:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3756032->3907583) req@ffff880091949180 x1830962858686080/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143133.682110:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949180 with x1830962858686080 ext(3756032->3907583) 00010000:00010000:0.0:1746143133.682116:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 20 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.682125:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 20 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:0.0:1746143133.682130:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091949180 00000100:00100000:0.0:1746143133.682141:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1991 00000100:00100000:0.0:1746143133.682146:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858686080:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143133.682403:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858685824 00000100:00100000:2.0:1746143133.682407:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858685824 00010000:00010000:2.0:1746143133.682423:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.682440:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6601 00000100:00100000:2.0:1746143133.682444:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858685824:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.682451:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.682464:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.682472:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.682487:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f12600/0x25aee876ca70d62d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->3674111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165047b expref: 27 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.682498:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.682500:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.682702:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.682710:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.682726:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 15 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.682734:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861267968:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143133.682764:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143133.702190:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.702205:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.703782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.703804:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858686208 00000100:00100000:2.0:1746143133.703811:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858686208 00010000:00010000:2.0:1746143133.703841:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 7 pid: 22204 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.703863:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858686336 00000100:00100000:2.0:1746143133.703866:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858686336 00010000:00010000:2.0:1746143133.703875:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 16 pid: 4758 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.703887:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858686464 00000100:00100000:2.0:1746143133.703889:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858686464 00010000:00010000:2.0:1746143133.703896:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 22 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.703907:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6602 00000100:00100000:2.0:1746143133.703914:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858686208:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.703924:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143133.703930:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6603 00010000:00010000:2.0:1746143133.703942:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 7 pid: 22204 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.703947:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858686336:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.703952:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 7 pid: 22204 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.703964:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.703976:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143133.703991:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 16 pid: 4758 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.704003:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 16 pid: 4758 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.704019:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858686208:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 98us (1828us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143133.704022:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.704027:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6602 00000100:00100000:2.0:1746143133.704062:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6604 00000100:00100000:2.0:1746143133.704068:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858686464:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.704075:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.704083:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 22 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.704096:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 22 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.704108:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.704110:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.704116:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.704124:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 16 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.704187:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858686336:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 246us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.704193:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6603 00000100:00100000:0.0:1746143133.704338:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.704643:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858686720 00000100:00100000:0.0:1746143133.704648:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858686720 00010000:00010000:2.0:1746143133.704651:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.704664:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861268096:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143133.704715:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.704996:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858686080:12345-192.168.201.28@tcp:4:cat.0 Request processed in 22620us (23173us total) trans 21474840046 rc 0/0 00000100:00100000:1.0:1746143133.705005:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1991 00002000:00100000:1.0:1746143133.705014:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3756032->3907583) req@ffff880091949180 x1830962858686080/t21474840046(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.705023:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091949180 with x1830962858686080 ext(3756032->3907583) 00010000:00010000:1.0:1746143133.705044:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 23 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.705057:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 23 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:1.0:1746143133.705064:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091949180 00002000:00100000:0.0:1746143133.705281:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009ae2d880 x1830962858686720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143133.705291:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2d880 with x1830962858686720 ext(2097152->3145727) 00002000:00010000:0.0:1746143133.705295:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae2d880 00000100:00100000:0.0:1746143133.705313:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6064 00000100:00100000:0.0:1746143133.705319:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858686720:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143133.706631:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861267968:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143133.706640:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e57e400/0x25aee876ca70d404 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650332 expref: 6 pid: 22204 timeout: 1015 lvb_type: 1 00010000:00010000:3.0:1746143133.706648:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.706665:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861267584:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.706672:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858685824:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 24227us (25132us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143133.706679:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4000/0x25aee876ca70d490 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165036a expref: 15 pid: 4758 timeout: 1015 lvb_type: 1 00000100:00100000:3.0:1746143133.706680:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6601 00000100:00100000:2.0:1746143133.706688:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861267712:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.706698:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81da00/0x25aee876ca70d3d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165030f expref: 22 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.706706:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861267840:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.706731:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 14 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.706741:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81de00, rc 0) 00000100:00100000:2.0:1746143133.706762:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31002:x1830962858685952:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 24956us (25277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.706769:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12471 00000100:00100000:3.0:1746143133.709203:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.709290:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.709329:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858686848 00000100:00100000:3.0:1746143133.709335:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858686848 00000100:00100000:2.0:1746143133.709341:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861268096:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143133.709355:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143133.709362:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 22 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.709387:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858686464:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5318us (5609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.709393:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6605 00000100:00100000:3.0:1746143133.709399:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858686848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143133.709410:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143133.709431:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 22 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.709443:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 22 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.709465:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b430fe00/0x25aee876ca70d5fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [3756032->3907583] (req 3756032->3907583) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165044a expref: 22 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.709485:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.709487:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.709494:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 21 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.709501:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 21 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.709528:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 21 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.709543:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861268224:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143133.709587:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.709672:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858687104 00000100:00100000:1.0:1746143133.709678:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858687104 00002000:00100000:1.0:1746143133.709705:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1216512->1220607) req@ffff88008eaaf800 x1830962858687104/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.709712:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaaf800 with x1830962858687104 ext(1216512->1220607) 00002000:00010000:1.0:1746143133.709716:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaaf800 00000100:00100000:1.0:1746143133.709738:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6065 00000100:00100000:1.0:1746143133.709742:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858687104:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143133.709849:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858687104:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 107us (560us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143133.709854:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6065 00002000:00100000:1.0:1746143133.709858:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1216512->1220607) req@ffff88008eaaf800 x1830962858687104/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.709863:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaaf800 with x1830962858687104 ext(1216512->1220607) 00002000:00010000:1.0:1746143133.709865:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaaf800 00000100:00100000:2.0:1746143133.710274:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6604 00000100:00100000:3.0:1746143133.713796:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861268224:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143133.713817:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.713851:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858686848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4450us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.713861:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6605 00000100:00100000:0.0:1746143133.718941:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.719013:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858687360 00000100:00100000:1.0:1746143133.719021:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858687360 00002000:00100000:1.0:1746143133.719179:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2ea00 x1830962858687360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.719188:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2ea00 with x1830962858687360 ext(3145728->4194303) 00002000:00010000:1.0:1746143133.719193:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2ea00 00000100:00100000:1.0:1746143133.719237:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6066 00000100:00100000:1.0:1746143133.719245:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858687360:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143133.721327:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858686720:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 15889us (16870us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.721339:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6064 00002000:00100000:3.0:1746143133.721351:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009ae2d880 x1830962858686720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.721360:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2d880 with x1830962858686720 ext(2097152->3145727) 00002000:00010000:3.0:1746143133.721366:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae2d880 00000100:00100000:0.0:1746143133.726193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.727158:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858687616 00000100:00100000:3.0:1746143133.727167:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858687616 00002000:00100000:3.0:1746143133.727205:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1601536->1605631) req@ffff88009ae2f800 x1830962858687616/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.727228:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2f800 with x1830962858687616 ext(1601536->1605631) 00002000:00010000:3.0:1746143133.727234:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2f800 00000100:00100000:3.0:1746143133.727261:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6067 00000100:00100000:3.0:1746143133.727269:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858687616:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143133.727429:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858687616:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 161us (1242us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143133.727436:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6067 00002000:00100000:3.0:1746143133.727442:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1601536->1605631) req@ffff88009ae2f800 x1830962858687616/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.727450:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2f800 with x1830962858687616 ext(1601536->1605631) 00002000:00010000:3.0:1746143133.727453:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2f800 00000100:00100000:1.0:1746143133.732408:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.732501:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858687744 00000100:00100000:2.0:1746143133.732510:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858687744 00000100:00100000:2.0:1746143133.732561:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12472 00000100:00100000:2.0:1746143133.732568:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:30993:x1830962858687744:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.732585:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.732601:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504c1 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.732622:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.732624:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.732631:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.732643:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.732652:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094257c00, rc 0) 00000100:00100000:2.0:1746143133.732704:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:30993:x1830962858687744:12345-192.168.201.28@tcp:101:cat.0 Request processed in 135us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.732711:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12472 00000100:00100000:2.0:1746143133.735659:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858687360:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16408us (16718us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143133.735669:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6066 00002000:00100000:2.0:1746143133.735678:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2ea00 x1830962858687360/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.735687:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2ea00 with x1830962858687360 ext(3145728->4194303) 00002000:00010000:2.0:1746143133.735692:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2ea00 00000100:00100000:0.0:1746143133.743816:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.743942:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858688000 00000100:00100000:2.0:1746143133.743949:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858688000 00002000:00100000:2.0:1746143133.743985:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2c000 x1830962858688000/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.743994:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c000 with x1830962858688000 ext(3145728->4194303) 00002000:00010000:2.0:1746143133.743999:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2c000 00000100:00100000:2.0:1746143133.744028:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6068 00000100:00100000:2.0:1746143133.744062:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858688000:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143133.746293:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.747126:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858688256 00000100:00100000:3.0:1746143133.747144:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858688256 00002000:00100000:3.0:1746143133.747178:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ae2ed80 x1830962858688256/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.747188:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2ed80 with x1830962858688256 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.747193:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae2ed80 00000100:00100000:3.0:1746143133.747233:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6069 00000100:00100000:3.0:1746143133.747240:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858688256:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143133.749180:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.749329:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858688384 00000100:00100000:3.0:1746143133.749334:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858688384 00000100:00100000:3.0:1746143133.749376:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12473 00000100:00100000:3.0:1746143133.749383:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:30998:x1830962858688384:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.749393:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.749408:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504c8 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.749428:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.749430:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.749437:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 27 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.749451:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 27 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.749460:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a472de00, rc 0) 00000100:00100000:3.0:1746143133.749503:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:30998:x1830962858688384:12345-192.168.201.28@tcp:101:cat.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.749509:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12473 00000100:00100000:1.0:1746143133.754540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.754609:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858688512 00000100:00100000:3.0:1746143133.754618:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858688512 00000100:00100000:3.0:1746143133.754675:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8186 00000100:00100000:3.0:1746143133.754683:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:31004:x1830962858688512:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143133.754701:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.754716:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a472ca00/0x25aee876ca70d681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504cf expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.754765:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.754777:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.754787:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.755016:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.755025:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.755056:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.755148:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.755159:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 26 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.755166:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 217 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.755172:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.755201:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 217 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.755227:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 217 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.755240:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861268352:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.755333:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 26 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.755342:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 26 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.755355:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861268480:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.755377:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.755864:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.756310:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858688768 00000100:00100000:3.0:1746143133.756315:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858688768 00000100:00100000:2.0:1746143133.756326:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858688000:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 12264us (12515us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143133.756334:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6068 00002000:00100000:3.0:1746143133.756338:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800942c5c00 x1830962858688768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.756340:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2c000 x1830962858688000/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.756347:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5c00 with x1830962858688768 ext(3145728->4194303) 00002000:00100000:2.0:1746143133.756347:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c000 with x1830962858688000 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.756351:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c5c00 00002000:00010000:2.0:1746143133.756351:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2c000 00000100:00100000:3.0:1746143133.756369:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6070 00000100:00100000:3.0:1746143133.756374:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858688768:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143133.759637:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858688256:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 12391us (13343us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.759647:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6069 00002000:00100000:3.0:1746143133.759655:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ae2ed80 x1830962858688256/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.759663:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2ed80 with x1830962858688256 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.759668:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae2ed80 00000100:00100000:1.0:1746143133.760417:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.761363:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861268352:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.761374:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861268480:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.761397:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143133.762351:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858689024 00000100:00100000:0.0:1746143133.762359:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858689024 00000100:00100000:0.0:1746143133.762424:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3460 00000100:00100000:0.0:1746143133.762431:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+218:26840:x1830962858689024:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143133.762647:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+219:26840:x1830962858689024:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 215us (2230us total) trans 8589942397 rc 0/0 00000100:00100000:0.0:1746143133.762653:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3460 00000100:00100000:1.0:1746143133.763252:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.763284:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858689280 00000100:00100000:0.0:1746143133.763288:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858689280 00000100:00100000:0.0:1746143133.763315:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3461 00000100:00100000:0.0:1746143133.763320:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:15437:x1830962858689280:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143133.763411:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:15437:x1830962858689280:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 89us (771us total) trans 8589942398 rc 0/0 00000100:00100000:0.0:1746143133.763420:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3461 00000100:00100000:0.0:1746143133.769739:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.770969:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.771067:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.771087:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858689536 00000100:00100000:2.0:1746143133.771095:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858689536 00010000:00010000:2.0:1746143133.771125:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 219 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.771551:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858689664 00000100:00100000:2.0:1746143133.771555:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858689664 00010000:00010000:2.0:1746143133.771569:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 28 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.771607:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6606 00000100:00100000:2.0:1746143133.771766:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6607 00000100:00100000:2.0:1746143133.771774:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858689664:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.771787:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.771793:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 28 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:1.0:1746143133.771802:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+219:1968:x1830962858689536:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.771804:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 28 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.771811:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143133.771817:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 219 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.771822:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dbfc00/0x25aee876ca70d5bd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650420 expref: 28 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.771827:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 219 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.772091:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70d5e0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650435 expref: 219 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.772107:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143133.772111:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143133.772120:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143133.772346:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858689408 00000100:00100000:3.0:1746143133.772351:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858689408 00000100:00100000:3.0:1746143133.772379:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12474 00000100:00100000:3.0:1746143133.772385:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858689408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.772398:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.772409:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d409400/0x25aee876ca70d69d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504d6 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.772450:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861268608:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143133.772532:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea240 going to sleep for 11 seconds 00010000:00010000:1.0:1746143133.773085:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143133.773097:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143133.773102:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143133.773121:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.773131:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858689664:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1358us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.773138:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6607 00000100:00100000:1.0:1746143133.773142:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+218:1968:x1830962858689536:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1527us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.773148:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6606 00010000:00010000:3.0:1746143133.773492:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773499:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:3.0:1746143133.773535:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143133.773539:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143133.773555:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773564:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773573:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773579:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773585:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773590:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fcfc00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143133.773595:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773602:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773610:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143133.773613:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143133.773616:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773620:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fcfc00/0x25aee876ca70d688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773644:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773650:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773655:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773659:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fce400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143133.773662:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773666:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773673:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531e00) 00010000:00010000:3.0:1746143133.773675:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143133.773678:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773686:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fce400/0x25aee876ca70d68f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.773715:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a472ca00/0x25aee876ca70d681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.773725:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.773731:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143133.773733:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143133.773735:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4984200, rc 0) 00000100:00100000:3.0:1746143133.773760:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:31004:x1830962858688512:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 19078us (19228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.773766:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8186 00000100:00100000:3.0:1746143133.775089:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858688768:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18711us (19222us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143133.775098:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6070 00002000:00100000:3.0:1746143133.775107:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800942c5c00 x1830962858688768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143133.775115:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c5c00 with x1830962858688768 ext(3145728->4194303) 00002000:00010000:3.0:1746143133.775120:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c5c00 00000100:00100000:0.0:1746143133.776924:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861268608:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143133.776953:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d409400/0x25aee876ca70d69d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504d6 expref: 16 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.776966:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d409400/0x25aee876ca70d69d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504d6 expref: 16 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.776985:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409400, rc 0) 00000100:00100000:1.0:1746143133.777050:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858689408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4663us (7315us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143133.777059:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12474 00000100:00100000:0.0:1746143133.777838:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.777881:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858689792 00000100:00100000:1.0:1746143133.777887:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858689792 00000100:00100000:1.0:1746143133.777923:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12475 00000100:00100000:1.0:1746143133.777930:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858689792:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143133.777942:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.777955:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504dd expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.777971:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.777973:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.777980:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 6 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.777993:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 6 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.778001:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490da00, rc 0) 00000100:00100000:1.0:1746143133.778061:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858689792:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 130us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.778067:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12475 00000100:00100000:0.0:1746143133.781688:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.782157:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858690048 00000100:00100000:1.0:1746143133.782164:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858690048 00000100:00100000:1.0:1746143133.782225:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12476 00000100:00100000:1.0:1746143133.782231:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858690048:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143133.782247:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.782267:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009490d800/0x25aee876ca70d6ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504eb expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143133.782315:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861268736:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143133.782392:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.783282:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.783301:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.783321:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.783341:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858690304 00000100:00100000:1.0:1746143133.783345:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858690304 00000100:00100000:0.0:1746143133.783354:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.783363:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858689920 00000100:00100000:1.0:1746143133.783365:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858689920 00000100:00100000:1.0:1746143133.783375:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858690176 00000100:00100000:1.0:1746143133.783377:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858690176 00000100:00100000:1.0:1746143133.783388:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12477 00000100:00100000:1.0:1746143133.783393:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858690304:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143133.783401:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.783410:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504f9 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.783412:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12478 00000100:00100000:2.0:1746143133.783420:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858689920:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143133.783421:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.783423:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.783426:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.783430:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143133.783432:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12479 00010000:00010000:2.0:1746143133.783433:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504e4 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.783441:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858690176:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143133.783442:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.783443:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.783443:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.783448:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.783449:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.783453:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490c000, rc 0) 00010000:00010000:2.0:1746143133.783455:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.783458:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d408c00/0x25aee876ca70d6c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16504f2 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.783460:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094257600, rc 0) 00000100:00100000:1.0:1746143133.783477:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858690304:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.783481:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858689920:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.783483:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861268864:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143133.783483:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12477 00000100:00100000:2.0:1746143133.783485:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12478 00000100:00100000:2.0:1746143133.783550:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858690560 00000100:00100000:2.0:1746143133.783553:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858690560 00002000:00100000:2.0:1746143133.783578:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4886528->5210111) req@ffff88009ae2e680 x1830962858690560/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.783587:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2e680 with x1830962858690560 ext(4886528->5210111) 00002000:00010000:2.0:1746143133.783590:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2e680 00000100:00100000:2.0:1746143133.783603:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6071 00000100:00100000:2.0:1746143133.783608:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858690560:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143133.784053:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.791238:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.791280:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.791395:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858690688 00000100:00100000:2.0:1746143133.791403:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858690688 00000100:00100000:2.0:1746143133.791443:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858690816 00000100:00100000:2.0:1746143133.791446:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858690816 00002000:00010000:1.0:1746143133.791458:0:10061:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143131 -> 1746143132 00000100:00100000:2.0:1746143133.791462:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12480 00002000:00010000:1.0:1746143133.791462:0:10061:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143131 -> 1746143132 00002000:00010000:1.0:1746143133.791464:0:10061:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143131 -> 1746143132 00000100:00100000:2.0:1746143133.791469:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858690688:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.791483:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143133.791483:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861268736:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143133.791498:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094257400/0x25aee876ca70d6c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650500 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.791511:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009490d800/0x25aee876ca70d6ab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504eb expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.791528:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009490d800/0x25aee876ca70d6ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504eb expref: 9 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143133.791540:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861268992:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143133.791542:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490d800, rc 0) 00000100:00100000:2.0:1746143133.791604:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.791621:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12481 00000100:00100000:3.0:1746143133.791629:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858690816:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.791637:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.791645:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70d6ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650507 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.792027:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861269120:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143133.792300:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858690048:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 10067us (10616us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143133.792305:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858690560:12345-192.168.201.28@tcp:3:cat.0 Request processed in 8694us (8948us total) trans 0 rc 323584/323584 00000100:00100000:1.0:1746143133.792307:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12476 00000100:00100000:2.0:1746143133.792313:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6071 00002000:00100000:2.0:1746143133.792322:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4886528->5210111) req@ffff88009ae2e680 x1830962858690560/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 323584/323584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.792330:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2e680 with x1830962858690560 ext(4886528->5210111) 00002000:00010000:2.0:1746143133.792334:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2e680 00000100:00100000:3.0:1746143133.792604:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.792953:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861268864:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143133.792968:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d408c00/0x25aee876ca70d6c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f2 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.792978:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d408c00/0x25aee876ca70d6c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f2 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.792989:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d408c00, rc 0) 00000100:00100000:3.0:1746143133.793007:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858690176:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 9568us (9686us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143133.793013:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12479 00000100:00100000:3.0:1746143133.799095:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861269120:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143133.799095:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861268992:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143133.799125:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70d6ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650507 expref: 23 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.799125:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094257400/0x25aee876ca70d6c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650500 expref: 23 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.799139:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d408a00/0x25aee876ca70d6ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650507 expref: 23 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.799139:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094257400/0x25aee876ca70d6c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650500 expref: 23 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.799157:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d408a00, rc 0) 00010000:00010000:2.0:1746143133.799168:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094257400, rc 0) 00000100:00100000:3.0:1746143133.799203:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858690816:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7567us (7915us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143133.799221:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12481 00000100:00100000:2.0:1746143133.799977:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858690688:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8507us (8745us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143133.799984:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12480 00000100:00100000:0.0:1746143133.800189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.800289:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.800430:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858691200 00000100:00100000:3.0:1746143133.800436:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858691200 00000100:00100000:3.0:1746143133.800476:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8187 00000100:00100000:3.0:1746143133.800482:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:31004:x1830962858691200:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143133.800497:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.800509:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70d6d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650515 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.800581:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.800595:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.800601:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.800629:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.800640:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 14 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.800822:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858690944 00000100:00100000:2.0:1746143133.800826:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858690944 00000100:00100000:3.0:1746143133.800853:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861269248:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.800948:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12482 00000100:00100000:2.0:1746143133.800956:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858690944:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.800969:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.800978:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094256400/0x25aee876ca70d6e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165050e expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.801005:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861269376:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143133.801134:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143133.803195:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.805664:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.805752:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858691328 00000100:00100000:2.0:1746143133.805760:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858691328 00000100:00100000:2.0:1746143133.806176:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12483 00000100:00100000:2.0:1746143133.806184:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:30998:x1830962858691328:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143133.806198:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.806224:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165051c expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.806250:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.806258:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143133.806260:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143133.806263:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.806290:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.806300:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.806311:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861269504:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.806713:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.807055:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861269248:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.807074:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:2.0:1746143133.807184:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861269376:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143133.807208:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094256400/0x25aee876ca70d6e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165050e expref: 16 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.807232:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094256400/0x25aee876ca70d6e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165050e expref: 16 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.807377:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094256400, rc 0) 00000100:00100000:2.0:1746143133.807413:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858690944:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6457us (7123us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143133.807419:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12482 00000100:00100000:2.0:1746143133.807463:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.807794:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858691456 00000100:00100000:3.0:1746143133.807799:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858691456 00010000:00010000:3.0:1746143133.808020:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 15 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.808060:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6608 00000100:00100000:3.0:1746143133.808067:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1969:x1830962858691456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143133.808075:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143133.808081:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 15 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.808090:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 15 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.808106:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4984200/0x25aee876ca70d696 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504cf expref: 15 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.808124:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143133.808129:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.808137:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.808142:0:16965:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.808155:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143133.808264:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143133.808270:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143133.808286:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143133.808593:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408400/0x25aee876ca70d6d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650515 expref: 16 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.808605:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650515 expref: 15 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.808610:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143133.808613:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143133.808615:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409c00, rc 0) 00000100:00100000:3.0:1746143133.809095:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1969:x1830962858691456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1027us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.809103:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6608 00000100:00100000:2.0:1746143133.809421:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:31004:x1830962858691200:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 8937us (9231us total) trans 8589942399 rc 0/0 00000100:00100000:2.0:1746143133.809428:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8187 00000100:00100000:3.0:1746143133.809775:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861269504:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.809793:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 21 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.809805:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f8a000, rc 0) 00000100:00100000:3.0:1746143133.809824:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:30998:x1830962858691328:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3642us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.809831:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12483 00000100:00100000:0.0:1746143133.810491:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.810523:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.810573:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858691584 00000100:00100000:3.0:1746143133.810578:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858691584 00000100:00100000:3.0:1746143133.810600:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12484 00000100:00100000:3.0:1746143133.810605:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858691584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.810616:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.810627:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d409800/0x25aee876ca70d6f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650523 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.810661:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861269632:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143133.810746:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858691712 00000100:00100000:2.0:1746143133.810749:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858691712 00002000:00100000:2.0:1746143133.810772:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4886527) req@ffff8800906a6d80 x1830962858691712/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.810780:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6d80 with x1830962858691712 ext(4194304->4886527) 00010000:00010000:2.0:1746143133.810785:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.810795:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:2.0:1746143133.810801:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a6d80 00000100:00100000:2.0:1746143133.810814:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1992 00000100:00100000:2.0:1746143133.810819:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858691712:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143133.811681:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.814767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.814920:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858691968 00000100:00100000:3.0:1746143133.814927:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858691968 00000100:00100000:3.0:1746143133.814964:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8188 00000100:00100000:3.0:1746143133.814971:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:31004:x1830962858691968:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143133.814990:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.814993:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143133.815013:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409c00/0x25aee876ca70d6dc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650515 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.815027:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143133.815075:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143133.815091:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70d6ff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165052a expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.815167:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.815178:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143133.815186:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:3.0:1746143133.815196:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143133.815299:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d409e00/0x25aee876ca70d6ff lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 16 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.815310:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 15 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.815316:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143133.815319:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143133.815321:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d408a00, rc 0) 00000100:00100000:3.0:1746143133.815353:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:31004:x1830962858691968:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 382us (592us total) trans 8589942400 rc 0/0 00000100:00100000:3.0:1746143133.815359:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8188 00000100:00100000:0.0:1746143133.820488:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.820762:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858692096 00000100:00100000:1.0:1746143133.820770:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858692096 00000100:00100000:1.0:1746143133.820826:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8189 00000100:00100000:1.0:1746143133.820833:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:31004:x1830962858692096:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143133.820853:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.820868:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009490d000/0x25aee876ca70d714 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650531 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.820917:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009490d000/0x25aee876ca70d714 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650531 expref: 16 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.820930:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009490d000/0x25aee876ca70d714 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650531 expref: 16 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.820947:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143133.820950:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143133.820953:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490d000, rc 0) 00000100:00100000:1.0:1746143133.821000:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:31004:x1830962858692096:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 167us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.821007:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8189 00000100:00100000:3.0:1746143133.821408:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861269632:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143133.821436:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d409800/0x25aee876ca70d6f8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650523 expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.821447:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d409800/0x25aee876ca70d6f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650523 expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.821457:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409800, rc 0) 00000100:00100000:3.0:1746143133.821481:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858691584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10875us (10991us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143133.821487:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12484 00000100:00100000:1.0:1746143133.829110:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858691712:12345-192.168.201.28@tcp:4:cat.0 Request processed in 18281us (18576us total) trans 21474840047 rc 0/0 00000100:00100000:1.0:1746143133.829121:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1992 00002000:00100000:1.0:1746143133.829132:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4886527) req@ffff8800906a6d80 x1830962858691712/t21474840047(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.829140:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6d80 with x1830962858691712 ext(4194304->4886527) 00010000:00010000:1.0:1746143133.829148:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.829161:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:1.0:1746143133.829166:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a6d80 00000100:00100000:0.0:1746143133.836145:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.836185:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.836225:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.836227:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858692352 00000100:00100000:3.0:1746143133.836235:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858692352 00000100:00100000:0.0:1746143133.836252:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.836264:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.836277:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858692608 00000100:00100000:3.0:1746143133.836279:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858692608 00000100:00100000:2.0:1746143133.836286:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858692864 00000100:00100000:0.0:1746143133.836286:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858692224 00000100:00100000:2.0:1746143133.836289:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858692864 00000100:00100000:0.0:1746143133.836290:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858692224 00000100:00100000:3.0:1746143133.836295:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858692480 00000100:00100000:3.0:1746143133.836297:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858692480 00000100:00100000:2.0:1746143133.836309:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12485 00000100:00100000:0.0:1746143133.836320:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12486 00000100:00100000:2.0:1746143133.836322:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858692352:12345-192.168.201.28@tcp:1:mirror_io.0 00000100:00100000:3.0:1746143133.836327:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12487 00000100:00100000:0.0:1746143133.836327:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858692608:12345-192.168.201.28@tcp:1:mirror_io.0 00000100:00100000:3.0:1746143133.836332:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858692864:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143133.836358:0:21048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836359:0:8169:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.836359:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.836373:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836373:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 26 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.836373:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.836380:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143133.836381:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.836381:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 10 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.836381:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143133.836384:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.836387:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 26 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836388:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.836393:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.836393:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.836394:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.836394:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.836396:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836396:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.836412:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 26 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836413:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.836413:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.836422:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 26 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.836422:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.836424:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.836433:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861269888:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.836433:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861269760:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.836433:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861270016:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.836494:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12488 00000100:00100000:2.0:1746143133.836500:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858692224:12345-192.168.201.28@tcp:1:mirror_io.0 00000100:00100000:0.0:1746143133.836502:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3300 going to sleep for 11 seconds 00010000:00010000:2.0:1746143133.836516:0:754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.836520:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12489 00010000:00010000:2.0:1746143133.836524:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.836527:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858692480:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143133.836530:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 7 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.836537:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.836541:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.836542:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.836543:0:8449:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836544:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.836553:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 26 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.836560:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 10 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.836562:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.836566:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 15 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.836570:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 20 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.836571:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.836573:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.836575:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.836577:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861270144:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143133.836591:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 15 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.836599:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 15 pid: 22204 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.836602:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 7 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143133.836607:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861270272:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.836610:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 7 pid: 10061 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.836616:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861270400:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143133.836636:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 10 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.836638:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 16 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836645:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 16 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.836648:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 10 pid: 21048 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.836651:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861270656:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.836655:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861270528:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.836666:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00010000:00010000:0.0:1746143133.836679:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 26 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836685:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 10 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.836687:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 26 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.836694:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861270784:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.836696:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 10 pid: 10061 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.836704:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861270912:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.836712:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143133.836724:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 26 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.836731:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 26 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.836738:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861271040:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.836747:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.836748:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.837184:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858692736 00000100:00100000:1.0:1746143133.837188:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858692736 00010000:00010000:3.0:1746143133.837907:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.837916:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 10 pid: 4758 timeout: 1015 lvb_type: 1 00000100:00100000:3.0:1746143133.837924:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861271168:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.837950:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 15 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.837957:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 15 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.837964:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861271296:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.837977:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143133.839159:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12490 00000100:00100000:1.0:1746143133.839167:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858692736:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143133.839189:0:10061:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839200:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839225:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839232:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839238:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839243:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 5 00010000:00010000:1.0:1746143133.839246:0:10061:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839250:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 6 00010000:00010000:1.0:1746143133.839252:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 8/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839275:0:10061:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839284:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839291:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:1.0:1746143133.839303:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861271552:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.839333:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839340:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:1.0:1746143133.839347:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861271680:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.839368:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 20 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839375:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 20 pid: 10061 timeout: 1015 lvb_type: 0 00000100:00100000:1.0:1746143133.839382:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861271808:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.839402:0:10061:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 16 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.839408:0:10061:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 16 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:1.0:1746143133.839415:0:10061:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861271936:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143133.840287:0:10061:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143133.845830:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861269760:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.847949:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861270272:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.847950:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.847963:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861270400:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.847981:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858692992 00000100:00100000:3.0:1746143133.847986:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858692992 00010000:00010000:3.0:1746143133.848017:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.848061:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6609 00000100:00100000:1.0:1746143133.848063:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861270016:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.848069:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858692992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143133.848080:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143133.848087:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.848097:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.848112:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.848133:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f12c00/0x25aee876ca70d61f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165046d expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.848148:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.848150:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.848156:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.848164:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.848192:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 20 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.848201:0:16965:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 20 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.848226:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861272064:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143133.848291:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143133.848308:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861270656:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.848316:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861270144:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.848335:0:754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.849337:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.849356:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858693376 00000100:00100000:0.0:1746143133.849360:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858693376 00010000:00010000:0.0:1746143133.849377:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 16 pid: 22204 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.849406:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6610 00000100:00100000:0.0:1746143133.849412:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858693376:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.849420:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.849640:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 16 pid: 22204 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.849650:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 16 pid: 22204 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.849679:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0c7200/0x25aee876ca70d5ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650443 expref: 16 pid: 22204 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.849695:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.849718:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858693376:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 306us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.849725:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6610 00000100:00100000:3.0:1746143133.853113:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861269888:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.854232:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.854237:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861271552:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143133.854248:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861271680:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.854254:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858693632 00000100:00100000:1.0:1746143133.854256:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861271808:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143133.854260:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858693632 00000100:00100000:1.0:1746143133.854264:0:10061:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10061:1830962861271936:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.854288:0:10061:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.854288:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 11 pid: 21048 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.854312:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6611 00000100:00100000:0.0:1746143133.854319:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858693632:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.854330:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.854346:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 11 pid: 21048 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.854357:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 11 pid: 21048 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.854383:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.854413:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858693632:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 94us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.854420:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6611 00000100:00100000:0.0:1746143133.854456:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.854528:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858694016 00000100:00100000:1.0:1746143133.854533:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858694016 00000100:00100000:0.0:1746143133.854543:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143133.854548:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 11 pid: 4758 timeout: 1015 lvb_type: 1 00000100:00100000:1.0:1746143133.854564:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858693888 00000100:00100000:1.0:1746143133.854566:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858693888 00010000:00010000:1.0:1746143133.854573:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 27 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.854576:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6612 00000100:00100000:0.0:1746143133.854582:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858694016:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143133.854586:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6613 00010000:00010000:0.0:1746143133.854589:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143133.854591:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858693888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143133.854597:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143133.854605:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 27 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.854613:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 27 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.854624:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.854626:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.854629:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.854636:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.854643:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 11 pid: 4758 timeout: 1015 lvb_type: 1 00010000:00010000:1.0:1746143133.854649:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143133.854652:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 11 pid: 4758 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.854662:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143133.854670:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858693888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.854675:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6613 00000100:00100000:0.0:1746143133.854677:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858694016:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.854683:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6612 00000100:00100000:1.0:1746143133.854726:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143133.855050:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009490c000/0x25aee876ca70d6b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504f9 expref: 10 pid: 4758 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.855051:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094257600/0x25aee876ca70d6b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504e4 expref: 10 pid: 21048 timeout: 1015 lvb_type: 1 00000100:00100000:3.0:1746143133.855064:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861271168:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.855067:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861270528:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143133.855073:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861271296:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.855076:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dbe000/0x25aee876ca70d5af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650419 expref: 26 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.855083:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861270784:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143133.855088:0:21048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.855099:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.855106:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.855107:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858694400 00000100:00100000:3.0:1746143133.855110:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858694400 00010000:00010000:2.0:1746143133.855112:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.855122:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 26 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.855129:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.855136:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.855143:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.855149:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009490bc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143133.855152:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.855159:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.855169:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.855180:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009490bc00/0x25aee876ca70d737 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.855232:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858692480:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 18705us (18965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.855239:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12489 00000100:00100000:0.0:1746143133.857775:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6614 00000100:00100000:0.0:1746143133.857788:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858694400:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.857800:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.857817:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 26 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.857833:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 26 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.857848:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.857875:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858694400:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 92us (3149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.857881:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6614 00000100:00100000:0.0:1746143133.857946:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.857963:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858693248 00000100:00100000:0.0:1746143133.857968:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858693248 00010000:00010000:0.0:1746143133.857984:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 9 pid: 10061 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.858001:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6615 00000100:00100000:0.0:1746143133.858006:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858693248:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.858015:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.858026:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 9 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858047:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 9 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858060:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132051200/0x25aee876ca70d40b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165032b expref: 9 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858074:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.858088:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858693248:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 82us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.858093:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6615 00000100:00100000:0.0:1746143133.858128:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.858136:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858693504 00000100:00100000:0.0:1746143133.858138:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858693504 00010000:00010000:0.0:1746143133.858147:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 21 pid: 10061 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.858158:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6616 00000100:00100000:0.0:1746143133.858161:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858693504:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.858167:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.858172:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 21 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858180:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 21 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858189:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d522000/0x25aee876ca70d3b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502ec expref: 21 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858196:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.858206:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858693504:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 45us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.858226:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6616 00000100:00100000:0.0:1746143133.858255:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.858263:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858694144 00000100:00100000:0.0:1746143133.858265:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858694144 00010000:00010000:0.0:1746143133.858273:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 26 pid: 10061 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.858299:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6617 00000100:00100000:0.0:1746143133.858303:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858694144:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.858308:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.858314:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 26 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858321:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 26 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858329:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a472de00/0x25aee876ca70d67a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c8 expref: 26 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858336:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.858346:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858694144:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 42us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.858350:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6617 00000100:00100000:0.0:1746143133.858373:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.858380:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858694528 00000100:00100000:0.0:1746143133.858382:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858694528 00010000:00010000:0.0:1746143133.858390:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.858400:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6618 00000100:00100000:0.0:1746143133.858403:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858694528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.858408:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.858415:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858422:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858431:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094257c00/0x25aee876ca70d673 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504c1 expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858440:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.858450:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858694528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 46us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.858454:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6618 00000100:00100000:0.0:1746143133.858482:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.858502:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.858508:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858693760 00000100:00100000:0.0:1746143133.858510:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858693760 00010000:00010000:0.0:1746143133.858517:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 8 pid: 10061 timeout: 1015 lvb_type: 1 00000100:00100000:0.0:1746143133.858527:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6619 00000100:00100000:0.0:1746143133.858531:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858693760:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.858537:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.858542:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 8 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858549:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 8 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858558:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.858569:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858693760:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 38us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.858573:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6619 00000100:00100000:0.0:1746143133.858622:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.858632:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858694272 00000100:00100000:0.0:1746143133.858634:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858694272 00010000:00010000:0.0:1746143133.858644:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 16 pid: 10061 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.858655:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6620 00000100:00100000:0.0:1746143133.858659:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858694272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.858664:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.858671:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 16 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858678:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 16 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858687:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c5b000/0x25aee876ca70d378 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502d0 expref: 16 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.858696:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.858697:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.858701:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858708:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858741:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.858756:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858694272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 96us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.858762:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6620 00000100:00100000:0.0:1746143133.858796:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.858805:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858694656 00000100:00100000:0.0:1746143133.858807:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858694656 00010000:00010000:2.0:1746143133.858810:0:754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858816:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.858818:0:754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.858828:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6621 00000100:00100000:0.0:1746143133.858831:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858694656:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.858834:0:754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858837:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.858840:0:754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858842:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.858848:0:754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858850:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.858854:0:754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ffba00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143133.858857:0:754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.858863:0:754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858864:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d76000/0x25aee876ca70d5f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165043c expref: 15 pid: 10061 timeout: 1015 lvb_type: 1 00010000:00010000:0.0:1746143133.858872:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.858873:0:754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858873:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.858876:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.858879:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ffba00/0x25aee876ca70d730 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858882:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.858890:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.858902:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858694656:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 70us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.858906:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6621 00000100:00100000:2.0:1746143133.858912:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858692224:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 22413us (22659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.858918:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12488 00000100:00100000:0.0:1746143133.858935:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.858944:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858694784 00000100:00100000:0.0:1746143133.858946:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858694784 00000100:00100000:1.0:1746143133.859124:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858693120 00000100:00100000:1.0:1746143133.859129:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858693120 00002000:00100000:1.0:1746143133.859154:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1216512->1605631) req@ffff88008fe7aa00 x1830962858693120/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.859164:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7aa00 with x1830962858693120 ext(1216512->1605631) 00010000:00010000:1.0:1746143133.859171:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.859181:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:1.0:1746143133.859194:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe7aa00 00000100:00100000:1.0:1746143133.859206:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1993 00000100:00100000:1.0:1746143133.859226:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858693120:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143133.859756:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.859768:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858694912 00000100:00100000:1.0:1746143133.859771:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858694912 00010000:00010000:1.0:1746143133.859782:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:1.0:1746143133.859798:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6622 00000100:00100000:1.0:1746143133.859803:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858694912:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143133.859809:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143133.859818:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.860076:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.860089:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093fcea00/0x25aee876ca70d650 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165049e expref: 17 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.860103:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143133.860119:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858694912:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 315us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.860125:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6622 00010000:00010000:2.0:1746143133.860151:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009490da00/0x25aee876ca70d6a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504dd expref: 7 pid: 10061 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.860160:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861270912:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.860170:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132050c00/0x25aee876ca70d5a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165040b expref: 24 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.860178:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861271040:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143133.860196:0:8169:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860203:0:8169:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860219:0:8169:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860232:0:8169:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860238:0:8169:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860243:0:8169:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860248:0:8169:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f8ac00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143133.860250:0:8169:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860256:0:8169:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860265:0:8169:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.860270:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f8ac00/0x25aee876ca70d71b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.860304:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858692352:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 23985us (24168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.860311:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12485 00000100:00100000:3.0:1746143133.860909:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861272064:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143133.860920:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.860934:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858692992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 12867us (12989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.860939:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6609 00010000:00010000:0.0:1746143133.861024:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:3.0:1746143133.864252:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6623 00000100:00100000:3.0:1746143133.864270:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858694784:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143133.864290:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143133.864317:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.864331:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.864529:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5337600/0x25aee876ca70d665 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504b3 expref: 20 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.864541:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.864584:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858694784:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 321us (5648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.864589:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6623 00000100:00100000:1.0:1746143133.864903:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.865108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.865126:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858695296 00000100:00100000:1.0:1746143133.865133:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858695296 00002000:00100000:1.0:1746143133.865159:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800942c4700 x1830962858695296/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143133.865169:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4700 with x1830962858695296 ext(4194304->5210111) 00010000:00010000:1.0:1746143133.865175:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 19 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:1.0:1746143133.865186:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 19 pid: 22204 timeout: 1015 lvb_type: 0 00002000:00010000:1.0:1746143133.865192:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c4700 00000100:00100000:1.0:1746143133.865225:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1994 00000100:00100000:1.0:1746143133.865232:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858695296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.865265:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.865502:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858695040 00000100:00100000:0.0:1746143133.865507:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858695040 00010000:00010000:0.0:1746143133.865525:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 14 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.865540:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858695424 00000100:00100000:0.0:1746143133.865543:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858695424 00010000:00010000:0.0:1746143133.865550:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 20 pid: 10061 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.865569:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6624 00000100:00100000:0.0:1746143133.865574:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858695040:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.865581:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143133.865716:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6625 00000100:00100000:3.0:1746143133.865723:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858695424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143133.865731:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143133.865740:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 20 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.865750:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 20 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.865764:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a472c800/0x25aee876ca70d657 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504a5 expref: 20 pid: 10061 timeout: 1015 lvb_type: 0 00010000:00010000:3.0:1746143133.865779:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.866062:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858695424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 338us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.866068:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6625 00010000:00010000:0.0:1746143133.866443:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 14 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.866453:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 14 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.866552:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fcf800/0x25aee876ca70d65e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ac expref: 14 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.866561:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.866563:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.866566:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.866573:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.866593:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.866614:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858695040:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1040us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.866620:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6624 00010000:00010000:3.0:1746143133.866759:0:21048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.866768:0:21048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.866786:0:21048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.866794:0:21048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.866801:0:21048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.866808:0:21048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d408000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143133.866812:0:21048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.866819:0:21048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.866834:0:21048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.866840:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d408000/0x25aee876ca70d722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143133.867237:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858692864:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 30903us (31010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.867245:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12487 00000100:00100000:2.0:1746143133.878521:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858695296:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13280us (13404us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143133.878533:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1994 00002000:00100000:2.0:1746143133.878543:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800942c4700 x1830962858695296/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/440 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.878552:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4700 with x1830962858695296 ext(4194304->5210111) 00010000:00010000:2.0:1746143133.878560:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 18 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.878572:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 18 pid: 22204 timeout: 1015 lvb_type: 0 00002000:00010000:2.0:1746143133.878578:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c4700 00000100:00100000:1.0:1746143133.887515:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.887554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.887586:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858695680 00000100:00100000:2.0:1746143133.887594:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858695680 00000100:00100000:2.0:1746143133.887646:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8190 00000100:00100000:2.0:1746143133.887654:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+218:31006:x1830962858695680:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143133.887676:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.887690:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2be00/0x25aee876ca70d745 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650538 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.887985:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143133.888000:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 15 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.888009:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143133.888493:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 15 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.888504:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 15 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.888515:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861272192:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143133.888571:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.888642:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858693120:12345-192.168.201.28@tcp:4:cat.0 Request processed in 29415us (30156us total) trans 21474840048 rc 0/0 00000100:00100000:0.0:1746143133.888651:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1993 00002000:00100000:0.0:1746143133.888659:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1216512->1605631) req@ffff88008fe7aa00 x1830962858693120/t21474840048(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:284/0 lens 488/448 e 0 to 0 dl 1746143144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143133.888668:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7aa00 with x1830962858693120 ext(1216512->1605631) 00010000:00010000:0.0:1746143133.888675:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.888684:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 1015 lvb_type: 0 00002000:00010000:0.0:1746143133.888690:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe7aa00 00000100:00100000:1.0:1746143133.889120:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.889675:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.891126:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858695808 00000100:00100000:3.0:1746143133.891135:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858695808 00000100:00100000:3.0:1746143133.891173:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858696064 00000100:00100000:3.0:1746143133.891176:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858696064 00000100:00100000:3.0:1746143133.891199:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12491 00000100:00100000:3.0:1746143133.891206:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858695808:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.891231:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.891246:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165053f expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143133.891266:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x6814079b, atime: 0x6814079b, ctime: 0x6814079b, blocks: 0x7cf 00010000:00010000:3.0:1746143133.891281:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.891283:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.891290:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.891303:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.891313:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409c00, rc 0) 00000100:00100000:3.0:1746143133.891352:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858695808:12345-192.168.201.28@tcp:101:cat.0 Request processed in 147us (3844us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.891358:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12491 00000100:00100000:3.0:1746143133.891371:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12492 00000100:00100000:3.0:1746143133.891376:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858696064:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.891382:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.891568:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165054d expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143133.891581:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x6814079b, atime: 0x6814079b, ctime: 0x6814079b, blocks: 0x821 00010000:00010000:3.0:1746143133.891589:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.891590:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.891594:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 25 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.891603:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 25 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143133.891608:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409800, rc 0) 00000100:00100000:3.0:1746143133.891623:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858696064:12345-192.168.201.28@tcp:101:cat.0 Request processed in 248us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.891628:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12492 00000100:00100000:0.0:1746143133.892886:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.893431:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.893453:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.893472:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858696320 00000100:00100000:0.0:1746143133.893477:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858696320 00000100:00100000:0.0:1746143133.893499:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858695936 00000100:00100000:0.0:1746143133.893501:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858695936 00000100:00100000:0.0:1746143133.893509:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858696192 00000100:00100000:0.0:1746143133.893510:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858696192 00000100:00100000:0.0:1746143133.893518:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858696448 00000100:00100000:0.0:1746143133.893520:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858696448 00000100:00100000:0.0:1746143133.893531:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12493 00000100:00100000:0.0:1746143133.893536:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858696320:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143133.893546:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143133.893556:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dbee00/0x25aee876ca70d761 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165055b expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.893568:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.893576:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dbee00/0x25aee876ca70d761 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165055b expref: 21 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.893585:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dbee00/0x25aee876ca70d761 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165055b expref: 21 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.893604:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dbee00, rc 0) 00000100:00100000:0.0:1746143133.893626:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858696320:12345-192.168.201.28@tcp:101:cat.0 Request processed in 90us (3952us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143133.893632:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12493 00000100:00100000:0.0:1746143133.893644:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12494 00000100:00100000:0.0:1746143133.893648:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858695936:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143133.893654:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143133.893663:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650546 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143133.893677:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x6814079b, atime: 0x6814079b, ctime: 0x6814079b, blocks: 0x81d 00010000:00010000:0.0:1746143133.893684:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.893686:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.893691:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 27 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.893701:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 27 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.893714:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd18000, rc 0) 00000100:00100000:0.0:1746143133.893728:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858695936:12345-192.168.201.28@tcp:101:cat.0 Request processed in 79us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.893733:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12494 00000100:00100000:0.0:1746143133.893743:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12495 00000100:00100000:0.0:1746143133.893747:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858696192:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143133.893752:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143133.893757:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd19000/0x25aee876ca70d76f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650554 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.893791:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861272320:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143133.893837:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012eab9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.893856:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12496 00000100:00100000:0.0:1746143133.893861:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858696448:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143133.893867:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143133.893875:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650562 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143133.893886:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x6814079c, atime: 0x6814079c, ctime: 0x6814079c, blocks: 0x1029 00010000:00010000:0.0:1746143133.893893:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.893894:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.893898:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.893911:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.893918:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1a00, rc 0) 00000100:00100000:0.0:1746143133.893932:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858696448:12345-192.168.201.28@tcp:101:cat.0 Request processed in 71us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.893937:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12496 00000100:00100000:0.0:1746143133.893970:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.893987:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858696576 00000100:00100000:0.0:1746143133.893990:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858696576 00010000:00010000:0.0:1746143133.894003:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 21 pid: 22204 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.894019:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6626 00000100:00100000:0.0:1746143133.894023:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858696576:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143133.894046:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143133.894059:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 21 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.894068:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 21 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.894080:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f8a000/0x25aee876ca70d6ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165051c expref: 21 pid: 22204 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.894092:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.894093:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.894096:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894102:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894118:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143133.894131:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858696576:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 108us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.894136:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6626 00000100:00100000:0.0:1746143133.894225:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861272192:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143133.894242:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143133.894283:0:10061:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894290:0:10061:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894307:0:10061:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894314:0:10061:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894321:0:10061:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894327:0:10061:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135e9b800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143133.894330:0:10061:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894337:0:10061:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.894343:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143133.894345:0:10061:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894350:0:10061:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d73e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.894380:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.894385:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858692736:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 55218us (57636us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.894390:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12490 00000100:00100000:0.0:1746143133.894407:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858696704 00000100:00100000:0.0:1746143133.894410:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858696704 00010000:00010000:0.0:1746143133.894420:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 16 pid: 14794 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.894432:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858696832 00000100:00100000:0.0:1746143133.894433:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858696832 00000100:00100000:2.0:1746143133.894440:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6627 00010000:00010000:0.0:1746143133.894441:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:2.0:1746143133.894447:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:1968:x1830962858696704:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143133.894453:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6628 00010000:00010000:2.0:1746143133.894455:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143133.894457:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858696832:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.894461:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 16 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.894462:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.894469:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 16 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.894470:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.894478:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 15 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:2.0:1746143133.894483:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d408a00/0x25aee876ca70d706 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165052a expref: 16 pid: 14794 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.894488:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.894490:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143133.894492:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.894497:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143133.894498:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.894502:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143133.894509:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143133.894510:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143133.894516:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143133.894523:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858696832:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.894527:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6628 00010000:00010000:2.0:1746143133.894532:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.894551:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1968:x1830962858696704:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 105us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143133.894554:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.894558:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6627 00010000:00010000:0.0:1746143133.894560:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894571:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.894573:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143133.894577:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.894578:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143133.894582:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894586:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093245600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143133.894589:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746143133.894594:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143133.894594:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894601:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143133.894605:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093245600/0x25aee876ca70d729 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143133.894623:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858692608:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 58297us (58438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143133.894628:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12486 00010000:00010000:2.0:1746143133.899625:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2be00/0x25aee876ca70d745 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 221 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.899648:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 220 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.899656:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143133.899659:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143133.899662:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2bc00, rc 0) 00000100:00100000:2.0:1746143133.899734:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+220:31006:x1830962858695680:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 12080us (12179us total) trans 8589942401 rc 0/0 00000100:00100000:2.0:1746143133.899745:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8190 00010000:00010000:0.0:1746143133.901383:0:4756:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.201.28@tcp) returned -22 from glimpse AST (req@ffff88008fe79f80 x1830962861272320) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 14 pid: 754 timeout: 1015 lvb_type: 0 00010000:00010000:0.0:1746143133.901491:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81de00/0x25aee876ca70d66c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1605631) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16504ba expref: 14 pid: 754 timeout: 1015 lvb_type: 0 00000100:00100000:0.0:1746143133.901503:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861272320:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143133.901531:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd19000/0x25aee876ca70d76f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650554 expref: 19 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.901541:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd19000/0x25aee876ca70d76f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650554 expref: 19 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143133.901554:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd19000, rc 0) 00000100:00100000:0.0:1746143133.901600:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858696192:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7851us (8168us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143133.901609:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12495 00000100:00100000:0.0:1746143133.908600:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143133.908655:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.908746:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858697216 00000100:00100000:1.0:1746143133.908754:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858697216 00000100:00100000:1.0:1746143133.908811:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12497 00000100:00100000:1.0:1746143133.908819:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:31006:x1830962858697216:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143133.908836:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.908851:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650569 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.908889:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 28 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.908897:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.908899:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.908902:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1695744->1822719] (req 1695744->1822719) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 28 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.908930:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 28 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.908941:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 28 pid: 4756 timeout: 1015 lvb_type: 1 00000100:00100000:1.0:1746143133.908955:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861272448:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143133.909054:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143133.909119:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858697088 00000100:00100000:2.0:1746143133.909123:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858697088 00000100:00100000:2.0:1746143133.909147:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8191 00000100:00100000:2.0:1746143133.909152:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:31004:x1830962858697088:12345-192.168.201.28@tcp:36:mirror_io.0 00010000:00010000:2.0:1746143133.909186:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.909205:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009490d000/0x25aee876ca70d714 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650531 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.909237:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143133.909241:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143133.909275:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:31004:x1830962858697088:12345-192.168.201.28@tcp:36:mirror_io.0 Request processed in 122us (684us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746143133.909281:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8191 00000100:00100000:0.0:1746143133.912138:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143133.912282:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858697344 00000100:00100000:3.0:1746143133.912290:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858697344 00000100:00100000:3.0:1746143133.912339:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12498 00000100:00100000:3.0:1746143133.912347:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:30998:x1830962858697344:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143133.912362:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143133.912377:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650570 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143133.912405:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x6814079c, atime: 0x6814079c, ctime: 0x6814079c, blocks: 0x180b 00010000:00010000:3.0:1746143133.912422:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.912424:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143133.912430:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.912442:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143133.912450:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d408600, rc 0) 00000100:00100000:3.0:1746143133.912500:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:30998:x1830962858697344:12345-192.168.201.28@tcp:101:cat.0 Request processed in 153us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.912506:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12498 00000100:00100000:0.0:1746143133.913621:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.914110:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861272448:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143133.914137:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1695744->1822719] (req 1695744->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 28 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.914149:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5351400, rc 0) 00000100:00100000:1.0:1746143133.914175:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:31006:x1830962858697216:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5357us (5520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143133.914182:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12497 00000100:00100000:2.0:1746143133.914804:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858697600 00000100:00100000:2.0:1746143133.914810:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858697600 00000100:00100000:2.0:1746143133.915625:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3462 00000100:00100000:2.0:1746143133.915634:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:31004:x1830962858697600:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143133.918070:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:31004:x1830962858697600:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 2430us (4445us total) trans 8589942402 rc 0/0 00000100:00100000:2.0:1746143133.918081:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3462 00000100:00100000:0.0:1746143133.918548:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.918601:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858697728 00000100:00100000:2.0:1746143133.918608:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858697728 00000100:00100000:0.0:1746143133.918608:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143133.918632:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 28 pid: 4756 timeout: 1015 lvb_type: 1 00000100:00100000:2.0:1746143133.918659:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6629 00000100:00100000:2.0:1746143133.918665:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858697728:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143133.918675:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143133.918692:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 28 pid: 4756 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.918704:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 28 pid: 4756 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.918724:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d768 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650546 expref: 28 pid: 4756 timeout: 1015 lvb_type: 1 00010000:00010000:2.0:1746143133.919169:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.919172:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.919180:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 27 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.919188:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 27 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143133.919248:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 27 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143133.919262:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861272576:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143133.919314:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143133.920149:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.920288:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858697984 00000100:00100000:2.0:1746143133.920293:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858697984 00000100:00100000:1.0:1746143133.920309:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858697856 00000100:00100000:1.0:1746143133.920314:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858697856 00000100:00100000:2.0:1746143133.920320:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12499 00000100:00100000:2.0:1746143133.920326:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858697984:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143133.920336:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12500 00010000:00010000:2.0:1746143133.920338:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143133.920341:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858697856:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143133.920553:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143133.920557:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165057e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.920561:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5351000/0x25aee876ca70d799 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650577 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143133.920574:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x6814079c, atime: 0x6814079b, ctime: 0x6814079c, blocks: 0x81d 00010000:00010000:2.0:1746143133.920584:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.920585:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143133.920590:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143133.920593:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861272704:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143133.920601:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143133.920609:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2ac00, rc 0) 00000100:00100000:1.0:1746143133.920627:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143133.920630:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858697984:12345-192.168.201.28@tcp:101:cat.0 Request processed in 305us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143133.920636:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12499 00000100:00100000:0.0:1746143133.927190:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.927738:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858698240 00000100:00100000:2.0:1746143133.927747:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858698240 00000100:00100000:2.0:1746143133.927785:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3463 00000100:00100000:2.0:1746143133.927792:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:31004:x1830962858698240:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143133.927955:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861272576:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143133.927975:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143133.928012:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858697728:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9347us (9465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143133.928021:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6629 00000100:00100000:2.0:1746143133.928261:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:31004:x1830962858698240:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 469us (1079us total) trans 8589942403 rc 0/0 00000100:00100000:2.0:1746143133.928272:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3463 00000100:00100000:0.0:1746143133.928408:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.928681:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858698496 00000100:00100000:2.0:1746143133.928685:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858698496 00002000:00100000:2.0:1746143133.928708:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1818624->1822719) req@ffff88008fe7a680 x1830962858698496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.928717:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7a680 with x1830962858698496 ext(1818624->1822719) 00002000:00010000:2.0:1746143133.928721:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7a680 00000100:00100000:2.0:1746143133.929058:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6072 00000100:00100000:2.0:1746143133.929088:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858698496:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.929189:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858698496:12345-192.168.201.28@tcp:3:cat.0 Request processed in 124us (781us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143133.929194:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6072 00002000:00100000:2.0:1746143133.929199:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1818624->1822719) req@ffff88008fe7a680 x1830962858698496/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.929218:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7a680 with x1830962858698496 ext(1818624->1822719) 00002000:00010000:2.0:1746143133.929222:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7a680 00002000:00010000:1.0:1746143133.932411:0:4756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143131 -> 1746143132 00002000:00010000:1.0:1746143133.932417:0:4756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143131 -> 1746143132 00002000:00010000:1.0:1746143133.932419:0:4756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143131 -> 1746143132 00000100:00100000:1.0:1746143133.932612:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861272704:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143133.932643:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5351000/0x25aee876ca70d799 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650577 expref: 28 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.932657:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351000/0x25aee876ca70d799 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650577 expref: 28 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.932681:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5351000, rc 0) 00000100:00100000:1.0:1746143133.932723:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858697856:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12381us (12575us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143133.932730:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12500 00000100:00100000:0.0:1746143133.940715:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143133.942790:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858698752 00000100:00100000:2.0:1746143133.942800:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858698752 00002000:00100000:2.0:1746143133.942839:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88012b800380 x1830962858698752/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/0 e 0 to 0 dl 1746143144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.942849:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800380 with x1830962858698752 ext(5206016->5210111) 00002000:00010000:2.0:1746143133.942854:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b800380 00000100:00100000:2.0:1746143133.942883:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6073 00000100:00100000:2.0:1746143133.942889:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858698752:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143133.946879:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858698752:12345-192.168.201.28@tcp:3:cat.0 Request processed in 3980us (6161us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143133.946891:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6073 00002000:00100000:2.0:1746143133.946902:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88012b800380 x1830962858698752/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746143144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143133.946912:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800380 with x1830962858698752 ext(5206016->5210111) 00002000:00010000:2.0:1746143133.946917:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b800380 00000100:00100000:0.0:1746143133.988693:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.990461:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858699008 00000100:00100000:1.0:1746143133.990476:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858699008 00000100:00100000:1.0:1746143133.990533:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8192 00000100:00100000:1.0:1746143133.990541:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:31011:x1830962858699008:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143133.990564:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.990580:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5350600/0x25aee876ca70d7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650585 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.990653:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143133.990666:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143133.990676:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:1.0:1746143133.990684:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143133.990773:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5350600/0x25aee876ca70d7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 30 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.990796:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 29 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.990803:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143133.990806:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143133.990809:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5351800, rc 0) 00000100:00100000:1.0:1746143133.990852:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:31011:x1830962858699008:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 313us (2168us total) trans 8589942404 rc 0/0 00000100:00100000:1.0:1746143133.990858:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8192 00000100:00100000:0.0:1746143133.997565:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143133.997661:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858699136 00000100:00100000:1.0:1746143133.997670:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858699136 00000100:00100000:1.0:1746143133.997726:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12501 00000100:00100000:1.0:1746143133.997735:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31011:x1830962858699136:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143133.997752:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143133.998334:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165058c expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.998362:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 26 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.998370:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.998371:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143133.998374:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1486848->1613823] (req 1486848->1613823) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143133.998405:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 26 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143133.998417:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 26 pid: 8449 timeout: 1015 lvb_type: 1 00000100:00100000:1.0:1746143133.998428:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861272832:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143133.999774:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143134.002252:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.002927:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861272832:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143134.002953:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1486848->1613823] (req 1486848->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 14 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.002970:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5350600, rc 0) 00000100:00100000:1.0:1746143134.003014:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31011:x1830962858699136:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5280us (5458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.003023:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12501 00000100:00100000:3.0:1746143134.004911:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858699264 00000100:00100000:3.0:1746143134.004921:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858699264 00010000:00010000:3.0:1746143134.004972:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 27 pid: 8449 timeout: 1015 lvb_type: 1 00000100:00100000:3.0:1746143134.005011:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6630 00000100:00100000:3.0:1746143134.005019:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858699264:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.005046:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143134.005067:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 27 pid: 8449 timeout: 1015 lvb_type: 1 00010000:00010000:3.0:1746143134.005078:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 27 pid: 8449 timeout: 1015 lvb_type: 1 00010000:00010000:3.0:1746143134.005099:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d409800/0x25aee876ca70d75a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165054d expref: 27 pid: 8449 timeout: 1015 lvb_type: 1 00010000:00010000:3.0:1746143134.005113:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.005116:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.005121:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.005128:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.005158:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 13 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143134.005171:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861272960:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143134.005253:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00000100:00080000:0.0:1746143134.005706:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143134.009721:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.010750:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861272960:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143134.010772:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143134.010828:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858699264:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5809us (8580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.010838:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6630 00000100:00100000:3.0:1746143134.011276:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858699520 00000100:00100000:3.0:1746143134.011282:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858699520 00002000:00100000:3.0:1746143134.011315:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1486848->1490943) req@ffff88012b800000 x1830962858699520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.011324:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800000 with x1830962858699520 ext(1486848->1490943) 00002000:00010000:3.0:1746143134.011328:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b800000 00000100:00100000:3.0:1746143134.011352:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6074 00000100:00100000:3.0:1746143134.011358:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858699520:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143134.011485:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858699520:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 127us (1774us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143134.011490:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6074 00002000:00100000:3.0:1746143134.011711:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1486848->1490943) req@ffff88012b800000 x1830962858699520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.011719:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800000 with x1830962858699520 ext(1486848->1490943) 00002000:00010000:3.0:1746143134.011722:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b800000 00000100:00100000:0.0:1746143134.015191:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.015292:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858699776 00000100:00100000:2.0:1746143134.015301:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858699776 00002000:00100000:2.0:1746143134.015339:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1609728->1613823) req@ffff88012b800a80 x1830962858699776/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.015349:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800a80 with x1830962858699776 ext(1609728->1613823) 00002000:00010000:2.0:1746143134.015353:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b800a80 00000100:00100000:2.0:1746143134.015386:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6075 00000100:00100000:2.0:1746143134.015393:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858699776:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143134.015542:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858699776:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 149us (358us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143134.015549:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6075 00002000:00100000:2.0:1746143134.015554:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1609728->1613823) req@ffff88012b800a80 x1830962858699776/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.015561:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800a80 with x1830962858699776 ext(1609728->1613823) 00002000:00010000:2.0:1746143134.015564:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b800a80 00000100:00100000:0.0:1746143134.095844:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.095888:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.095913:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.095937:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858699904 00000100:00100000:0.0:1746143134.095944:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858699904 00000100:00100000:0.0:1746143134.097526:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858700032 00000100:00100000:0.0:1746143134.097531:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858700032 00000100:00100000:1.0:1746143134.098675:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858700160 00000100:00100000:1.0:1746143134.098679:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858700160 00000100:00100000:1.0:1746143134.098710:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12502 00000100:00100000:1.0:1746143134.098716:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858699904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.098732:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.098747:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650593 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.098767:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.098769:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.098776:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.098789:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.098799:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5350800, rc 0) 00000100:00100000:1.0:1746143134.099079:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858699904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 362us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.099085:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12502 00000100:00100000:1.0:1746143134.099100:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12503 00000100:00100000:1.0:1746143134.099104:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858700032:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.099110:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.099118:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5351600/0x25aee876ca70d7c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165059a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143134.099157:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861273088:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143134.099203:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.099231:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12504 00000100:00100000:1.0:1746143134.099237:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858700160:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.099243:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.099250:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505a1 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.099260:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.099262:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.099267:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 16 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.099276:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 16 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.099282:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d77800, rc 0) 00000100:00100000:1.0:1746143134.099297:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858700160:12345-192.168.201.28@tcp:101:cat.0 Request processed in 61us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.099303:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12504 00000100:00100000:1.0:1746143134.099354:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.099367:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858700288 00000100:00100000:1.0:1746143134.099370:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858700288 00000100:00100000:1.0:1746143134.099384:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12505 00000100:00100000:1.0:1746143134.099388:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858700288:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.099396:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.099403:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505a8 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.099411:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.099413:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.099416:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 17 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.099424:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 17 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.099431:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475ae00, rc 0) 00000100:00100000:1.0:1746143134.099444:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858700288:12345-192.168.201.28@tcp:101:cat.0 Request processed in 55us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.099448:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12505 00000100:00100000:1.0:1746143134.099501:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.099510:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858700416 00000100:00100000:1.0:1746143134.099513:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858700416 00000100:00100000:1.0:1746143134.099532:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12506 00000100:00100000:1.0:1746143134.099536:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858700416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.099542:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.099548:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505af expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.099556:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.099557:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.099561:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 17 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.099569:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 17 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.099575:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51f1600, rc 0) 00000100:00100000:1.0:1746143134.099586:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858700416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 50us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.099590:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12506 00000100:00100000:1.0:1746143134.109687:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861273088:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143134.109722:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5351600/0x25aee876ca70d7c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165059a expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.109737:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351600/0x25aee876ca70d7c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165059a expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.109757:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5351600, rc 0) 00000100:00100000:1.0:1746143134.111232:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858700032:12345-192.168.201.28@tcp:101:cat.0 Request processed in 12122us (15338us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143134.111241:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12503 00000100:00100000:0.0:1746143134.128736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.128824:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858700672 00000100:00100000:3.0:1746143134.128832:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858700672 00002000:00100000:3.0:1746143134.128869:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88012b803b80 x1830962858700672/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.128906:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803b80 with x1830962858700672 ext(0->1048575) 00002000:00010000:3.0:1746143134.128913:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b803b80 00000100:00100000:3.0:1746143134.128941:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6076 00000100:00100000:3.0:1746143134.128949:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858700672:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143134.138710:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.140925:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858700800 00000100:00100000:2.0:1746143134.140937:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858700800 00000100:00100000:2.0:1746143134.140984:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12507 00000100:00100000:2.0:1746143134.140993:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858700800:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143134.141009:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.141026:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd2b800/0x25aee876ca70d7df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505b6 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143134.141089:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861273216:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143134.141171:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143134.147063:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858700672:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18104us (18324us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143134.147075:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6076 00002000:00100000:3.0:1746143134.147088:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88012b803b80 x1830962858700672/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.147098:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803b80 with x1830962858700672 ext(0->1048575) 00002000:00010000:3.0:1746143134.147104:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b803b80 00002000:00010000:2.0:1746143134.149124:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143131 -> 1746143132 00002000:00010000:2.0:1746143134.149130:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143131 -> 1746143133 00002000:00010000:2.0:1746143134.149133:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143131 -> 1746143132 00000100:00100000:2.0:1746143134.149150:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861273216:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143134.149178:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd2b800/0x25aee876ca70d7df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505b6 expref: 27 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143134.149192:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd2b800/0x25aee876ca70d7df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505b6 expref: 27 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143134.149242:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2b800, rc 0) 00000100:00100000:2.0:1746143134.149275:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858700800:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8283us (10572us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143134.149283:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12507 00000100:00100000:0.0:1746143134.168268:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.168491:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858700928 00000100:00100000:2.0:1746143134.168500:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858700928 00000100:00100000:2.0:1746143134.168552:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12508 00000100:00100000:2.0:1746143134.168560:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:31016:x1830962858700928:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143134.168577:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.168592:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505bd expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.168620:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 25 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.168628:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143134.168630:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143134.168633:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.168662:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 25 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.168674:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 25 pid: 4756 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.168687:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861273344:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143134.168778:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143134.172094:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861273344:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.172122:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.172138:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2a400, rc 0) 00000100:00100000:2.0:1746143134.172172:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31016:x1830962858700928:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3612us (3911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.172182:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12508 00000100:00100000:1.0:1746143134.183418:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.183666:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.183698:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858701056 00000100:00100000:1.0:1746143134.183705:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.183707:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858701056 00000100:00100000:1.0:1746143134.183728:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858701440 00000100:00100000:1.0:1746143134.183730:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858701440 00002000:00100000:3.0:1746143134.183748:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1695744->1822719) req@ffff8800906a6680 x1830962858701056/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.183748:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800906a5180 x1830962858701440/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 504/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.183758:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6680 with x1830962858701056 ext(1695744->1822719) 00002000:00100000:1.0:1746143134.183763:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5180 with x1830962858701440 ext(1048576->2097151) 00010000:00010000:3.0:1746143134.183766:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 27 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.183766:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 27 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.183778:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 27 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.183779:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 27 pid: 4756 timeout: 1016 lvb_type: 0 00002000:00010000:3.0:1746143134.183786:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800906a6680 00002000:00010000:1.0:1746143134.183786:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800906a5180 00000100:00100000:1.0:1746143134.183799:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858701568 00000100:00100000:3.0:1746143134.183842:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1995 00000100:00100000:2.0:1746143134.183853:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1996 00000100:00100000:2.0:1746143134.183864:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858701056:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143134.183914:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858701440:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143134.186621:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858701568 00002000:00100000:1.0:1746143134.186661:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800906a5c00 x1830962858701568/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.186670:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5c00 with x1830962858701568 ext(0->1048575) 00002000:00010000:1.0:1746143134.186674:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a5c00 00000100:00100000:1.0:1746143134.186689:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6077 00000100:00100000:1.0:1746143134.186694:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858701568:12345-192.168.201.28@tcp:3:cat.0 00000100:00080000:0.0:1746143134.189054:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143134.196509:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.196545:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858701696 00000100:00100000:2.0:1746143134.196952:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858701056:12345-192.168.201.28@tcp:4:cat.0 Request processed in 13086us (13540us total) trans 17179872787 rc 0/0 00000100:00100000:2.0:1746143134.196963:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1996 00002000:00100000:2.0:1746143134.196976:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1695744->1822719) req@ffff8800906a6680 x1830962858701056/t17179872787(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/448 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.196985:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6680 with x1830962858701056 ext(1695744->1822719) 00010000:00010000:2.0:1746143134.196994:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 30 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.197008:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 30 pid: 4756 timeout: 1016 lvb_type: 0 00002000:00010000:2.0:1746143134.197015:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800906a6680 00000100:00100000:0.0:1746143134.197055:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858701696 00000100:00100000:0.0:1746143134.197087:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12509 00000100:00100000:0.0:1746143134.197093:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31022:x1830962858701696:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143134.197106:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143134.197118:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505c4 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143134.197141:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143134.197153:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 18 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143134.197158:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143134.197160:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143134.197163:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1691648->1937407] (req 1691648->1937407) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143134.197189:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 18 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143134.197197:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 18 pid: 4756 timeout: 1016 lvb_type: 1 00000100:00100000:0.0:1746143134.197222:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861273472:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143134.197277:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143134.197285:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 21 pid: 8449 timeout: 1016 lvb_type: 1 00000100:00100000:0.0:1746143134.197293:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b800700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861273600:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143134.197313:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dd7540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143134.205201:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858701440:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21343us (21524us total) trans 0 rc 921600/921600 00000100:00100000:3.0:1746143134.205223:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1995 00002000:00100000:3.0:1746143134.205234:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800906a5180 x1830962858701440/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 504/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 921600/921600 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.205243:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5180 with x1830962858701440 ext(1048576->2097151) 00010000:00010000:3.0:1746143134.205253:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 28 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.205265:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 28 pid: 4756 timeout: 1016 lvb_type: 0 00002000:00010000:3.0:1746143134.205272:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800906a5180 00000100:00100000:1.0:1746143134.207361:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858701568:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20659us (23647us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143134.207371:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6077 00002000:00100000:1.0:1746143134.207378:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800906a5c00 x1830962858701568/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.207386:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5c00 with x1830962858701568 ext(0->1048575) 00002000:00010000:1.0:1746143134.207391:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a5c00 00000100:00100000:0.0:1746143134.210023:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.210256:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858701824 00000100:00100000:3.0:1746143134.210264:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858701824 00010000:00010000:3.0:1746143134.210299:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 20 pid: 8449 timeout: 1016 lvb_type: 1 00000100:00100000:3.0:1746143134.210331:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6631 00000100:00100000:3.0:1746143134.210339:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858701824:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.210351:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143134.210370:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 20 pid: 8449 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.210382:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 20 pid: 8449 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.210413:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143134.210455:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858701824:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 116us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.210462:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6631 00000100:00100000:2.0:1746143134.210558:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861273472:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.210569:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2ac00/0x25aee876ca70d792 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165057e expref: 19 pid: 8449 timeout: 1016 lvb_type: 1 00000100:00100000:2.0:1746143134.210584:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b800700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861273600:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.210612:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1691648->1937407] (req 1691648->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.210627:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135e9b800, rc 0) 00000100:00100000:2.0:1746143134.210648:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31022:x1830962858701696:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 13556us (14146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.210655:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12509 00000100:00100000:2.0:1746143134.211853:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.211920:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858701952 00000100:00100000:0.0:1746143134.211925:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858701952 00010000:00010000:0.0:1746143134.211946:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 18 pid: 4756 timeout: 1016 lvb_type: 1 00000100:00100000:0.0:1746143134.211976:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6632 00000100:00100000:0.0:1746143134.211983:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858701952:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143134.211996:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143134.212009:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 18 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:0.0:1746143134.212019:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 18 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:0.0:1746143134.212068:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d7ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a1 expref: 18 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:0.0:1746143134.212087:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143134.212089:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143134.212096:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143134.212102:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143134.212131:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143134.212144:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861273728:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143134.212676:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dd7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143134.213986:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.214075:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858702080 00000100:00100000:3.0:1746143134.214080:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858702080 00010000:00010000:3.0:1746143134.214102:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 28 pid: 4756 timeout: 1016 lvb_type: 0 00000100:00100000:3.0:1746143134.214131:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6633 00000100:00100000:3.0:1746143134.214137:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858702080:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.214146:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143134.214161:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 28 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.214171:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 28 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.214189:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5351400/0x25aee876ca70d784 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->1822719) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650569 expref: 28 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.214222:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.214224:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.214230:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.214242:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.214266:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143134.214276:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861273856:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143134.214328:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143134.215869:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861273728:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143134.215892:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143134.215950:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858701952:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3965us (4097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.215960:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6632 00000100:00100000:0.0:1746143134.217321:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.217397:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858702336 00000100:00100000:1.0:1746143134.217406:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858702336 00002000:00100000:1.0:1746143134.217448:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1691648->1695743) req@ffff88012b801180 x1830962858702336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.217458:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801180 with x1830962858702336 ext(1691648->1695743) 00002000:00010000:1.0:1746143134.217464:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b801180 00000100:00100000:1.0:1746143134.217508:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6078 00000100:00100000:1.0:1746143134.217517:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858702336:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143134.217887:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858702336:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 368us (564us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143134.217895:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6078 00002000:00100000:1.0:1746143134.217902:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1691648->1695743) req@ffff88012b801180 x1830962858702336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.217910:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801180 with x1830962858702336 ext(1691648->1695743) 00002000:00010000:1.0:1746143134.217913:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b801180 00000100:00100000:3.0:1746143134.225361:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861273856:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143134.225382:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143134.225438:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858702080:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11299us (11453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.225448:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6633 00000100:00100000:0.0:1746143134.225865:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.225981:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858702464 00000100:00100000:3.0:1746143134.225988:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858702464 00000100:00100000:3.0:1746143134.226017:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12510 00000100:00100000:3.0:1746143134.226023:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:31019:x1830962858702464:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143134.226067:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143134.226081:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505cb expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.226101:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.226103:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.226109:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 28 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.226128:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 28 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.226136:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f4a00, rc 0) 00000100:00100000:3.0:1746143134.226164:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:31019:x1830962858702464:12345-192.168.201.28@tcp:101:cat.0 Request processed in 141us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.226169:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12510 00000100:00100000:0.0:1746143134.226529:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.226641:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858702720 00000100:00100000:2.0:1746143134.226645:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858702720 00002000:00100000:2.0:1746143134.226669:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1933312->1937407) req@ffff88012b800e00 x1830962858702720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.226677:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800e00 with x1830962858702720 ext(1933312->1937407) 00002000:00010000:2.0:1746143134.226681:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b800e00 00000100:00100000:2.0:1746143134.226700:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6079 00000100:00100000:2.0:1746143134.226704:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858702720:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143134.227055:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858702720:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 349us (526us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143134.227060:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6079 00002000:00100000:2.0:1746143134.227065:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1933312->1937407) req@ffff88012b800e00 x1830962858702720/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.227077:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b800e00 with x1830962858702720 ext(1933312->1937407) 00002000:00010000:2.0:1746143134.227080:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b800e00 00000100:00100000:0.0:1746143134.238359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.238570:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.238606:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.238807:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858702976 00000100:00100000:3.0:1746143134.238817:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858702976 00002000:00100000:3.0:1746143134.238858:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012b802a00 x1830962858702976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.238868:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802a00 with x1830962858702976 ext(1048576->2097151) 00002000:00010000:3.0:1746143134.238873:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b802a00 00000100:00100000:3.0:1746143134.238900:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858703232 00000100:00100000:3.0:1746143134.238902:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858703232 00002000:00100000:3.0:1746143134.238912:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012b803800 x1830962858703232/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 504/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.238918:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803800 with x1830962858703232 ext(1048576->2097151) 00002000:00010000:3.0:1746143134.238921:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b803800 00000100:00100000:3.0:1746143134.238931:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858703488 00000100:00100000:3.0:1746143134.238933:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858703488 00002000:00100000:3.0:1746143134.238945:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->1691647) req@ffff88009b59a300 x1830962858703488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.238952:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59a300 with x1830962858703488 ext(1048576->1691647) 00002000:00010000:3.0:1746143134.238955:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b59a300 00000100:00100000:3.0:1746143134.238973:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6080 00000100:00100000:3.0:1746143134.238980:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858702976:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143134.240125:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6081 00000100:00100000:3.0:1746143134.240133:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858703232:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143134.241361:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6082 00000100:00100000:1.0:1746143134.241370:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858703488:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143134.248623:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.263647:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858703744 00000100:00100000:2.0:1746143134.263659:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858703744 00002000:00100000:2.0:1746143134.263698:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800942c6300 x1830962858703744/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.263707:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6300 with x1830962858703744 ext(1048576->2097151) 00002000:00010000:2.0:1746143134.263712:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c6300 00000100:00100000:2.0:1746143134.263729:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6083 00000100:00100000:2.0:1746143134.263735:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858703744:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143134.291483:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858702976:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 52493us (53121us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143134.291495:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6080 00002000:00100000:3.0:1746143134.291509:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012b802a00 x1830962858702976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.291519:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802a00 with x1830962858702976 ext(1048576->2097151) 00002000:00010000:3.0:1746143134.291524:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b802a00 00000100:00100000:0.0:1746143134.293287:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858703488:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 51915us (54677us total) trans 0 rc 643072/643072 00000100:00100000:0.0:1746143134.293295:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6082 00002000:00100000:0.0:1746143134.293301:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->1691647) req@ffff88009b59a300 x1830962858703488/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 643072/643072 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.293309:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59a300 with x1830962858703488 ext(1048576->1691647) 00002000:00010000:0.0:1746143134.293313:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b59a300 00000100:00100000:2.0:1746143134.294694:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858703232:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 54559us (56121us total) trans 0 rc 921600/921600 00000100:00100000:2.0:1746143134.294702:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6081 00002000:00100000:2.0:1746143134.294707:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012b803800 x1830962858703232/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 504/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 921600/921600 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.294715:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803800 with x1830962858703232 ext(1048576->2097151) 00002000:00010000:2.0:1746143134.294719:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b803800 00000100:00100000:2.0:1746143134.302404:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858703744:12345-192.168.201.28@tcp:3:cat.0 Request processed in 38657us (53780us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143134.302417:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6083 00002000:00100000:2.0:1746143134.302429:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff8800942c6300 x1830962858703744/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.302445:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6300 with x1830962858703744 ext(1048576->2097151) 00002000:00010000:2.0:1746143134.302450:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942c6300 00000100:00100000:0.0:1746143134.313668:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.313713:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.313723:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858704000 00000100:00100000:1.0:1746143134.313758:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858704128 00000100:00100000:1.0:1746143134.313764:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858704128 00000100:00100000:1.0:1746143134.313817:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12511 00000100:00100000:1.0:1746143134.313826:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:31019:x1830962858704128:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.313843:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.313859:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505d2 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.313889:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 15 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.313896:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143134.313898:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143134.313902:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143134.313924:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858704000 00010000:00010000:1.0:1746143134.313938:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 15 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.313948:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 15 pid: 4756 timeout: 1016 lvb_type: 0 00002000:00100000:2.0:1746143134.313949:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1937408->2097151) req@ffff88009b59b480 x1830962858704000/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.313957:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b480 with x1830962858704000 ext(1937408->2097151) 00000100:00100000:1.0:1746143134.313959:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861273984:192.168.201.28@tcp:104: 00002000:00010000:2.0:1746143134.313961:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b59b480 00000100:00100000:2.0:1746143134.313975:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6084 00000100:00100000:2.0:1746143134.313980:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858704000:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143134.314025:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.319697:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861273984:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143134.319726:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.319740:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af7a200, rc 0) 00000100:00100000:1.0:1746143134.319787:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:31019:x1830962858704128:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5962us (6072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.319795:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12511 00000100:00100000:2.0:1746143134.319952:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858704000:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 5971us (6292us total) trans 0 rc 159744/159744 00000100:00100000:2.0:1746143134.319960:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6084 00002000:00100000:2.0:1746143134.319967:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1937408->2097151) req@ffff88009b59b480 x1830962858704000/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 159744/159744 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.319975:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b480 with x1830962858704000 ext(1937408->2097151) 00002000:00010000:2.0:1746143134.319979:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b59b480 00000100:00100000:0.0:1746143134.321951:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.322281:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858704256 00000100:00100000:3.0:1746143134.322288:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858704256 00002000:00100000:3.0:1746143134.322325:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1486848->1613823) req@ffff88009b599500 x1830962858704256/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.322331:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599500 with x1830962858704256 ext(1486848->1613823) 00010000:00010000:3.0:1746143134.322337:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 16 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.322345:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 16 pid: 4756 timeout: 1016 lvb_type: 0 00002000:00010000:3.0:1746143134.322349:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b599500 00000100:00100000:3.0:1746143134.322362:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1997 00000100:00100000:3.0:1746143134.322366:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858704256:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:3.0:1746143134.328281:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858704256:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 5905us (6325us total) trans 17179872788 rc 0/0 00000100:00100000:3.0:1746143134.328292:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1997 00002000:00100000:3.0:1746143134.328301:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1486848->1613823) req@ffff88009b599500 x1830962858704256/t17179872788(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/448 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.328309:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599500 with x1830962858704256 ext(1486848->1613823) 00010000:00010000:3.0:1746143134.328318:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 18 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.328332:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 18 pid: 4756 timeout: 1016 lvb_type: 0 00002000:00010000:3.0:1746143134.328338:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b599500 00000100:00100000:0.0:1746143134.332001:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.338319:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.338370:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.338479:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858704384 00000100:00100000:3.0:1746143134.338489:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858704384 00010000:00010000:3.0:1746143134.338521:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 18 pid: 4756 timeout: 1016 lvb_type: 0 00000100:00100000:3.0:1746143134.338554:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6634 00000100:00100000:3.0:1746143134.338562:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858704384:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.338573:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143134.338587:0:16965:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143132 -> 1746143133 00010000:00010000:3.0:1746143134.338593:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 18 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.338604:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 18 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.338623:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5350600/0x25aee876ca70d7b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1613823) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165058c expref: 18 pid: 4756 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.338652:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.338654:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.338660:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.338667:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.338698:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143134.338710:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861274112:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143134.338768:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143134.338856:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858704640 00000100:00100000:2.0:1746143134.338860:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858704640 00002000:00100000:2.0:1746143134.338915:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094512a00 x1830962858704640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.338924:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512a00 with x1830962858704640 ext(2097152->3145727) 00002000:00010000:2.0:1746143134.338928:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094512a00 00000100:00100000:2.0:1746143134.338950:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858704896 00000100:00100000:2.0:1746143134.338953:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858704896 00002000:00100000:2.0:1746143134.338964:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094510000 x1830962858704896/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.338971:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510000 with x1830962858704896 ext(3145728->4194303) 00002000:00010000:2.0:1746143134.338974:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094510000 00000100:00100000:2.0:1746143134.338985:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6085 00000100:00100000:2.0:1746143134.338990:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858704640:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143134.339056:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6086 00000100:00100000:3.0:1746143134.339064:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858704896:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143134.342333:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.342363:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.342380:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858705152 00000100:00100000:1.0:1746143134.342386:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858705152 00002000:00100000:1.0:1746143134.342417:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094513800 x1830962858705152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.342426:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513800 with x1830962858705152 ext(2097152->3145727) 00002000:00010000:1.0:1746143134.342430:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094513800 00000100:00100000:1.0:1746143134.342444:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858705408 00000100:00100000:1.0:1746143134.342446:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858705408 00002000:00100000:1.0:1746143134.342456:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094510e00 x1830962858705408/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.342462:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510e00 with x1830962858705408 ext(3145728->4194303) 00002000:00010000:1.0:1746143134.342464:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094510e00 00000100:00100000:1.0:1746143134.342474:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6087 00000100:00100000:1.0:1746143134.342480:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858705152:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143134.344364:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6088 00000100:00100000:1.0:1746143134.344375:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858705408:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143134.349766:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.349790:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858705664 00000100:00100000:0.0:1746143134.349802:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858705664 00000100:00100000:3.0:1746143134.349821:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861274112:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143134.349840:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746143134.349842:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094511f80 x1830962858705664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.349852:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511f80 with x1830962858705664 ext(1048576->2097151) 00002000:00010000:0.0:1746143134.349857:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094511f80 00000100:00100000:0.0:1746143134.350343:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6089 00000100:00100000:0.0:1746143134.350353:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858705664:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143134.351065:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858704384:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 12501us (19293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.351075:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6634 00000100:00100000:2.0:1746143134.368696:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858704640:12345-192.168.201.28@tcp:3:cat.0 Request processed in 29694us (30373us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143134.368708:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6085 00002000:00100000:2.0:1746143134.368720:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094512a00 x1830962858704640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.368730:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512a00 with x1830962858704640 ext(2097152->3145727) 00002000:00010000:2.0:1746143134.368734:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094512a00 00000100:00100000:0.0:1746143134.369845:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.371020:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858705792 00000100:00100000:1.0:1746143134.371028:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858705792 00000100:00100000:3.0:1746143134.371060:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858704896:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31993us (32685us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143134.371070:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6086 00002000:00100000:3.0:1746143134.371078:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094510000 x1830962858704896/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143134.371086:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12512 00002000:00100000:3.0:1746143134.371087:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510000 with x1830962858704896 ext(3145728->4194303) 00002000:00010000:3.0:1746143134.371092:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094510000 00000100:00100000:1.0:1746143134.371093:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31023:x1830962858705792:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143134.371107:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.371123:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505d9 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.371153:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 32 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.371161:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.371167:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.371169:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.371173:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3416064->4194303] (req 3416064->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 32 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.371211:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.371222:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 20 pid: 4756 timeout: 1016 lvb_type: 1 00000100:00100000:1.0:1746143134.371233:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861274240:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143134.371893:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 32 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.371902:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 32 pid: 8450 timeout: 1016 lvb_type: 1 00000100:00100000:1.0:1746143134.371910:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094513100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861274368:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143134.371934:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143134.381079:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.381423:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858705920 00000100:00100000:3.0:1746143134.381431:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858705920 00010000:00010000:3.0:1746143134.381462:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 33 pid: 8450 timeout: 1016 lvb_type: 1 00000100:00100000:1.0:1746143134.381623:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858705152:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39141us (39295us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143134.381634:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6087 00002000:00100000:1.0:1746143134.381643:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094513800 x1830962858705152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.381651:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513800 with x1830962858705152 ext(2097152->3145727) 00010000:00010000:1.0:1746143134.381657:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 19 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:1.0:1746143134.381666:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 19 pid: 4756 timeout: 1016 lvb_type: 1 00002000:00010000:1.0:1746143134.381672:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094513800 00000100:00100000:3.0:1746143134.381903:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6635 00000100:00100000:3.0:1746143134.381909:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858705920:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.381920:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143134.381933:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 33 pid: 8450 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.381942:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 33 pid: 8450 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.381963:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143134.381982:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1968:x1830962858705920:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 73us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.381990:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6635 00000100:00100000:0.0:1746143134.382371:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861274240:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143134.382383:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70d776 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650562 expref: 32 pid: 8450 timeout: 1016 lvb_type: 1 00000100:00100000:0.0:1746143134.382398:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094513100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861274368:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143134.382421:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3416064->4194303] (req 3416064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 31 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143134.382430:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af7b600, rc 0) 00000100:00100000:0.0:1746143134.382462:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31023:x1830962858705792:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11370us (12619us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143134.382471:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12512 00000100:00100000:1.0:1746143134.394766:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858705408:12345-192.168.201.28@tcp:3:cat.0 Request processed in 50384us (52392us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143134.394777:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6088 00002000:00100000:1.0:1746143134.394788:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094510e00 x1830962858705408/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.394797:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094510e00 with x1830962858705408 ext(3145728->4194303) 00010000:00010000:1.0:1746143134.394806:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 17 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:1.0:1746143134.394820:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 17 pid: 4756 timeout: 1016 lvb_type: 1 00002000:00010000:1.0:1746143134.394833:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094510e00 00000100:00100000:0.0:1746143134.404392:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.405762:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.406420:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858705664:12345-192.168.201.28@tcp:3:cat.0 Request processed in 56066us (56659us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143134.406433:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6089 00002000:00100000:1.0:1746143134.406446:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094511f80 x1830962858705664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.406457:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511f80 with x1830962858705664 ext(1048576->2097151) 00002000:00010000:1.0:1746143134.406464:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094511f80 00000100:00100000:3.0:1746143134.406732:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858706176 00000100:00100000:3.0:1746143134.406741:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858706176 00010000:00010000:3.0:1746143134.406772:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 17 pid: 4756 timeout: 1016 lvb_type: 1 00000100:00100000:3.0:1746143134.406800:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6636 00000100:00100000:3.0:1746143134.406808:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858706176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.406821:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143134.406841:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 17 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.406852:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 17 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.406877:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b51f1600/0x25aee876ca70d7d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505af expref: 17 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.406896:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.406899:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.406906:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.406914:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.406946:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143134.406959:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861274496:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143134.407651:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858706048 00000100:00100000:2.0:1746143134.407656:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858706048 00000100:00100000:2.0:1746143134.407689:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12513 00000100:00100000:2.0:1746143134.407695:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31016:x1830962858706048:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143134.407709:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.407722:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505e0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.407741:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.407748:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143134.407749:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143134.407752:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.407770:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.407782:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 28 pid: 8449 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.407791:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861274624:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143134.408645:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143134.408742:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143134.411983:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.412383:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861274624:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143134.412637:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143134.412654:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd18000, rc 0) 00000100:00100000:2.0:1746143134.412782:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858706304 00000100:00100000:2.0:1746143134.412788:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858706304 00000100:00100000:2.0:1746143134.412830:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12514 00000100:00100000:2.0:1746143134.412837:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:31019:x1830962858706304:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143134.412853:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.412868:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505e7 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.412891:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.412897:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143134.412900:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143134.412904:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.412927:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.412938:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 16 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.412949:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861274752:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143134.413322:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861274496:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143134.413335:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143134.416161:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143134.416259:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858706176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9447us (10496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.416271:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6636 00000100:00100000:0.0:1746143134.416793:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31016:x1830962858706048:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9095us (12410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143134.416803:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12513 00000100:00100000:3.0:1746143134.417143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.418252:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858706560 00000100:00100000:0.0:1746143134.418259:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858706560 00002000:00100000:0.0:1746143134.418300:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3416064->3420159) req@ffff88008eaafb80 x1830962858706560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.418310:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaafb80 with x1830962858706560 ext(3416064->3420159) 00010000:00010000:0.0:1746143134.418319:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 29 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:0.0:1746143134.418332:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 29 pid: 8449 timeout: 1016 lvb_type: 0 00002000:00010000:0.0:1746143134.418339:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008eaafb80 00000100:00100000:0.0:1746143134.418355:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1998 00000100:00100000:0.0:1746143134.418361:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858706560:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143134.419302:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858706560:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 938us (2155us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143134.419309:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1998 00002000:00100000:0.0:1746143134.419315:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3416064->3420159) req@ffff88008eaafb80 x1830962858706560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.419323:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaafb80 with x1830962858706560 ext(3416064->3420159) 00010000:00010000:0.0:1746143134.419330:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 29 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:0.0:1746143134.419343:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 29 pid: 8449 timeout: 1016 lvb_type: 0 00002000:00010000:0.0:1746143134.419350:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008eaafb80 00000100:00100000:2.0:1746143134.420278:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861274752:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.420302:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.420313:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd18600, rc 0) 00000100:00100000:2.0:1746143134.420342:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:31019:x1830962858706304:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7505us (8371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.420349:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12514 00000100:00100000:0.0:1746143134.425728:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.425828:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858706688 00000100:00100000:1.0:1746143134.425837:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858706688 00002000:00100000:1.0:1746143134.425882:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1691648->1937407) req@ffff88009b598700 x1830962858706688/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.425893:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598700 with x1830962858706688 ext(1691648->1937407) 00010000:00010000:1.0:1746143134.425903:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 17 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.425916:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 17 pid: 4758 timeout: 1016 lvb_type: 0 00002000:00010000:1.0:1746143134.425923:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b598700 00000100:00100000:1.0:1746143134.425955:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 1999 00000100:00100000:1.0:1746143134.425962:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858706688:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143134.431846:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.432082:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858707072 00000100:00100000:2.0:1746143134.432093:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858707072 00000100:00100000:2.0:1746143134.432139:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12515 00000100:00100000:2.0:1746143134.432148:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:31023:x1830962858707072:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143134.432167:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.432186:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505ee expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.432234:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 21 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.432243:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 18 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143134.432249:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.432251:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.432255:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4210687] (req 4194304->4210687) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.432283:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 18 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143134.432294:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 18 pid: 4756 timeout: 1016 lvb_type: 1 00000100:00100000:2.0:1746143134.432304:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861274880:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.432646:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 21 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.432655:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 21 pid: 21048 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.432663:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861275008:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143134.432679:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143134.433401:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.433467:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858706944 00000100:00100000:0.0:1746143134.433472:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858706944 00002000:00100000:0.0:1746143134.433518:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3416064->4194303) req@ffff88009194b800 x1830962858706944/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.433528:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194b800 with x1830962858706944 ext(3416064->4194303) 00010000:00010000:0.0:1746143134.433535:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 29 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:0.0:1746143134.433545:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 29 pid: 8449 timeout: 1016 lvb_type: 0 00002000:00010000:0.0:1746143134.433552:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009194b800 00000100:00100000:0.0:1746143134.433568:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2000 00000100:00100000:0.0:1746143134.433574:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858706944:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:1.0:1746143134.436377:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858706688:12345-192.168.201.28@tcp:4:cat.0 Request processed in 10403us (10650us total) trans 21474840049 rc 0/0 00000100:00100000:1.0:1746143134.436391:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 1999 00002000:00100000:1.0:1746143134.436402:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1691648->1937407) req@ffff88009b598700 x1830962858706688/t21474840049(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/448 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.436411:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598700 with x1830962858706688 ext(1691648->1937407) 00010000:00010000:1.0:1746143134.436421:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.436432:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00002000:00010000:1.0:1746143134.436440:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b598700 00000100:00100000:2.0:1746143134.437235:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861274880:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143134.437394:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861275008:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.437425:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4210687] (req 4194304->4210687) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.437443:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009490d000, rc 0) 00000100:00100000:2.0:1746143134.437482:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31023:x1830962858707072:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5334us (5650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.437489:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12515 00000100:00100000:0.0:1746143134.438332:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.438474:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858707200 00000100:00100000:3.0:1746143134.438481:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858707200 00010000:00010000:3.0:1746143134.438507:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 21 pid: 21048 timeout: 1016 lvb_type: 0 00000100:00100000:3.0:1746143134.438527:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6637 00000100:00100000:3.0:1746143134.438534:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858707200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.438546:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143134.438568:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 21 pid: 21048 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.438578:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 21 pid: 21048 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.438603:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d408600/0x25aee876ca70d78b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650570 expref: 21 pid: 21048 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.438615:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143134.439848:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858707200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1306us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.439857:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6637 00000100:00100000:3.0:1746143134.444143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.444452:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858707328 00000100:00100000:1.0:1746143134.444461:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858707328 00010000:00010000:1.0:1746143134.444496:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:1.0:1746143134.444524:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6638 00000100:00100000:1.0:1746143134.444530:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858707328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143134.444543:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143134.444563:0:16965:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143132 -> 1746143133 00002000:00010000:1.0:1746143134.444565:0:16965:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143131 -> 1746143133 00002000:00010000:1.0:1746143134.444567:0:16965:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143132 -> 1746143133 00010000:00010000:1.0:1746143134.444574:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.444591:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.444613:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135e9b800/0x25aee876ca70d7ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1691648->1937407) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505c4 expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.444639:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.444641:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.444649:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.444658:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.444693:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143134.444705:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861275136:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143134.444785:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143134.449482:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.449836:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858707456 00000100:00100000:3.0:1746143134.449845:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858707456 00010000:00010000:3.0:1746143134.449879:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 19 pid: 4756 timeout: 1016 lvb_type: 1 00000100:00100000:3.0:1746143134.450087:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6639 00000100:00100000:3.0:1746143134.450096:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858707456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.450112:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143134.450136:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 19 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.450150:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 19 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.450174:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009475ae00/0x25aee876ca70d7d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505a8 expref: 19 pid: 4756 timeout: 1016 lvb_type: 1 00010000:00010000:3.0:1746143134.450210:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.450212:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.450220:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.450380:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.450416:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143134.450430:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861275264:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143134.450501:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143134.450833:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858706944:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 17249us (17424us total) trans 17179872789 rc 0/0 00000100:00100000:2.0:1746143134.450846:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2000 00002000:00100000:2.0:1746143134.450857:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3416064->4194303) req@ffff88009194b800 x1830962858706944/t17179872789(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/448 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.450867:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194b800 with x1830962858706944 ext(3416064->4194303) 00010000:00010000:2.0:1746143134.450878:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 31 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.450895:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 31 pid: 8449 timeout: 1016 lvb_type: 0 00002000:00010000:2.0:1746143134.450902:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009194b800 00000100:00100000:0.0:1746143134.452094:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861275136:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143134.452115:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143134.452144:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858707328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7613us (8011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143134.452153:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6638 00000100:00100000:0.0:1746143134.458417:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.458461:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861275264:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143134.458462:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143134.458486:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143134.458501:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.458533:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858707456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8437us (9059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.458546:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6639 00000100:00100000:3.0:1746143134.458578:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858707840 00000100:00100000:3.0:1746143134.458584:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858707840 00010000:00010000:3.0:1746143134.458607:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 31 pid: 8449 timeout: 1016 lvb_type: 0 00000100:00100000:1.0:1746143134.458607:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858707712 00000100:00100000:1.0:1746143134.458618:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858707712 00000100:00100000:3.0:1746143134.458640:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6640 00000100:00100000:3.0:1746143134.458648:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a507c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858707840:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143134.458648:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858708096 00000100:00100000:2.0:1746143134.458653:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858708096 00010000:00010000:3.0:1746143134.458660:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746143134.458679:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009b599c00 x1830962858708096/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.458679:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4206592->4210687) req@ffff88009b59a680 x1830962858707712/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:3.0:1746143134.458680:0:7111:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143132 -> 1746143133 00002000:00010000:3.0:1746143134.458683:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143132 -> 1746143133 00010000:00010000:3.0:1746143134.458689:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 31 pid: 8449 timeout: 1016 lvb_type: 0 00002000:00100000:2.0:1746143134.458689:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599c00 with x1830962858708096 ext(1048576->2097151) 00002000:00100000:1.0:1746143134.458689:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59a680 with x1830962858707712 ext(4206592->4210687) 00002000:00010000:2.0:1746143134.458694:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b599c00 00002000:00010000:1.0:1746143134.458694:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b59a680 00010000:00010000:3.0:1746143134.458703:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 31 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.458726:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af7b600/0x25aee876ca70d802 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d9 expref: 31 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.458747:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.458749:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.458756:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.458765:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.458797:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143134.458809:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861275392:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143134.458810:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6090 00000100:00100000:2.0:1746143134.458818:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858707712:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143134.458856:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143134.458878:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6091 00000100:00100000:3.0:1746143134.458885:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858708096:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143134.458966:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858707712:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 148us (562us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143134.458972:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6090 00002000:00100000:2.0:1746143134.458977:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4206592->4210687) req@ffff88009b59a680 x1830962858707712/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.458983:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59a680 with x1830962858707712 ext(4206592->4210687) 00002000:00010000:2.0:1746143134.458986:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b59a680 00000100:00100000:3.0:1746143134.479486:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861275392:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143134.479504:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143134.479553:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a507c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858707840:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 20906us (21090us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.479564:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6640 00000100:00100000:0.0:1746143134.483534:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.484150:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858708352 00000100:00100000:1.0:1746143134.484162:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858708352 00002000:00100000:1.0:1746143134.484229:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009b598380 x1830962858708352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.484238:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598380 with x1830962858708352 ext(3145728->4194303) 00002000:00010000:1.0:1746143134.484243:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598380 00000100:00100000:1.0:1746143134.484281:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6092 00000100:00100000:1.0:1746143134.484288:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858708352:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143134.484459:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858708096:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 25572us (25955us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143134.484468:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6091 00002000:00100000:3.0:1746143134.484477:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009b599c00 x1830962858708096/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.484485:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599c00 with x1830962858708096 ext(1048576->2097151) 00002000:00010000:3.0:1746143134.484490:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b599c00 00000100:00100000:0.0:1746143134.495699:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.495800:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858708608 00000100:00100000:3.0:1746143134.495809:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858708608 00002000:00100000:3.0:1746143134.495847:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009b599180 x1830962858708608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.495855:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599180 with x1830962858708608 ext(2097152->3145727) 00002000:00010000:3.0:1746143134.495861:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b599180 00000100:00100000:3.0:1746143134.496112:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6093 00000100:00100000:3.0:1746143134.496120:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858708608:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143134.496461:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858708352:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12172us (12935us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143134.496468:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6092 00002000:00100000:1.0:1746143134.496474:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009b598380 x1830962858708352/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.496481:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598380 with x1830962858708352 ext(3145728->4194303) 00002000:00010000:1.0:1746143134.496485:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598380 00000100:00100000:0.0:1746143134.503189:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.503243:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.503281:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.504318:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858708864 00000100:00100000:2.0:1746143134.504328:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858708864 00000100:00100000:1.0:1746143134.504373:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858708736 00000100:00100000:1.0:1746143134.504377:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858708736 00000100:00100000:1.0:1746143134.504398:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858708992 00000100:00100000:1.0:1746143134.504401:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858708992 00000100:00100000:1.0:1746143134.504418:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12516 00000100:00100000:1.0:1746143134.504426:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858708864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.504445:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.504462:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505fc expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.504486:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.504489:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.504497:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.504512:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.504524:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f8b600, rc 0) 00000100:00100000:0.0:1746143134.504526:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12517 00000100:00100000:0.0:1746143134.504532:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858708736:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143134.504540:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143134.504548:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16505f5 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143134.504559:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143134.504561:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143134.504565:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143134.504567:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858708864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 143us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.504573:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12516 00010000:00010000:0.0:1746143134.504574:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143134.504581:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc0e00, rc 0) 00000100:00100000:1.0:1746143134.504588:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12518 00000100:00100000:1.0:1746143134.504593:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858708992:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:0.0:1746143134.504594:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858708736:12345-192.168.201.28@tcp:101:cat.0 Request processed in 64us (1352us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143134.504598:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143134.504602:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12517 00010000:00010000:1.0:1746143134.504604:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f8bc00/0x25aee876ca70d82c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650603 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143134.504638:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861275520:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143134.504931:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.505442:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858708608:12345-192.168.201.28@tcp:3:cat.0 Request processed in 9321us (9751us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143134.505450:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6093 00002000:00100000:1.0:1746143134.505459:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88009b599180 x1830962858708608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.505468:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b599180 with x1830962858708608 ext(2097152->3145727) 00002000:00010000:1.0:1746143134.505472:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b599180 00002000:00010000:1.0:1746143134.512969:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143132 -> 1746143133 00002000:00010000:1.0:1746143134.512979:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143132 -> 1746143133 00002000:00010000:1.0:1746143134.512981:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143132 -> 1746143133 00000100:00100000:1.0:1746143134.513009:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861275520:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143134.513070:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f8bc00/0x25aee876ca70d82c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650603 expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.513083:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f8bc00/0x25aee876ca70d82c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650603 expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143134.513103:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f8bc00, rc 0) 00000100:00100000:0.0:1746143134.513119:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.513186:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858709120 00000100:00100000:3.0:1746143134.513193:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858709120 00000100:00100000:3.0:1746143134.513246:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12519 00000100:00100000:3.0:1746143134.513253:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:31019:x1830962858709120:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143134.513270:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143134.513288:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165060a expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.513317:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.513319:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.513326:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.513341:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.513351:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f5800, rc 0) 00000100:00100000:3.0:1746143134.513389:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31019:x1830962858709120:12345-192.168.201.28@tcp:101:cat.0 Request processed in 136us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.513395:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12519 00000100:00100000:1.0:1746143134.513450:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858708992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8855us (10167us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143134.513455:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12518 00000100:00100000:0.0:1746143134.520935:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.522300:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858709248 00000100:00100000:1.0:1746143134.522313:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858709248 00000100:00100000:1.0:1746143134.522587:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12520 00000100:00100000:1.0:1746143134.522598:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31016:x1830962858709248:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.522621:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.522642:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650611 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.522678:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.522686:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143134.522690:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143134.522694:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.522734:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.523002:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:1.0:1746143134.523017:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861275648:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143134.524411:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.524708:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.524727:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.524729:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858709504 00000100:00100000:2.0:1746143134.524735:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858709504 00000100:00100000:1.0:1746143134.524762:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143134.524775:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094513100 x1830962858709504/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143134.524782:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858709888 00002000:00100000:2.0:1746143134.524785:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513100 with x1830962858709504 ext(2097152->3145727) 00000100:00100000:1.0:1746143134.524785:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858709888 00002000:00010000:2.0:1746143134.524790:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094513100 00002000:00100000:1.0:1746143134.524799:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094513480 x1830962858709888/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143134.524813:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858710016 00000100:00100000:2.0:1746143134.524815:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858710016 00002000:00100000:2.0:1746143134.524828:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2fb80 x1830962858710016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143134.524839:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6094 00002000:00100000:2.0:1746143134.524839:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2fb80 with x1830962858710016 ext(3145728->4194303) 00010000:00010000:2.0:1746143134.524845:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 20 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:3.0:1746143134.524848:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858709504:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:2.0:1746143134.524856:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 20 pid: 4758 timeout: 1016 lvb_type: 0 00002000:00010000:2.0:1746143134.524862:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ae2fb80 00000100:00100000:2.0:1746143134.524878:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2001 00000100:00100000:2.0:1746143134.524883:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858710016:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:1.0:1746143134.531249:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513480 with x1830962858709888 ext(3145728->4194303) 00002000:00010000:1.0:1746143134.531272:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094513480 00000100:00100000:1.0:1746143134.531328:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6095 00000100:00100000:1.0:1746143134.531344:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858709888:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:2.0:1746143134.536582:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143134.552225:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094512300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861275648:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143134.552268:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.552296:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d77800, rc 0) 00000100:00100000:1.0:1746143134.552357:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31016:x1830962858709248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 29758us (31434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.552367:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12520 00000100:00100000:2.0:1746143134.555183:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.557271:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858710016:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32379us (32499us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143134.557283:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2001 00002000:00100000:2.0:1746143134.557295:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2fb80 x1830962858710016/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.557305:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2fb80 with x1830962858710016 ext(3145728->4194303) 00010000:00010000:2.0:1746143134.557316:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 20 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.557332:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 20 pid: 4758 timeout: 1016 lvb_type: 0 00002000:00010000:2.0:1746143134.557555:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ae2fb80 00000100:00100000:2.0:1746143134.557579:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858710144 00000100:00100000:2.0:1746143134.557585:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858710144 00002000:00100000:2.0:1746143134.557609:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4210687) req@ffff88009194a300 x1830962858710144/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 16872/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.557616:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194a300 with x1830962858710144 ext(4194304->4210687) 00010000:00010000:2.0:1746143134.557620:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 20 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.557628:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 20 pid: 4758 timeout: 1016 lvb_type: 0 00002000:00010000:2.0:1746143134.557633:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009194a300 00000100:00100000:2.0:1746143134.557651:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2002 00000100:00100000:2.0:1746143134.557656:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858710144:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143134.557977:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858710144:12345-192.168.201.28@tcp:4:cat.0 Request processed in 320us (2805us total) trans 21474840050 rc 0/0 00000100:00100000:2.0:1746143134.557982:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2002 00002000:00100000:2.0:1746143134.557987:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4210687) req@ffff88009194a300 x1830962858710144/t21474840050(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 16872/448 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.557993:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194a300 with x1830962858710144 ext(4194304->4210687) 00010000:00010000:2.0:1746143134.557998:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 22 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.558011:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 22 pid: 4758 timeout: 1016 lvb_type: 0 00002000:00010000:2.0:1746143134.558017:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009194a300 00000100:00100000:3.0:1746143134.565085:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858709504:12345-192.168.201.28@tcp:3:cat.0 Request processed in 40225us (40366us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143134.565097:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6094 00002000:00100000:3.0:1746143134.565109:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094513100 x1830962858709504/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.565118:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513100 with x1830962858709504 ext(2097152->3145727) 00002000:00010000:3.0:1746143134.565124:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094513100 00000100:00100000:0.0:1746143134.570973:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858709888:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39625us (46232us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143134.570985:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6095 00002000:00100000:0.0:1746143134.570997:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094513480 x1830962858709888/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.571007:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094513480 with x1830962858709888 ext(3145728->4194303) 00002000:00010000:0.0:1746143134.571013:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094513480 00000100:00100000:0.0:1746143134.572119:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.572548:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858710272 00000100:00100000:3.0:1746143134.572557:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858710272 00010000:00010000:3.0:1746143134.572589:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 22 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:3.0:1746143134.572627:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6641 00000100:00100000:3.0:1746143134.572634:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858710272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143134.572648:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143134.572668:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 22 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.572680:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 22 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.572703:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009490d000/0x25aee876ca70d817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505ee expref: 22 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:3.0:1746143134.572730:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.572732:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.572740:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.572748:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.572778:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143134.572790:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861275776:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143134.574616:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.584073:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861275776:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143134.584094:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143134.584438:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858710272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11802us (12321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.584450:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6641 00000100:00100000:0.0:1746143134.590303:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.591079:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.591219:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858710400 00000100:00100000:1.0:1746143134.591230:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858710400 00000100:00100000:1.0:1746143134.591311:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12521 00000100:00100000:1.0:1746143134.591323:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31019:x1830962858710400:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143134.591346:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143134.591367:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650618 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.591397:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.591400:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.591410:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.591427:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.591446:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc0000, rc 0) 00000100:00100000:1.0:1746143134.591517:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31019:x1830962858710400:12345-192.168.201.28@tcp:101:cat.0 Request processed in 194us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.591524:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12521 00000100:00100000:2.0:1746143134.591919:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858710656 00000100:00100000:2.0:1746143134.591926:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858710656 00002000:00100000:2.0:1746143134.591965:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094516a00 x1830962858710656/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.591976:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516a00 with x1830962858710656 ext(4194304->5210111) 00002000:00010000:2.0:1746143134.591981:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094516a00 00000100:00100000:2.0:1746143134.592009:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6096 00000100:00100000:2.0:1746143134.592017:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858710656:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143134.609608:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.609687:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858710912 00000100:00100000:3.0:1746143134.609697:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858710912 00002000:00100000:3.0:1746143134.609745:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094517100 x1830962858710912/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.609757:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094517100 with x1830962858710912 ext(3145728->4194303) 00002000:00010000:3.0:1746143134.609762:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094517100 00000100:00100000:3.0:1746143134.609797:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6097 00000100:00100000:3.0:1746143134.609806:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858710912:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143134.626912:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858710656:12345-192.168.201.28@tcp:3:cat.0 Request processed in 34882us (35866us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143134.626925:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6096 00002000:00100000:2.0:1746143134.626939:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094516a00 x1830962858710656/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.626949:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516a00 with x1830962858710656 ext(4194304->5210111) 00002000:00010000:2.0:1746143134.626956:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094516a00 00000100:00100000:3.0:1746143134.633649:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858710912:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23831us (24043us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143134.633662:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6097 00002000:00100000:3.0:1746143134.633676:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094517100 x1830962858710912/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.633685:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094517100 with x1830962858710912 ext(3145728->4194303) 00002000:00010000:3.0:1746143134.633691:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094517100 00000100:00100000:0.0:1746143134.642236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.642391:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858711168 00000100:00100000:3.0:1746143134.642403:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858711168 00002000:00100000:3.0:1746143134.642459:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094515180 x1830962858711168/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.642470:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515180 with x1830962858711168 ext(4194304->5210111) 00002000:00010000:3.0:1746143134.642477:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094515180 00000100:00100000:3.0:1746143134.642607:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6098 00000100:00100000:3.0:1746143134.642618:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858711168:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143134.664697:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858711168:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22067us (22461us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143134.664710:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6098 00002000:00100000:3.0:1746143134.664726:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094515180 x1830962858711168/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.664736:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515180 with x1830962858711168 ext(4194304->5210111) 00002000:00010000:3.0:1746143134.664743:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094515180 00000100:00100000:0.0:1746143134.676095:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.676238:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858711296 00000100:00100000:3.0:1746143134.676247:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858711296 00000100:00100000:3.0:1746143134.676295:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12522 00000100:00100000:3.0:1746143134.676303:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31026:x1830962858711296:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143134.676323:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143134.676342:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165061f expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.676373:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143134.676381:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 20 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143134.676388:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.676390:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143134.676393:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [397312->1048575] (req 397312->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 20 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.676422:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 20 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143134.676440:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 20 pid: 4758 timeout: 1016 lvb_type: 1 00000100:00100000:3.0:1746143134.676684:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861275904:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.679462:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143134.679477:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 21 pid: 8449 timeout: 1016 lvb_type: 1 00000100:00100000:2.0:1746143134.679492:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861276032:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143134.680594:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.685472:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.685519:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.685549:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858711424 00000100:00100000:1.0:1746143134.685557:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858711424 00010000:00010000:1.0:1746143134.685597:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 22 pid: 8449 timeout: 1016 lvb_type: 1 00000100:00100000:1.0:1746143134.685624:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858711552 00000100:00100000:1.0:1746143134.685626:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858711552 00010000:00010000:1.0:1746143134.685635:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 21 pid: 4758 timeout: 1016 lvb_type: 1 00000100:00100000:1.0:1746143134.685649:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6642 00000100:00100000:1.0:1746143134.685656:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858711424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143134.685670:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143134.685692:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 22 pid: 8449 timeout: 1016 lvb_type: 1 00010000:00010000:1.0:1746143134.685703:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 22 pid: 8449 timeout: 1016 lvb_type: 1 00010000:00010000:1.0:1746143134.685729:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143134.685770:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858711424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.685777:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6642 00000100:00100000:1.0:1746143134.685793:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6643 00000100:00100000:1.0:1746143134.685798:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858711552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143134.685804:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143134.685812:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 21 pid: 4758 timeout: 1016 lvb_type: 1 00010000:00010000:1.0:1746143134.685823:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 21 pid: 4758 timeout: 1016 lvb_type: 1 00010000:00010000:1.0:1746143134.685835:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.685837:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.685844:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.685851:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.685879:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143134.685890:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861276160:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143134.685956:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00010000:00010000:2.0:1746143134.686255:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5350800/0x25aee876ca70d7bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650593 expref: 21 pid: 4758 timeout: 1016 lvb_type: 1 00000100:00100000:2.0:1746143134.686273:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861275904:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.686282:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d753 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165053f expref: 21 pid: 8449 timeout: 1016 lvb_type: 1 00000100:00100000:2.0:1746143134.686290:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861276032:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.686315:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 20 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.686323:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f4400, rc 0) 00000100:00100000:2.0:1746143134.686347:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31026:x1830962858711296:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10045us (10264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.686354:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12522 00000100:00100000:2.0:1746143134.688169:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861276160:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143134.688186:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143134.688225:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858711552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2426us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.688234:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6643 00000100:00100000:1.0:1746143134.690186:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.690278:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858711808 00000100:00100000:3.0:1746143134.690286:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858711808 00002000:00100000:3.0:1746143134.690332:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fc:0x0] (397312->401407) req@ffff88009ae2c380 x1830962858711808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.690343:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c380 with x1830962858711808 ext(397312->401407) 00002000:00010000:3.0:1746143134.690348:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2c380 00000100:00100000:3.0:1746143134.690369:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6099 00000100:00100000:3.0:1746143134.690376:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858711808:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143134.690788:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858711808:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 411us (610us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143134.690795:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6099 00002000:00100000:3.0:1746143134.690801:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fc:0x0] (397312->401407) req@ffff88009ae2c380 x1830962858711808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.690808:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c380 with x1830962858711808 ext(397312->401407) 00002000:00010000:3.0:1746143134.690811:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2c380 00000100:00100000:0.0:1746143134.697697:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.698670:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858711936 00000100:00100000:2.0:1746143134.698680:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858711936 00000100:00100000:2.0:1746143134.698725:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12523 00000100:00100000:2.0:1746143134.698733:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31026:x1830962858711936:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143134.698751:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.698768:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650626 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.698798:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.698807:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.698813:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.698815:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.698818:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->1277951] (req 1048576->1277951) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 19 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.698847:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.698859:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 30 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.698870:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861276288:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.700270:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.700290:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.700301:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861276416:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143134.700401:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143134.701401:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861276288:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143134.707171:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.707505:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858712064 00000100:00100000:2.0:1746143134.707515:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858712064 00010000:00010000:2.0:1746143134.707554:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 31 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.707589:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6644 00000100:00100000:2.0:1746143134.707598:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858712064:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143134.707614:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143134.707638:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 31 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.707651:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 31 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.707674:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4a00/0x25aee876ca70d7f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505cb expref: 31 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.707696:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143134.708257:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858712064:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 658us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.708267:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6644 00000100:00100000:3.0:1746143134.709067:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861276416:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143134.709099:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->1277951] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 19 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143134.709112:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a472ca00, rc 0) 00000100:00100000:3.0:1746143134.709145:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31026:x1830962858711936:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10413us (11459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143134.709153:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12523 00000100:00100000:0.0:1746143134.711675:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.713257:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858712192 00000100:00100000:1.0:1746143134.713266:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858712192 00010000:00010000:1.0:1746143134.713303:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00000100:00100000:1.0:1746143134.714118:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6645 00000100:00100000:1.0:1746143134.714128:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858712192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143134.714143:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143134.714168:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.714181:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.714213:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd2a400/0x25aee876ca70d7e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505bd expref: 19 pid: 4758 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.714242:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.714244:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.714250:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 18 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.714259:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 18 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.714294:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 18 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143134.714306:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861276544:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143134.714959:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.720210:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861276544:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143134.720235:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143134.720284:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858712192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6156us (8618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.720296:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6645 00000100:00100000:0.0:1746143134.721874:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.721968:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858712448 00000100:00100000:2.0:1746143134.721975:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858712448 00002000:00100000:2.0:1746143134.722016:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1273856->1277951) req@ffff880094517480 x1830962858712448/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.722054:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094517480 with x1830962858712448 ext(1273856->1277951) 00002000:00010000:2.0:1746143134.722059:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094517480 00000100:00100000:3.0:1746143134.723289:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6100 00000100:00100000:3.0:1746143134.723304:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858712448:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143134.723518:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858712448:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 218us (1647us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143134.723524:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6100 00002000:00100000:3.0:1746143134.723530:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1273856->1277951) req@ffff880094517480 x1830962858712448/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.723539:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094517480 with x1830962858712448 ext(1273856->1277951) 00002000:00010000:3.0:1746143134.723544:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094517480 00000100:00100000:0.0:1746143134.768916:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.768964:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.768994:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.769072:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.769115:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858712704 00000100:00100000:0.0:1746143134.769125:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858712704 00002000:00100000:0.0:1746143134.769176:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (0->397311) req@ffff880094516680 x1830962858712704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.769186:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516680 with x1830962858712704 ext(0->397311) 00002000:00010000:0.0:1746143134.769192:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094516680 00000100:00100000:0.0:1746143134.769219:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858712960 00000100:00100000:0.0:1746143134.769222:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858712960 00002000:00100000:0.0:1746143134.769234:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1277952->2097151) req@ffff880094514e00 x1830962858712960/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.769241:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514e00 with x1830962858712960 ext(1277952->2097151) 00002000:00010000:0.0:1746143134.769244:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094514e00 00000100:00100000:0.0:1746143134.769251:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858713216 00000100:00100000:0.0:1746143134.769252:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858713216 00002000:00100000:0.0:1746143134.769259:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094515880 x1830962858713216/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.769265:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515880 with x1830962858713216 ext(1048576->2097151) 00002000:00010000:0.0:1746143134.769268:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094515880 00000100:00100000:0.0:1746143134.769273:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858713472 00000100:00100000:0.0:1746143134.769275:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858713472 00002000:00100000:0.0:1746143134.769282:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094515500 x1830962858713472/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143134.769287:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515500 with x1830962858713472 ext(1048576->2097151) 00002000:00010000:0.0:1746143134.769290:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094515500 00000100:00100000:0.0:1746143134.769302:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6101 00000100:00100000:0.0:1746143134.769308:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858712704:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143134.770016:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6102 00000100:00100000:0.0:1746143134.770023:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858712960:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143134.771133:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6103 00000100:00100000:2.0:1746143134.771141:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858713216:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143134.772707:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6104 00000100:00100000:2.0:1746143134.772723:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858713472:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143134.783895:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858712704:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14573us (14979us total) trans 0 rc 397312/397312 00000100:00100000:2.0:1746143134.783909:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6101 00002000:00100000:2.0:1746143134.783923:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (0->397311) req@ffff880094516680 x1830962858712704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 397312/397312 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.783934:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516680 with x1830962858712704 ext(0->397311) 00002000:00010000:2.0:1746143134.783940:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094516680 00000100:00100000:2.0:1746143134.787728:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858712960:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17693us (18751us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746143134.787741:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6102 00002000:00100000:2.0:1746143134.787753:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1277952->2097151) req@ffff880094514e00 x1830962858712960/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.787763:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514e00 with x1830962858712960 ext(1277952->2097151) 00002000:00010000:2.0:1746143134.787770:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094514e00 00000100:00100000:2.0:1746143134.795695:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858713216:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24541us (26686us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143134.795709:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6103 00002000:00100000:2.0:1746143134.795722:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094515880 x1830962858713216/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.795733:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515880 with x1830962858713216 ext(1048576->2097151) 00002000:00010000:2.0:1746143134.795740:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094515880 00000100:00100000:2.0:1746143134.798236:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858713472:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25505us (29154us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143134.798247:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6104 00002000:00100000:2.0:1746143134.798258:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094515500 x1830962858713472/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.798268:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515500 with x1830962858713472 ext(1048576->2097151) 00002000:00010000:2.0:1746143134.798274:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094515500 00000100:00100000:0.0:1746143134.817124:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.817415:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858713728 00000100:00100000:2.0:1746143134.817426:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858713728 00002000:00100000:2.0:1746143134.817474:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008f576d80 x1830962858713728/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.817484:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576d80 with x1830962858713728 ext(2097152->3145727) 00002000:00010000:2.0:1746143134.817490:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f576d80 00000100:00100000:1.0:1746143134.818717:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.820248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.820751:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858713984 00000100:00100000:2.0:1746143134.820761:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858713984 00002000:00100000:2.0:1746143134.820799:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2c700 x1830962858713984/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.820810:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c700 with x1830962858713984 ext(3145728->4194303) 00002000:00010000:2.0:1746143134.820817:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2c700 00000100:00100000:2.0:1746143134.820840:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6105 00000100:00100000:2.0:1746143134.820847:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858713728:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143134.821086:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6106 00000100:00100000:3.0:1746143134.821095:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858713984:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143134.826685:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858714240 00000100:00100000:1.0:1746143134.826700:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858714240 00002000:00100000:1.0:1746143134.826945:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094512300 x1830962858714240/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.826956:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512300 with x1830962858714240 ext(2097152->3145727) 00002000:00010000:1.0:1746143134.826962:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094512300 00000100:00100000:1.0:1746143134.826984:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6107 00000100:00100000:1.0:1746143134.826992:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858714240:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143134.839472:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858713984:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18366us (20743us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143134.839484:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6106 00002000:00100000:3.0:1746143134.839496:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ae2c700 x1830962858713984/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143134.839512:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2c700 with x1830962858713984 ext(3145728->4194303) 00002000:00010000:3.0:1746143134.839519:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2c700 00000100:00100000:2.0:1746143134.850973:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858713728:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30108us (34926us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143134.850986:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6105 00002000:00100000:2.0:1746143134.851000:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008f576d80 x1830962858713728/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.851010:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576d80 with x1830962858713728 ext(2097152->3145727) 00002000:00010000:2.0:1746143134.851017:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f576d80 00000100:00100000:1.0:1746143134.856170:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858714240:12345-192.168.201.28@tcp:3:cat.0 Request processed in 29163us (35910us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143134.856185:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6107 00002000:00100000:1.0:1746143134.856211:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094512300 x1830962858714240/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.856220:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512300 with x1830962858714240 ext(2097152->3145727) 00002000:00010000:1.0:1746143134.856227:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094512300 00000100:00100000:0.0:1746143134.908170:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.908236:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858714368 00000100:00100000:3.0:1746143134.908247:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858714368 00000100:00100000:1.0:1746143134.908287:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143134.908308:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858714496 00000100:00100000:3.0:1746143134.908310:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858714496 00000100:00100000:3.0:1746143134.908328:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12524 00000100:00100000:3.0:1746143134.908336:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858714368:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:2.0:1746143134.908345:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12525 00000100:00100000:2.0:1746143134.908353:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858714496:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143134.908558:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143134.908578:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d409a00/0x25aee876ca70d856 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165062d expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.908579:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.908591:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70d85d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650634 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143134.908637:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861276672:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143134.908724:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861276800:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143134.908731:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143134.908946:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00002000:00010000:3.0:1746143134.913618:0:20836:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143131 -> 1746143133 00002000:00010000:3.0:1746143134.913626:0:20836:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143131 -> 1746143133 00002000:00010000:3.0:1746143134.913628:0:20836:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143131 -> 1746143133 00000100:00100000:3.0:1746143134.913653:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861276800:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143134.913686:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d409a00/0x25aee876ca70d856 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165062d expref: 22 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143134.913700:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d409a00/0x25aee876ca70d856 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165062d expref: 22 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143134.913715:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409a00, rc 0) 00000100:00100000:3.0:1746143134.913774:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858714368:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5438us (5742us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143134.913781:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12524 00002000:00010000:2.0:1746143134.913876:0:8448:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143132 -> 1746143133 00002000:00010000:2.0:1746143134.913879:0:8448:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143132 -> 1746143133 00002000:00010000:2.0:1746143134.913881:0:8448:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143132 -> 1746143133 00000100:00100000:2.0:1746143134.913893:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861276672:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143134.913912:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70d85d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650634 expref: 31 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143134.913927:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70d85d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650634 expref: 31 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143134.913938:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f4600, rc 0) 00000100:00100000:2.0:1746143134.913958:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858714496:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5607us (5672us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143134.913964:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12525 00000100:00100000:0.0:1746143134.917568:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.917627:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858714624 00000100:00100000:2.0:1746143134.917635:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858714624 00000100:00100000:2.0:1746143134.917671:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12526 00000100:00100000:2.0:1746143134.917677:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31041:x1830962858714624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143134.917694:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.917710:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165063b expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.917739:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 18 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.917746:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143134.917748:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143134.917751:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.917776:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 18 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.917791:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 18 pid: 20836 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.917801:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861276928:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143134.917870:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143134.921658:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861276928:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.921692:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.921711:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f4a00, rc 0) 00000100:00100000:2.0:1746143134.921767:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31041:x1830962858714624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4089us (4206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.921775:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12526 00000100:00100000:0.0:1746143134.922229:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.922266:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858714752 00000100:00100000:1.0:1746143134.922272:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858714752 00002000:00100000:1.0:1746143134.922304:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (397312->1048575) req@ffff88008f574000 x1830962858714752/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.922310:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574000 with x1830962858714752 ext(397312->1048575) 00010000:00010000:1.0:1746143134.922316:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 19 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.922331:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 19 pid: 20836 timeout: 1016 lvb_type: 0 00002000:00010000:1.0:1746143134.922336:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f574000 00000100:00100000:1.0:1746143134.922355:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2003 00000100:00100000:1.0:1746143134.922359:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858714752:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143134.957844:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858714752:12345-192.168.201.28@tcp:4:cat.0 Request processed in 35472us (35604us total) trans 21474840051 rc 0/0 00000100:00100000:1.0:1746143134.957858:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2003 00002000:00100000:1.0:1746143134.957871:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (397312->1048575) req@ffff88008f574000 x1830962858714752/t21474840051(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:285/0 lens 488/448 e 0 to 0 dl 1746143145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.957881:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574000 with x1830962858714752 ext(397312->1048575) 00010000:00010000:1.0:1746143134.957892:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.957910:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 1016 lvb_type: 0 00002000:00010000:1.0:1746143134.957921:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f574000 00000100:00100000:1.0:1746143134.965659:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143134.965926:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858714880 00000100:00100000:0.0:1746143134.965936:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858714880 00010000:00010000:0.0:1746143134.965982:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 1016 lvb_type: 0 00000100:00100000:0.0:1746143134.966021:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6646 00000100:00100000:0.0:1746143134.966701:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858714880:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143134.968096:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143134.968136:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.968153:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.968179:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4400/0x25aee876ca70d848 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165061f expref: 21 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.968221:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.968224:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143134.968234:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 21 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.968244:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 21 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143134.968288:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 21 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143134.968303:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861277056:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143134.968436:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143134.974290:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.976867:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858715008 00000100:00100000:2.0:1746143134.976884:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858715008 00000100:00100000:2.0:1746143134.976970:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12527 00000100:00100000:2.0:1746143134.976982:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:31031:x1830962858715008:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143134.977004:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.977026:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650642 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.977092:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.977107:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.977114:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.977116:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.977120:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3092480->3145727] (req 3092480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 31 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.977157:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.977172:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.977185:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861277184:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.977312:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.977322:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 17 pid: 8449 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.977331:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861277312:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143134.977361:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.980078:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861277056:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143134.980101:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143134.980146:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858714880:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 14118us (14498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.980156:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6646 00000100:00100000:2.0:1746143134.981745:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861277184:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143134.981758:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861277312:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.981784:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3092480->3145727] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 31 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.981801:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd19a00, rc 0) 00000100:00100000:2.0:1746143134.981840:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31031:x1830962858715008:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4861us (7565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.981848:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12527 00000100:00100000:0.0:1746143134.984718:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143134.985994:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858715136 00000100:00100000:1.0:1746143134.986005:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858715136 00010000:00010000:1.0:1746143134.986080:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 18 pid: 8449 timeout: 1016 lvb_type: 0 00000100:00100000:1.0:1746143134.986122:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6647 00000100:00100000:1.0:1746143134.986129:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858715136:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143134.986142:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143134.986165:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 18 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.986175:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 18 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.986210:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd18000/0x25aee876ca70d809 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e0 expref: 18 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143134.986235:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143134.986283:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858715136:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 154us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143134.986290:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6647 00000100:00100000:2.0:1746143134.987307:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.987376:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.987400:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858715520 00000100:00100000:2.0:1746143134.987406:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858715520 00010000:00010000:2.0:1746143134.987428:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.987470:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6648 00000100:00100000:2.0:1746143134.987478:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1970:x1830962858715520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143134.987490:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143134.987507:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.987518:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.987534:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8f5800/0x25aee876ca70d833 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165060a expref: 31 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143134.987556:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.987559:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.987567:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.987577:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.987613:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143134.987627:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861277440:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143134.987707:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143134.988003:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858715392 00000100:00100000:1.0:1746143134.988007:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858715392 00002000:00100000:1.0:1746143134.988061:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880091948380 x1830962858715392/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143134.988071:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948380 with x1830962858715392 ext(0->1048575) 00002000:00010000:1.0:1746143134.988075:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948380 00000100:00100000:1.0:1746143134.988089:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6108 00000100:00100000:1.0:1746143134.988094:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858715392:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143134.989305:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861277440:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143134.989322:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143134.989363:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858715520:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1885us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143134.989372:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6648 00000100:00100000:0.0:1746143134.989776:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.989840:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858715776 00000100:00100000:2.0:1746143134.989844:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858715776 00002000:00100000:2.0:1746143134.989868:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3092480->3096575) req@ffff88008f575880 x1830962858715776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/0 e 0 to 0 dl 1746143145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.989877:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575880 with x1830962858715776 ext(3092480->3096575) 00002000:00010000:2.0:1746143134.989881:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f575880 00000100:00100000:2.0:1746143134.989907:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6109 00000100:00100000:2.0:1746143134.989914:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858715776:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143134.990154:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858715776:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 240us (379us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143134.990159:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6109 00002000:00100000:2.0:1746143134.990164:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3092480->3096575) req@ffff88008f575880 x1830962858715776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143134.990171:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575880 with x1830962858715776 ext(3092480->3096575) 00002000:00010000:2.0:1746143134.990173:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f575880 00000100:00100000:0.0:1746143134.996307:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143134.999390:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858715904 00000100:00100000:2.0:1746143134.999401:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858715904 00000100:00100000:2.0:1746143134.999461:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12528 00000100:00100000:2.0:1746143134.999470:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:31031:x1830962858715904:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143134.999493:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143134.999512:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650649 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.999544:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.999552:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.999557:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.999559:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143134.999562:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4136959] (req 3145728->4136959) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.999597:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.999609:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 25 pid: 8449 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.999621:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861277568:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143134.999708:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143134.999717:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 19 pid: 8449 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143134.999725:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861277696:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143134.999742:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.002118:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858715392:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 14015us (14808us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143135.002128:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6108 00002000:00100000:1.0:1746143135.002140:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880091948380 x1830962858715392/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:285/0 lens 488/440 e 0 to 0 dl 1746143145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.002148:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948380 with x1830962858715392 ext(0->1048575) 00002000:00010000:1.0:1746143135.002153:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948380 00000100:00100000:2.0:1746143135.013488:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861277696:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143135.013618:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.013727:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.013767:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.013799:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.013828:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858716160 00000100:00100000:1.0:1746143135.013834:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858716160 00000100:00100000:1.0:1746143135.013876:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858716288 00000100:00100000:1.0:1746143135.013878:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858716288 00000100:00100000:1.0:1746143135.013889:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858716416 00000100:00100000:1.0:1746143135.013891:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858716416 00000100:00100000:1.0:1746143135.013909:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12529 00000100:00100000:1.0:1746143135.013916:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858716160:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.013937:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.013955:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650650 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.013977:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.013979:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.013986:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.014001:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.014012:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136471600, rc 0) 00000100:00100000:1.0:1746143135.014068:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858716160:12345-192.168.201.28@tcp:101:cat.0 Request processed in 151us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.014074:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12529 00000100:00100000:1.0:1746143135.014091:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12530 00000100:00100000:1.0:1746143135.014095:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858716288:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.014101:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.014108:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136470e00/0x25aee876ca70d880 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650657 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.014117:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.014126:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136470e00/0x25aee876ca70d880 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650657 expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.014134:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136470e00/0x25aee876ca70d880 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650657 expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.014147:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136470e00, rc 0) 00000100:00100000:1.0:1746143135.014163:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858716288:12345-192.168.201.28@tcp:101:cat.0 Request processed in 67us (435us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143135.014168:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12530 00000100:00100000:1.0:1746143135.014179:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12531 00000100:00100000:1.0:1746143135.014183:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858716416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.014201:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.014211:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136471200/0x25aee876ca70d887 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165065e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.014247:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861277824:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143135.014298:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328a80 going to sleep for 11 seconds 00000100:00080000:1.0:1746143135.014402:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143135.014405:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143135.014420:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858716032 00000100:00100000:1.0:1746143135.014423:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858716032 00010000:00010000:1.0:1746143135.014438:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 21 pid: 8449 timeout: 1016 lvb_type: 0 00000100:00100000:1.0:1746143135.014457:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6649 00000100:00100000:1.0:1746143135.014462:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858716032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.014469:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.014702:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 21 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.014716:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 21 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.014731:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d77800/0x25aee876ca70d83a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650611 expref: 21 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.014740:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.014760:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858716032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 297us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.014765:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6649 00000100:00100000:2.0:1746143135.014955:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861277568:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.014980:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4136959] (req 3145728->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.014988:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f4800, rc 0) 00000100:00100000:2.0:1746143135.015017:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:31031:x1830962858715904:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 15549us (18726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.015027:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12528 00000100:00100000:0.0:1746143135.022144:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.024072:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858716544 00000100:00100000:2.0:1746143135.024084:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858716544 00000100:00100000:1.0:1746143135.024720:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.024742:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858716672 00000100:00100000:1.0:1746143135.024746:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858716672 00010000:00010000:1.0:1746143135.024784:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 23 pid: 8449 timeout: 1016 lvb_type: 0 00000100:00100000:1.0:1746143135.024818:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6650 00000100:00100000:1.0:1746143135.024825:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858716672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.024841:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.024867:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 23 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.024880:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 23 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.024910:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dc0000/0x25aee876ca70d841 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650618 expref: 23 pid: 8449 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.024930:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.024932:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.024939:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.024948:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.024981:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.024993:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861277952:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143135.025686:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12532 00000100:00100000:2.0:1746143135.025693:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:31041:x1830962858716544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.025712:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.025726:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650665 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.025754:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 18 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.025766:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143135.025767:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143135.025771:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 31 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.025798:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00010000:00010000:2.0:1746143135.025913:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 18 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.025998:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 18 pid: 20836 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143135.026011:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861278080:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.026785:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00002000:00010000:1.0:1746143135.029971:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143132 -> 1746143133 00000100:00100000:1.0:1746143135.030002:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861277824:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143135.030075:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136471200/0x25aee876ca70d887 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165065e expref: 18 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.030089:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136471200/0x25aee876ca70d887 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165065e expref: 18 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.030099:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136471200, rc 0) 00000100:00100000:1.0:1746143135.030155:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858716416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 15969us (16353us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143135.030162:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12531 00000100:00100000:2.0:1746143135.030776:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861277952:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143135.030990:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.031017:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858716672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6192us (6300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.031026:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6650 00000100:00100000:2.0:1746143135.041271:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861278080:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.041370:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 31 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.041393:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b14dcc00, rc 0) 00000100:00100000:2.0:1746143135.041453:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31041:x1830962858716544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 15758us (19323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.041463:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12532 00000100:00100000:0.0:1746143135.042923:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.046455:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858716800 00000100:00100000:1.0:1746143135.046468:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858716800 00002000:00100000:1.0:1746143135.046522:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1277951) req@ffff88008f575c00 x1830962858716800/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.046533:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575c00 with x1830962858716800 ext(1048576->1277951) 00010000:00010000:1.0:1746143135.046559:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 17 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.046575:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 17 pid: 20836 timeout: 1016 lvb_type: 0 00002000:00010000:1.0:1746143135.046583:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f575c00 00000100:00100000:1.0:1746143135.046617:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2004 00000100:00100000:1.0:1746143135.046626:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858716800:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143135.057226:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.058063:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858717056 00000100:00100000:3.0:1746143135.058073:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858717056 00002000:00100000:3.0:1746143135.058116:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88008f574700 x1830962858717056/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.058126:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574700 with x1830962858717056 ext(0->1048575) 00002000:00010000:3.0:1746143135.058132:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f574700 00000100:00100000:3.0:1746143135.058163:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6110 00000100:00100000:3.0:1746143135.058171:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858717056:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143135.059211:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.064203:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858716800:12345-192.168.201.28@tcp:4:cat.0 Request processed in 17556us (21260us total) trans 17179872790 rc 0/0 00000100:00100000:1.0:1746143135.064217:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2004 00002000:00100000:1.0:1746143135.064228:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1277951) req@ffff88008f575c00 x1830962858716800/t17179872790(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/448 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.064239:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575c00 with x1830962858716800 ext(1048576->1277951) 00010000:00010000:1.0:1746143135.064249:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 19 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.064272:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 19 pid: 20836 timeout: 1016 lvb_type: 0 00002000:00010000:1.0:1746143135.064280:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f575c00 00000100:00100000:1.0:1746143135.064303:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858717312 00000100:00100000:1.0:1746143135.064310:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858717312 00002000:00100000:1.0:1746143135.064335:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4132864->4136959) req@ffff88008f577480 x1830962858717312/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.064342:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577480 with x1830962858717312 ext(4132864->4136959) 00002000:00010000:1.0:1746143135.064345:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f577480 00000100:00100000:1.0:1746143135.064362:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6111 00000100:00100000:1.0:1746143135.064367:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858717312:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143135.064460:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858717312:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 93us (5251us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143135.064466:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6111 00002000:00100000:1.0:1746143135.064470:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4132864->4136959) req@ffff88008f577480 x1830962858717312/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.064477:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577480 with x1830962858717312 ext(4132864->4136959) 00002000:00010000:1.0:1746143135.064480:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f577480 00000100:00100000:0.0:1746143135.072978:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.074316:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858717440 00000100:00100000:2.0:1746143135.074327:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858717440 00010000:00010000:2.0:1746143135.074374:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 19 pid: 20836 timeout: 1016 lvb_type: 0 00000100:00100000:2.0:1746143135.075205:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6651 00000100:00100000:2.0:1746143135.075214:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858717440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.075229:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.075255:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 19 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143135.075267:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 19 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143135.075295:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a472ca00/0x25aee876ca70d84f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650626 expref: 19 pid: 20836 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143135.075322:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.075324:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.075331:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.075340:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.075372:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.075385:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861278208:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143135.076545:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143135.077939:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858717056:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19764us (20719us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.077950:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6110 00002000:00100000:3.0:1746143135.077960:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88008f574700 x1830962858717056/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.077969:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574700 with x1830962858717056 ext(0->1048575) 00002000:00010000:3.0:1746143135.077973:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f574700 00000100:00100000:2.0:1746143135.085512:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861278208:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143135.085539:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.085593:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858717440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10378us (12627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.085606:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6651 00000100:00100000:0.0:1746143135.086966:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.092322:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858717696 00000100:00100000:3.0:1746143135.092336:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858717696 00002000:00100000:3.0:1746143135.092394:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008f577800 x1830962858717696/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.092405:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577800 with x1830962858717696 ext(1048576->2097151) 00002000:00010000:3.0:1746143135.092412:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f577800 00000100:00100000:3.0:1746143135.092651:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6112 00000100:00100000:3.0:1746143135.092660:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858717696:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143135.098865:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.099206:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858717824 00000100:00100000:2.0:1746143135.099218:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858717824 00000100:00100000:2.0:1746143135.099294:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12533 00000100:00100000:2.0:1746143135.099305:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31046:x1830962858717824:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.099333:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.099353:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165066c expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.099386:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.099388:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.099398:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.099415:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.099428:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c007800, rc 0) 00000100:00100000:2.0:1746143135.099487:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31046:x1830962858717824:12345-192.168.201.28@tcp:101:cat.0 Request processed in 183us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.099494:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12533 00000100:00100000:3.0:1746143135.107993:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858717696:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 15318us (21019us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.108008:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6112 00002000:00100000:3.0:1746143135.108021:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008f577800 x1830962858717696/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.108064:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577800 with x1830962858717696 ext(1048576->2097151) 00002000:00010000:3.0:1746143135.108070:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f577800 00000100:00100000:0.0:1746143135.112605:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.112674:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858718080 00000100:00100000:3.0:1746143135.112684:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858718080 00002000:00100000:3.0:1746143135.112732:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008f575f80 x1830962858718080/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.112743:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575f80 with x1830962858718080 ext(1048576->2097151) 00002000:00010000:3.0:1746143135.112749:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f575f80 00000100:00100000:3.0:1746143135.112872:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6113 00000100:00100000:3.0:1746143135.112880:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858718080:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143135.129265:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.129340:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858718336 00000100:00100000:1.0:1746143135.129351:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858718336 00002000:00100000:1.0:1746143135.129401:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008f575180 x1830962858718336/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.129419:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575180 with x1830962858718336 ext(2097152->3145727) 00002000:00010000:1.0:1746143135.129426:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f575180 00000100:00100000:1.0:1746143135.129464:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6114 00000100:00100000:1.0:1746143135.129472:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858718336:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143135.138130:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.138171:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.143526:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858718720 00000100:00100000:2.0:1746143135.143526:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858718848 00000100:00100000:3.0:1746143135.143539:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858718720 00000100:00100000:2.0:1746143135.143539:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858718848 00002000:00100000:3.0:1746143135.143585:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3198975) req@ffff8800a5319880 x1830962858718720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 504/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.143585:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3198976->4194303) req@ffff88008f574e00 x1830962858718848/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.143596:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5319880 with x1830962858718720 ext(2097152->3198975) 00002000:00100000:2.0:1746143135.143596:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574e00 with x1830962858718848 ext(3198976->4194303) 00002000:00010000:3.0:1746143135.143601:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5319880 00002000:00010000:2.0:1746143135.143601:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f574e00 00000100:00100000:3.0:1746143135.143725:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6115 00000100:00100000:3.0:1746143135.143732:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858718720:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143135.143736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.143913:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858719104 00000100:00100000:2.0:1746143135.143916:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858719104 00000100:00100000:3.0:1746143135.143929:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6116 00000100:00100000:3.0:1746143135.143934:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858718848:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:2.0:1746143135.143934:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (4136960->4194303) req@ffff8800a531b100 x1830962858719104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.143942:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b100 with x1830962858719104 ext(4136960->4194303) 00002000:00010000:2.0:1746143135.143946:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531b100 00000100:00100000:2.0:1746143135.143966:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6117 00000100:00100000:2.0:1746143135.143970:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858719104:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143135.147062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.147270:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858719232 00000100:00100000:3.0:1746143135.147278:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858719232 00000100:00100000:3.0:1746143135.147325:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12534 00000100:00100000:3.0:1746143135.147333:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31043:x1830962858719232:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143135.147352:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.147372:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650673 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.147404:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.147411:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143135.147413:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143135.147416:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3182592->3932159] (req 3182592->3932159) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.147445:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.147459:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 1016 lvb_type: 0 00000100:00100000:3.0:1746143135.147470:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861278336:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.147605:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143135.148319:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858718080:12345-192.168.201.28@tcp:3:cat.0 Request processed in 35437us (35906us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.148328:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6113 00002000:00100000:3.0:1746143135.148338:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008f575f80 x1830962858718080/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.148345:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575f80 with x1830962858718080 ext(1048576->2097151) 00002000:00010000:3.0:1746143135.148350:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f575f80 00000100:00100000:2.0:1746143135.154376:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858719104:12345-192.168.201.28@tcp:3:cat.0 Request processed in 10390us (10626us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1746143135.154389:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6117 00002000:00100000:2.0:1746143135.154608:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4136960->4194303) req@ffff8800a531b100 x1830962858719104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 57344/57344 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.154617:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b100 with x1830962858719104 ext(4136960->4194303) 00010000:00010000:2.0:1746143135.154627:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 24 pid: 8448 timeout: 1016 lvb_type: 0 00010000:00010000:2.0:1746143135.154644:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 24 pid: 8448 timeout: 1016 lvb_type: 0 00002000:00010000:2.0:1746143135.154650:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a531b100 00000100:00100000:1.0:1746143135.155133:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858718336:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25660us (25877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143135.155140:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6114 00002000:00100000:1.0:1746143135.155146:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008f575180 x1830962858718336/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.155154:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575180 with x1830962858718336 ext(2097152->3145727) 00010000:00010000:1.0:1746143135.155159:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 22 pid: 8448 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.155168:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 22 pid: 8448 timeout: 1016 lvb_type: 0 00002000:00010000:1.0:1746143135.155174:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f575180 00000100:00100000:3.0:1746143135.163143:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.164021:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861278336:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143135.164073:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3182592->3932159] (req 3182592->3932159) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.164092:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d409c00, rc 0) 00000100:00100000:0.0:1746143135.164150:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31043:x1830962858719232:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 16816us (17117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.164159:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12534 00000100:00100000:1.0:1746143135.165025:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858719360 00000100:00100000:1.0:1746143135.165052:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858719360 00002000:00100000:1.0:1746143135.165095:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4136959) req@ffff88008eaac000 x1830962858719360/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.165104:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaac000 with x1830962858719360 ext(3145728->4136959) 00010000:00010000:1.0:1746143135.165111:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 22 pid: 8448 timeout: 1016 lvb_type: 0 00010000:00010000:1.0:1746143135.165124:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 22 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00010000:1.0:1746143135.165131:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eaac000 00000100:00100000:1.0:1746143135.165158:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2005 00000100:00100000:1.0:1746143135.165164:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858719360:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143135.170807:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.171073:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.171171:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858719616 00000100:00100000:2.0:1746143135.171180:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858719616 00000100:00100000:2.0:1746143135.171311:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858719488 00000100:00100000:2.0:1746143135.171315:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858719488 00000100:00100000:1.0:1746143135.171573:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12535 00000100:00100000:1.0:1746143135.171584:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858719616:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.171604:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.171623:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944e7200/0x25aee876ca70d8a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650681 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.171739:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12536 00000100:00100000:2.0:1746143135.171746:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858719488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.171754:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.171764:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c007000/0x25aee876ca70d8aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165067a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.171802:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861278592:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143135.173171:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861278464:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143135.177761:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.178156:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143135.180590:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858718848:12345-192.168.201.28@tcp:3:cat.0 Request processed in 36645us (42460us total) trans 0 rc 995328/995328 00000100:00100000:3.0:1746143135.180603:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6116 00002000:00100000:3.0:1746143135.180616:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3198976->4194303) req@ffff88008f574e00 x1830962858718848/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 995328/995328 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.180627:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574e00 with x1830962858718848 ext(3198976->4194303) 00002000:00010000:3.0:1746143135.180633:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f574e00 00000100:00100000:2.0:1746143135.181437:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858718720:12345-192.168.201.28@tcp:3:cat.0 Request processed in 37700us (43260us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143135.181445:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6115 00002000:00100000:2.0:1746143135.181451:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3198975) req@ffff8800a5319880 x1830962858718720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 504/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.181458:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5319880 with x1830962858718720 ext(2097152->3198975) 00002000:00010000:2.0:1746143135.181461:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5319880 00002000:00010000:1.0:1746143135.182578:0:8448:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143133 -> 1746143134 00000100:00100000:1.0:1746143135.182598:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861278464:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143135.182630:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944e7200/0x25aee876ca70d8a3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650681 expref: 20 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.182643:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944e7200/0x25aee876ca70d8a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650681 expref: 20 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.182659:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944e7200, rc 0) 00000100:00100000:1.0:1746143135.182684:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858719616:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11103us (11888us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143135.182691:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12535 00002000:00010000:2.0:1746143135.183027:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143133 -> 1746143134 00000100:00100000:2.0:1746143135.183060:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861278592:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143135.183081:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c007000/0x25aee876ca70d8aa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165067a expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.183089:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c007000/0x25aee876ca70d8aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165067a expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.183112:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c007000, rc 0) 00000100:00100000:2.0:1746143135.183136:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858719488:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11390us (12063us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143135.183142:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12536 00000100:00100000:0.0:1746143135.194287:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.194451:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858719744 00000100:00100000:3.0:1746143135.194460:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858719744 00000100:00100000:3.0:1746143135.194508:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12537 00000100:00100000:3.0:1746143135.194516:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31046:x1830962858719744:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143135.194536:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.194553:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650688 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.194582:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143135.194585:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143135.194591:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.194603:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.194614:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12f000, rc 0) 00000100:00100000:3.0:1746143135.194672:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:31046:x1830962858719744:12345-192.168.201.28@tcp:101:cat.0 Request processed in 156us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.194678:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12537 00000100:00100000:0.0:1746143135.196397:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.196453:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858719872 00000100:00100000:1.0:1746143135.196459:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858719872 00000100:00100000:1.0:1746143135.196500:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12538 00000100:00100000:1.0:1746143135.196507:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:31041:x1830962858719872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.196523:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.196537:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165068f expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.196558:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143135.196564:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3182592->3932159] (req 3182592->3932159) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.196570:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143135.196573:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.196604:0:8448:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3182592->3932159] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.196616:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.196624:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944e7a00, rc 0) 00000100:00100000:1.0:1746143135.196661:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:31041:x1830962858719872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 155us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.196670:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12538 00000100:00100000:1.0:1746143135.219395:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858719360:12345-192.168.201.28@tcp:4:cat.0 Request processed in 54221us (56257us total) trans 21474840052 rc 0/0 00000100:00100000:1.0:1746143135.219406:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2005 00002000:00100000:1.0:1746143135.219731:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4136959) req@ffff88008eaac000 x1830962858719360/t21474840052(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/448 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.219738:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaac000 with x1830962858719360 ext(3145728->4136959) 00010000:00010000:1.0:1746143135.219746:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.219757:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00010000:1.0:1746143135.219762:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008eaac000 00000100:00100000:0.0:1746143135.231672:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.231762:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858720000 00000100:00100000:2.0:1746143135.231771:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858720000 00010000:00010000:2.0:1746143135.232013:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.232752:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6652 00000100:00100000:2.0:1746143135.232764:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858720000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.232784:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.232815:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.232829:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.232856:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4800/0x25aee876ca70d872 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4136959) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650649 expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.233076:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.233078:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.233088:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.233099:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.233108:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.233110:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.233114:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.233125:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.233164:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.233179:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861278848:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143135.233325:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.233339:0:7111:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 21 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.233349:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861278976:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143135.233380:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143135.254176:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.254259:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858720256 00000100:00100000:1.0:1746143135.254271:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858720256 00000100:00100000:0.0:1746143135.254272:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:1.0:1746143135.254318:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a531b480 x1830962858720256/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.254328:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b480 with x1830962858720256 ext(2097152->3145727) 00002000:00010000:1.0:1746143135.254334:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531b480 00000100:00100000:1.0:1746143135.254355:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858720512 00000100:00100000:1.0:1746143135.254358:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858720512 00002000:00100000:1.0:1746143135.254371:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3182592->3186687) req@ffff8800a531ad80 x1830962858720512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.254377:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531ad80 with x1830962858720512 ext(3182592->3186687) 00010000:00010000:1.0:1746143135.254386:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 23 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.254400:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 23 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:1.0:1746143135.254406:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a531ad80 00000100:00100000:3.0:1746143135.254421:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2006 00000100:00100000:3.0:1746143135.254451:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858720512:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143135.254689:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858720512:12345-192.168.201.28@tcp:3:cat.0 Request processed in 255us (416us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143135.255285:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861278848:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143135.255293:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861278976:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143135.255313:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143135.255345:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858720000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 22584us (23682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.255354:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6652 00000100:00100000:1.0:1746143135.256771:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6118 00000100:00100000:1.0:1746143135.256786:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858720256:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143135.256890:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2006 00002000:00100000:3.0:1746143135.256901:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3182592->3186687) req@ffff8800a531ad80 x1830962858720512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.256911:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531ad80 with x1830962858720512 ext(3182592->3186687) 00010000:00010000:3.0:1746143135.256920:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 23 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.256933:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 23 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.256939:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a531ad80 00000100:00100000:0.0:1746143135.272558:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.272649:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858720768 00000100:00100000:3.0:1746143135.272659:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858720768 00002000:00100000:3.0:1746143135.272701:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3928064->3932159) req@ffff8800a5318e00 x1830962858720768/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.272713:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5318e00 with x1830962858720768 ext(3928064->3932159) 00010000:00010000:3.0:1746143135.272723:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.272738:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.272746:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5318e00 00000100:00100000:3.0:1746143135.272812:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2007 00000100:00100000:3.0:1746143135.272820:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858720768:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143135.274489:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858720768:12345-192.168.201.28@tcp:3:cat.0 Request processed in 1663us (1935us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143135.274498:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2007 00002000:00100000:3.0:1746143135.274506:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3928064->3932159) req@ffff8800a5318e00 x1830962858720768/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.274515:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5318e00 with x1830962858720768 ext(3928064->3932159) 00010000:00010000:3.0:1746143135.274523:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.274535:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.274547:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5318e00 00000100:00100000:1.0:1746143135.285150:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858720256:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28359us (30977us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143135.285163:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6118 00002000:00100000:1.0:1746143135.285175:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a531b480 x1830962858720256/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.285197:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b480 with x1830962858720256 ext(2097152->3145727) 00002000:00010000:1.0:1746143135.285204:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a531b480 00000100:00100000:0.0:1746143135.295488:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.295581:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.295722:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858721024 00000100:00100000:1.0:1746143135.295735:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858721024 00002000:00100000:1.0:1746143135.295792:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3182592->3932159) req@ffff8800a5319180 x1830962858721024/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.295803:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5319180 with x1830962858721024 ext(3182592->3932159) 00010000:00010000:1.0:1746143135.295813:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 22 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.295829:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 22 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:1.0:1746143135.295838:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5319180 00000100:00100000:3.0:1746143135.296284:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858721152 00000100:00100000:3.0:1746143135.296290:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858721152 00000100:00100000:3.0:1746143135.296354:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12539 00000100:00100000:3.0:1746143135.296365:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31046:x1830962858721152:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143135.296385:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.296405:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650696 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.296443:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.296452:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143135.296454:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143135.296458:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.296495:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.296508:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 30 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.296521:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861279104:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.297667:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.297823:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2008 00000100:00100000:1.0:1746143135.297831:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858721024:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143135.303112:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.303137:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858721280 00000100:00100000:2.0:1746143135.303145:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858721280 00002000:00100000:2.0:1746143135.303200:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3092480->3145727) req@ffff88009194aa00 x1830962858721280/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.303210:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194aa00 with x1830962858721280 ext(3092480->3145727) 00010000:00010000:2.0:1746143135.303219:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 31 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.303235:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 31 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00010000:2.0:1746143135.303242:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009194aa00 00000100:00100000:2.0:1746143135.303261:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2009 00000100:00100000:2.0:1746143135.303272:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858721280:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143135.303744:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861279104:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.303771:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.303786:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12f600, rc 0) 00000100:00100000:3.0:1746143135.303814:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31046:x1830962858721152:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7452us (8235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.303822:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12539 00000100:00100000:2.0:1746143135.315847:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858721280:12345-192.168.201.28@tcp:4:cat.0 Request processed in 12564us (12729us total) trans 17179872791 rc 0/0 00000100:00100000:2.0:1746143135.315860:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2009 00002000:00100000:2.0:1746143135.315875:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3092480->3145727) req@ffff88009194aa00 x1830962858721280/t17179872791(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/448 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.315885:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194aa00 with x1830962858721280 ext(3092480->3145727) 00010000:00010000:2.0:1746143135.315897:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.315911:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00010000:2.0:1746143135.315918:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009194aa00 00000100:00100000:1.0:1746143135.326491:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858721024:12345-192.168.201.28@tcp:4:cat.0 Request processed in 28644us (31000us total) trans 21474840053 rc 0/0 00000100:00100000:1.0:1746143135.326508:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2008 00002000:00100000:1.0:1746143135.326523:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3182592->3932159) req@ffff8800a5319180 x1830962858721024/t21474840053(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/448 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.326533:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5319180 with x1830962858721024 ext(3182592->3932159) 00010000:00010000:1.0:1746143135.326546:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.326561:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:1.0:1746143135.326568:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5319180 00000100:00100000:0.0:1746143135.331614:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.332887:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858721408 00000100:00100000:2.0:1746143135.332901:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858721408 00010000:00010000:2.0:1746143135.332947:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.333004:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6653 00000100:00100000:2.0:1746143135.333015:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858721408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.333057:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143135.333083:0:7111:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143133 -> 1746143134 00002000:00010000:2.0:1746143135.333086:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143133 -> 1746143134 00010000:00010000:2.0:1746143135.333094:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.333105:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.333132:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d409c00/0x25aee876ca70d89c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3182592->3932159) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650673 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.333155:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.333158:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.333166:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.333176:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.333229:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.333250:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861279232:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143135.333351:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143135.333483:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.333804:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858721536 00000100:00100000:3.0:1746143135.333811:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858721536 00010000:00010000:3.0:1746143135.333834:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.334731:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6654 00000100:00100000:2.0:1746143135.334957:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858721536:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.334976:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.335001:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.335013:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.335062:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd19a00/0x25aee876ca70d86b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650642 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.335077:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.335079:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.335084:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.335091:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.335120:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.335134:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861279360:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143135.335229:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143135.337465:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861279360:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143135.337486:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.337524:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1971:x1830962858721536:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2782us (4040us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.337534:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6654 00000100:00100000:2.0:1746143135.339599:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861279232:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143135.339619:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.339672:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858721408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6659us (8068us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.339682:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6653 00000100:00100000:0.0:1746143135.341807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.343178:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858721792 00000100:00100000:1.0:1746143135.343201:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858721792 00002000:00100000:1.0:1746143135.343273:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880130764e00 x1830962858721792/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.343284:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764e00 with x1830962858721792 ext(2097152->3145727) 00002000:00010000:1.0:1746143135.343291:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130764e00 00000100:00100000:1.0:1746143135.343341:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6119 00000100:00100000:1.0:1746143135.343353:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858721792:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143135.344443:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.344495:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858722048 00000100:00100000:3.0:1746143135.344499:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858722048 00002000:00100000:3.0:1746143135.344522:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009194a680 x1830962858722048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.344530:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194a680 with x1830962858722048 ext(3145728->4194303) 00002000:00010000:3.0:1746143135.344533:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194a680 00000100:00100000:3.0:1746143135.344558:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6120 00000100:00100000:3.0:1746143135.344564:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858722048:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143135.363858:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858722048:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19280us (19404us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.363870:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6120 00002000:00100000:3.0:1746143135.363883:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009194a680 x1830962858722048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.363905:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194a680 with x1830962858722048 ext(3145728->4194303) 00002000:00010000:3.0:1746143135.363912:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194a680 00000100:00100000:1.0:1746143135.366967:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858721792:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23604us (25159us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143135.366980:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6119 00002000:00100000:1.0:1746143135.366989:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880130764e00 x1830962858721792/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.366999:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764e00 with x1830962858721792 ext(2097152->3145727) 00002000:00010000:1.0:1746143135.367005:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130764e00 00000100:00100000:0.0:1746143135.373667:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.373712:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.373763:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.373967:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858722176 00000100:00100000:0.0:1746143135.373977:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858722176 00000100:00100000:3.0:1746143135.373988:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858722432 00000100:00100000:3.0:1746143135.373992:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858722432 00000100:00100000:1.0:1746143135.374168:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858722304 00000100:00100000:1.0:1746143135.374173:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858722304 00000100:00100000:3.0:1746143135.374203:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12540 00000100:00100000:1.0:1746143135.374209:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12541 00000100:00100000:3.0:1746143135.374211:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:31049:x1830962858722176:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:1.0:1746143135.374213:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31046:x1830962858722432:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143135.374231:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.374231:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.374249:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165069d expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.374249:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506a4 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.374272:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.374274:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.374276:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.374281:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.374281:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.374282:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.374285:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3919872->4194303] (req 3919872->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.374312:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.374323:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 19 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.374336:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861279488:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.374478:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143135.374482:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.374492:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009015b600, rc 0) 00000100:00100000:3.0:1746143135.374512:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12542 00000100:00100000:1.0:1746143135.374515:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31046:x1830962858722432:12345-192.168.201.28@tcp:101:cat.0 Request processed in 302us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.374518:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:31041:x1830962858722304:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143135.374522:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12541 00010000:00010000:3.0:1746143135.374524:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.374529:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506ab expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.374539:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.374543:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3919872->4194303] (req 3919872->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 35 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.374549:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143135.374551:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.374573:0:20836:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3919872->4194303] (req 3919872->4194303) gid 0 flags: 0x60000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 35 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.375222:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.375234:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12f200, rc 0) 00000100:00100000:3.0:1746143135.375265:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:31041:x1830962858722304:12345-192.168.201.28@tcp:101:cat.0 Request processed in 747us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.375271:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12542 00000100:00100000:0.0:1746143135.378885:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.379016:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861279488:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.379076:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3919872->4194303] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.379100:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12fa00, rc 0) 00000100:00100000:2.0:1746143135.379144:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858722560 00000100:00100000:3.0:1746143135.379145:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:31049:x1830962858722176:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4934us (5491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.379152:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858722560 00000100:00100000:3.0:1746143135.379154:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12540 00010000:00010000:2.0:1746143135.379180:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 20 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.379229:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6655 00000100:00100000:2.0:1746143135.379236:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858722560:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.379250:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.379273:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 20 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.379290:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 20 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.379314:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f600/0x25aee876ca70d8bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650696 expref: 20 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.379330:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.379333:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.379340:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 33 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.379349:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 33 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.379414:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 33 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.379426:0:7111:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 33 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.379437:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861279744:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143135.379684:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143135.384456:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.384502:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.384579:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861279744:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143135.384599:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.384642:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858722560:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5405us (5769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.384656:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6655 00000100:00100000:1.0:1746143135.385182:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858722816 00000100:00100000:1.0:1746143135.385199:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858722816 00002000:00100000:1.0:1746143135.385241:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3919872->3923967) req@ffff880130766d80 x1830962858722816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.385251:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766d80 with x1830962858722816 ext(3919872->3923967) 00010000:00010000:1.0:1746143135.385261:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.385273:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:1.0:1746143135.385280:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130766d80 00000100:00100000:1.0:1746143135.385294:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858723072 00000100:00100000:1.0:1746143135.385297:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858723072 00002000:00100000:1.0:1746143135.385312:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880130765c00 x1830962858723072/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.385319:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130765c00 with x1830962858723072 ext(3145728->4194303) 00002000:00010000:1.0:1746143135.385322:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130765c00 00000100:00100000:1.0:1746143135.385637:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2010 00000100:00100000:1.0:1746143135.385644:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1970:x1830962858722816:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143135.385888:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1970:x1830962858722816:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 244us (1442us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143135.385895:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2010 00002000:00100000:1.0:1746143135.385900:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3919872->3923967) req@ffff880130766d80 x1830962858722816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143135.385907:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766d80 with x1830962858722816 ext(3919872->3923967) 00010000:00010000:1.0:1746143135.385912:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.385921:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:1.0:1746143135.385926:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130766d80 00000100:00100000:1.0:1746143135.385936:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6121 00000100:00100000:1.0:1746143135.385941:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858723072:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143135.397746:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.397900:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858723328 00000100:00100000:3.0:1746143135.397910:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858723328 00002000:00100000:3.0:1746143135.397953:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3919872->4194303) req@ffff880130767800 x1830962858723328/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.397964:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767800 with x1830962858723328 ext(3919872->4194303) 00010000:00010000:3.0:1746143135.397974:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.397989:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.397997:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130767800 00000100:00100000:3.0:1746143135.398025:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2011 00000100:00100000:3.0:1746143135.398061:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858723328:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:2.0:1746143135.403131:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.403320:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858723456 00000100:00100000:3.0:1746143135.403329:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858723456 00000100:00100000:3.0:1746143135.403370:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12543 00000100:00100000:3.0:1746143135.403375:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:31049:x1830962858723456:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143135.403391:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.403406:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506b2 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.403434:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.403444:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.403451:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.403453:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.403457:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->4718591] (req 4194304->4718591) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.403488:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.403500:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.404240:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861279872:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143135.404297:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858723072:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18352us (19792us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143135.404308:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6121 00010000:00010000:3.0:1746143135.404315:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143135.404318:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880130765c00 x1830962858723072/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143135.404322:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00100000:1.0:1746143135.404327:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130765c00 with x1830962858723072 ext(3145728->4194303) 00000100:00100000:3.0:1746143135.404328:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861280000:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143135.404334:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.404342:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143135.404343:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00010000:1.0:1746143135.404349:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130765c00 00000100:00100000:3.0:1746143135.407892:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858723328:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 9847us (10146us total) trans 17179872792 rc 0/0 00000100:00100000:3.0:1746143135.407906:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2011 00002000:00100000:3.0:1746143135.407916:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3919872->4194303) req@ffff880130767800 x1830962858723328/t17179872792(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/448 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.407934:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767800 with x1830962858723328 ext(3919872->4194303) 00010000:00010000:3.0:1746143135.407943:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 36 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.407954:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 36 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.407960:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130767800 00000100:00100000:3.0:1746143135.408788:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861279872:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.408800:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861280000:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.408830:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->4718591] (req 4194304->4718591) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.408848:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12ee00, rc 0) 00000100:00100000:3.0:1746143135.409484:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:31049:x1830962858723456:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6105us (6363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.409494:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12543 00000100:00100000:0.0:1746143135.418398:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.418965:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858723584 00000100:00100000:2.0:1746143135.418974:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858723584 00010000:00010000:2.0:1746143135.419007:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.419087:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6656 00000100:00100000:2.0:1746143135.419097:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858723584:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.419114:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.419146:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.419158:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.419194:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d8b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165068f expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.419223:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.419281:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858723584:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 186us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.419288:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6656 00000100:00100000:0.0:1746143135.419999:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.420022:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.420243:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858723712 00000100:00100000:3.0:1746143135.420248:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858723712 00000100:00100000:1.0:1746143135.420248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143135.420270:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 36 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.420274:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858723840 00000100:00100000:1.0:1746143135.420277:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858723840 00000100:00100000:3.0:1746143135.420288:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858723968 00000100:00100000:3.0:1746143135.420290:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858723968 00010000:00010000:3.0:1746143135.420298:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.420306:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12544 00000100:00100000:3.0:1746143135.420317:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6657 00000100:00100000:3.0:1746143135.420323:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1968:x1830962858723712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143135.420323:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6658 00000100:00100000:1.0:1746143135.420328:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858723968:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.420332:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.420336:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143135.420347:0:4759:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143133 -> 1746143134 00010000:00010000:1.0:1746143135.420348:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.420350:0:4759:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143133 -> 1746143134 00010000:00010000:3.0:1746143135.420353:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 36 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.420357:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.420362:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 36 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.420371:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009015b600/0x25aee876ca70d8c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506a4 expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.420375:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12fa00/0x25aee876ca70d8cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165069d expref: 36 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.420384:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.420386:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.420388:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.420389:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.420393:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.420394:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.420401:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.420401:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.420427:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.420427:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.420438:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861280128:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143135.420438:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861280256:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143135.420685:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.422250:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.422267:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31046:x1830962858723840:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.422281:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.422295:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506b9 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.422310:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.422312:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.422318:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.422330:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.422338:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009015b400, rc 0) 00000100:00100000:1.0:1746143135.422360:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31046:x1830962858723840:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2048us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.422365:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12544 00000100:00100000:3.0:1746143135.425127:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861280128:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143135.425149:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143135.425203:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858723712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4877us (5202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.425213:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6657 00000100:00100000:0.0:1746143135.425700:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.426108:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858724224 00000100:00100000:3.0:1746143135.426119:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858724224 00002000:00100000:3.0:1746143135.426161:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880130765500 x1830962858724224/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.426170:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130765500 with x1830962858724224 ext(3145728->4194303) 00002000:00010000:3.0:1746143135.426174:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130765500 00000100:00100000:3.0:1746143135.426221:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6122 00000100:00100000:3.0:1746143135.426229:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858724224:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143135.442493:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861280256:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143135.442517:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.442570:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858723968:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 22240us (22545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.442582:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6658 00000100:00100000:1.0:1746143135.450727:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.450846:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858724480 00000100:00100000:2.0:1746143135.450856:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858724480 00002000:00100000:2.0:1746143135.450900:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094516300 x1830962858724480/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.450911:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516300 with x1830962858724480 ext(3145728->4194303) 00002000:00010000:2.0:1746143135.450918:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094516300 00000100:00100000:2.0:1746143135.450948:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6123 00000100:00100000:2.0:1746143135.450956:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858724480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143135.454020:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.455320:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858724224:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 29085us (29615us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.455332:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6122 00002000:00100000:3.0:1746143135.455345:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880130765500 x1830962858724224/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.455362:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130765500 with x1830962858724224 ext(3145728->4194303) 00002000:00010000:3.0:1746143135.455368:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130765500 00000100:00100000:3.0:1746143135.459237:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858724736 00000100:00100000:3.0:1746143135.459250:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858724736 00002000:00100000:3.0:1746143135.459296:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4714496->4718591) req@ffff88009ae2e300 x1830962858724736/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.459307:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2e300 with x1830962858724736 ext(4714496->4718591) 00002000:00010000:3.0:1746143135.459313:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2e300 00000100:00100000:3.0:1746143135.459347:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6124 00000100:00100000:3.0:1746143135.459355:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858724736:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143135.459950:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858724736:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 595us (5939us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143135.459957:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6124 00002000:00100000:3.0:1746143135.459963:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4714496->4718591) req@ffff88009ae2e300 x1830962858724736/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.459971:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae2e300 with x1830962858724736 ext(4714496->4718591) 00002000:00010000:3.0:1746143135.459974:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae2e300 00000100:00100000:2.0:1746143135.463210:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858724480:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12245us (12485us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143135.463218:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6123 00002000:00100000:2.0:1746143135.463227:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094516300 x1830962858724480/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.463234:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094516300 with x1830962858724480 ext(3145728->4194303) 00002000:00010000:2.0:1746143135.463238:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094516300 00000100:00100000:0.0:1746143135.472986:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.474730:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.475128:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858724864 00000100:00100000:1.0:1746143135.475139:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858724864 00000100:00100000:1.0:1746143135.475199:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858724992 00000100:00100000:1.0:1746143135.475202:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858724992 00000100:00100000:1.0:1746143135.475228:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12545 00000100:00100000:1.0:1746143135.475237:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858724864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.475258:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.475277:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e934800/0x25aee876ca70d8e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506c0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.475328:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861280384:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143135.475417:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.475433:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12546 00000100:00100000:1.0:1746143135.475437:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858724992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.475443:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.475448:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e934e00/0x25aee876ca70d8f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506c7 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.475470:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861280512:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143135.475488:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.482355:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861280512:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143135.482395:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e934e00/0x25aee876ca70d8f0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506c7 expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.482409:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e934e00/0x25aee876ca70d8f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506c7 expref: 24 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143135.482413:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861280384:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143135.482465:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e934800/0x25aee876ca70d8e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506c0 expref: 25 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.482478:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e934800/0x25aee876ca70d8e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506c0 expref: 25 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.482478:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e934e00, rc 0) 00000100:00100000:1.0:1746143135.482797:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858724992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7356us (8072us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143135.482806:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12546 00010000:00010000:2.0:1746143135.482853:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e934800, rc 0) 00000100:00100000:2.0:1746143135.482899:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858724864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7662us (9924us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143135.482908:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12545 00000100:00100000:0.0:1746143135.487165:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.488610:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.488725:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858725376 00000100:00100000:3.0:1746143135.488734:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858725376 00002000:00100000:3.0:1746143135.488778:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4718592->5210111) req@ffff88009f4fc380 x1830962858725376/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.488789:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830962858725376 ext(4718592->5210111) 00002000:00010000:3.0:1746143135.488795:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fc380 00000100:00100000:3.0:1746143135.488817:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6125 00000100:00100000:3.0:1746143135.488824:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858725376:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143135.489279:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858725120 00000100:00100000:2.0:1746143135.489285:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858725120 00000100:00100000:2.0:1746143135.489319:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12547 00000100:00100000:2.0:1746143135.489325:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31046:x1830962858725120:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.489336:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.489593:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506ce expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.489619:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.489626:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143135.489628:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143135.489632:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 24 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.489659:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.489671:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 25 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.489683:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861280640:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.489766:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143135.494115:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861280640:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.494152:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 24 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.494178:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586e600, rc 0) 00000100:00100000:2.0:1746143135.494240:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31046:x1830962858725120:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4912us (7083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.494249:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12547 00000100:00100000:0.0:1746143135.498670:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.499457:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858725504 00000100:00100000:2.0:1746143135.499472:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858725504 00002000:00100000:2.0:1746143135.499515:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4718591) req@ffff88009f4fdc00 x1830962858725504/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.499526:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdc00 with x1830962858725504 ext(4194304->4718591) 00010000:00010000:2.0:1746143135.499536:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 26 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.499552:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 26 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:2.0:1746143135.499560:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4fdc00 00000100:00100000:2.0:1746143135.499665:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2012 00000100:00100000:2.0:1746143135.499674:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858725504:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143135.499743:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858725376:12345-192.168.201.28@tcp:3:cat.0 Request processed in 10918us (11134us total) trans 0 rc 491520/491520 00000100:00100000:3.0:1746143135.499751:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6125 00002000:00100000:3.0:1746143135.499758:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4718592->5210111) req@ffff88009f4fc380 x1830962858725376/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 491520/491520 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.499765:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830962858725376 ext(4718592->5210111) 00010000:00010000:3.0:1746143135.499771:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 25 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.499781:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 25 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.499787:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4fc380 00000100:00100000:1.0:1746143135.506827:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.507407:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858725632 00000100:00100000:2.0:1746143135.507417:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858725632 00000100:00100000:2.0:1746143135.507474:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12548 00000100:00100000:2.0:1746143135.507483:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858725632:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.507503:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.507521:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d8fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506d5 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.507577:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861280768:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143135.507738:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143135.515093:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861280768:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143135.515136:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d8fe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506d5 expref: 27 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.515152:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d8fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506d5 expref: 27 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.515189:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586ea00, rc 0) 00000100:00100000:3.0:1746143135.516145:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858725632:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8659us (9325us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143135.516157:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12548 00000100:00100000:2.0:1746143135.517452:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858725504:12345-192.168.201.28@tcp:4:cat.0 Request processed in 17769us (18784us total) trans 21474840054 rc 0/0 00000100:00100000:2.0:1746143135.517464:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2012 00002000:00100000:2.0:1746143135.517476:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4718591) req@ffff88009f4fdc00 x1830962858725504/t21474840054(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/448 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.517486:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdc00 with x1830962858725504 ext(4194304->4718591) 00010000:00010000:2.0:1746143135.517496:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 26 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.517510:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 26 pid: 8449 timeout: 1017 lvb_type: 0 00002000:00010000:2.0:1746143135.517517:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4fdc00 00000100:00100000:0.0:1746143135.531307:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.531568:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858725760 00000100:00100000:3.0:1746143135.531578:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858725760 00000100:00100000:3.0:1746143135.533815:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12549 00000100:00100000:3.0:1746143135.533829:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31053:x1830962858725760:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143135.534017:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.534053:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506dc expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.534089:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 34 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.534099:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.534105:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.534107:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.534110:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3702784->4009983] (req 3702784->4009983) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 21 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.534139:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.534150:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 21 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.534161:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861280896:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.534273:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 34 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.534280:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 34 pid: 20836 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.534288:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861281024:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.534305:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00010000:00010000:1.0:1746143135.535174:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143135.539199:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.539514:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858725888 00000100:00100000:1.0:1746143135.539523:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858725888 00010000:00010000:1.0:1746143135.539554:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 26 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.539589:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6659 00000100:00100000:1.0:1746143135.539596:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858725888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.539607:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.539624:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 26 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.539634:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 26 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.539653:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b12ee00/0x25aee876ca70d8db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4718591) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b2 expref: 26 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.539707:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.539709:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.539716:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.539724:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.539751:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.539764:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861281152:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143135.540193:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143135.542908:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.543015:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.543226:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858726016 00000100:00100000:2.0:1746143135.543233:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858726016 00010000:00010000:2.0:1746143135.543261:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 22 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.543294:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858726144 00000100:00100000:2.0:1746143135.543296:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858726144 00010000:00010000:2.0:1746143135.543306:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.543327:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6660 00000100:00100000:2.0:1746143135.543334:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858726016:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.543345:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.543365:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 22 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.543370:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6661 00010000:00010000:2.0:1746143135.543373:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 22 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.543377:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1971:x1830962858726144:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.543383:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.543392:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.543393:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143135.543399:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.543409:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.543410:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.543416:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 22 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.543423:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 22 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.543428:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858726016:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 94us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.543434:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6660 00010000:00010000:1.0:1746143135.543452:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 21 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.543463:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861281280:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143135.543506:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5328240 going to sleep for 11 seconds 00010000:00010000:3.0:1746143135.543567:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009015b400/0x25aee876ca70d8e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506b9 expref: 21 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.543598:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861280896:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.543610:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d8d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ab expref: 35 pid: 20836 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.543619:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861281024:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.543644:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 20 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.543655:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12ec00, rc 0) 00000100:00100000:3.0:1746143135.543698:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31053:x1830962858725760:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9874us (12401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.543706:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12549 00000100:00100000:0.0:1746143135.547132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.547201:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858726272 00000100:00100000:3.0:1746143135.547211:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858726272 00000100:00100000:3.0:1746143135.547258:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12550 00000100:00100000:3.0:1746143135.547266:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:31041:x1830962858726272:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143135.547285:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.547303:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506e3 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.547328:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.547330:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.547338:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 27 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.547353:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 27 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.547363:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12e400, rc 0) 00000100:00100000:3.0:1746143135.549881:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:31041:x1830962858726272:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2592us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.549893:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12550 00000100:00100000:1.0:1746143135.550580:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861281280:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143135.550607:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.550645:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1971:x1830962858726144:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7268us (7629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.550655:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6661 00000100:00100000:0.0:1746143135.553333:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.553436:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861281152:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143135.553457:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.553627:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858726528 00000100:00100000:2.0:1746143135.553639:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858726528 00002000:00100000:2.0:1746143135.553681:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3702784->3706879) req@ffff88009f4fd880 x1830962858726528/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.553690:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd880 with x1830962858726528 ext(3702784->3706879) 00002000:00010000:2.0:1746143135.553695:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fd880 00000100:00100000:2.0:1746143135.553733:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6126 00000100:00100000:2.0:1746143135.553741:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858726528:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143135.553897:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858725888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 14300us (14714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.553907:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6659 00000100:00100000:2.0:1746143135.554576:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858726528:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 834us (1251us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143135.554587:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6126 00002000:00100000:2.0:1746143135.554593:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3702784->3706879) req@ffff88009f4fd880 x1830962858726528/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.554601:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd880 with x1830962858726528 ext(3702784->3706879) 00002000:00010000:2.0:1746143135.554603:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fd880 00000100:00100000:0.0:1746143135.554865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.554911:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858726784 00000100:00100000:3.0:1746143135.554918:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858726784 00000100:00100000:0.0:1746143135.555266:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.555340:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858726912 00000100:00100000:2.0:1746143135.555344:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858726912 00002000:00100000:2.0:1746143135.555372:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009f4ff480 x1830962858726912/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.555381:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff480 with x1830962858726912 ext(4194304->5210111) 00002000:00010000:2.0:1746143135.555385:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ff480 00000100:00100000:2.0:1746143135.555398:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6127 00000100:00100000:2.0:1746143135.555403:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858726912:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143135.556021:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12551 00000100:00100000:3.0:1746143135.556028:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1970:x1830962858726784:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143135.556057:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.556073:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12ea00/0x25aee876ca70d913 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506ea expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.556125:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861281408:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143135.556206:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143135.565336:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.565944:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858727168 00000100:00100000:2.0:1746143135.565954:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858727168 00002000:00100000:2.0:1746143135.566002:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (4005888->4009983) req@ffff88009f4fdf80 x1830962858727168/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.566013:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdf80 with x1830962858727168 ext(4005888->4009983) 00002000:00010000:2.0:1746143135.566018:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fdf80 00000100:00100000:2.0:1746143135.566067:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6128 00000100:00100000:2.0:1746143135.566073:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858727168:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143135.566221:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861281408:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143135.566253:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b12ea00/0x25aee876ca70d913 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ea expref: 35 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.566268:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12ea00/0x25aee876ca70d913 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ea expref: 35 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.566336:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12ea00, rc 0) 00000100:00100000:3.0:1746143135.566380:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1970:x1830962858726784:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10351us (11515us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143135.566388:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12551 00000100:00100000:2.0:1746143135.567265:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858727168:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1187us (1939us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143135.567277:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6128 00002000:00100000:2.0:1746143135.567284:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (4005888->4009983) req@ffff88009f4fdf80 x1830962858727168/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143135.567293:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdf80 with x1830962858727168 ext(4005888->4009983) 00002000:00010000:2.0:1746143135.567297:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fdf80 00000100:00100000:3.0:1746143135.570167:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858726912:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 14752us (14889us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143135.570190:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6127 00002000:00100000:3.0:1746143135.570201:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009f4ff480 x1830962858726912/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.570209:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff480 with x1830962858726912 ext(4194304->5210111) 00002000:00010000:3.0:1746143135.570215:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ff480 00000100:00100000:0.0:1746143135.570916:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.571675:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858727424 00000100:00100000:3.0:1746143135.571684:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858727424 00002000:00100000:3.0:1746143135.571722:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88009f4fd500 x1830962858727424/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.571731:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd500 with x1830962858727424 ext(5206016->5210111) 00002000:00010000:3.0:1746143135.571734:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd500 00000100:00100000:3.0:1746143135.571945:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6129 00000100:00100000:3.0:1746143135.571953:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858727424:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143135.572769:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858727424:12345-192.168.201.28@tcp:3:cat.0 Request processed in 814us (1852us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143135.572776:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6129 00002000:00100000:3.0:1746143135.572782:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88009f4fd500 x1830962858727424/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.572789:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd500 with x1830962858727424 ext(5206016->5210111) 00002000:00010000:3.0:1746143135.572792:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd500 00000100:00100000:0.0:1746143135.594647:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.597682:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858727552 00000100:00100000:2.0:1746143135.597695:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858727552 00000100:00100000:2.0:1746143135.597765:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8193 00000100:00100000:2.0:1746143135.597774:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:31057:x1830962858727552:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143135.597799:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.597819:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fc00/0x25aee876ca70d91a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506f1 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.597878:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.597890:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.597900:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.597912:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.597917:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.597922:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.598077:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.598087:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 219 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.598095:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 28 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.598101:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.598129:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 28 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.598139:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 28 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.598150:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861281536:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.598240:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 219 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.598247:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 219 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.598254:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861281664:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.598270:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00000100:00080000:1.0:1746143135.598333:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143135.601210:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861281536:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.601224:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861281664:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.601257:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143135.603219:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.604536:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.605349:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858728064 00000100:00100000:2.0:1746143135.605359:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858728064 00000100:00080000:1.0:1746143135.605620:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143135.605634:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858727936 00000100:00100000:2.0:1746143135.605637:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858727936 00000100:00100000:0.0:1746143135.605673:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3464 00000100:00100000:0.0:1746143135.605684:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+220:27541:x1830962858728064:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00080000:1.0:1746143135.605715:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143135.606095:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3465 00000100:00100000:2.0:1746143135.606101:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009386cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:26840:x1830962858727936:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143135.606728:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+221:27541:x1830962858728064:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 1046us (3516us total) trans 8589942406 rc 0/0 00000100:00100000:0.0:1746143135.606735:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3464 00000100:00100000:2.0:1746143135.606974:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009386cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:26840:x1830962858727936:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 873us (2635us total) trans 8589942405 rc 0/0 00000100:00100000:2.0:1746143135.606981:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3465 00000100:00100000:0.0:1746143135.611338:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.611393:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.611599:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858728192 00000100:00100000:1.0:1746143135.611609:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858728192 00010000:00010000:1.0:1746143135.611647:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 30 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.611673:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858728320 00000100:00100000:1.0:1746143135.611675:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858728320 00010000:00010000:1.0:1746143135.611687:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 221 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.611715:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6662 00000100:00100000:1.0:1746143135.611723:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1969:x1830962858728192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.611737:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.611742:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 30 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.611752:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 30 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.611773:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5351800/0x25aee876ca70d7a7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650585 expref: 30 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.611792:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143135.611797:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143135.611805:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143135.611810:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143135.611815:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.611858:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858728192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.611865:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6662 00000100:00100000:3.0:1746143135.611879:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6663 00000100:00100000:3.0:1746143135.611887:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+221:1969:x1830962858728320:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.611896:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.611900:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 221 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.611909:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 221 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.611920:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2bc00/0x25aee876ca70d74c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650538 expref: 221 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.611936:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143135.611939:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.611946:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.611953:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.611972:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143135.611990:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+220:1969:x1830962858728320:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 105us (597us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143135.612076:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612085:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143135.612281:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143135.612287:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143135.612303:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612314:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612323:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612329:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612336:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612341:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a586fe00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143135.612345:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612351:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612358:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143135.612360:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143135.612363:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612367:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fe00/0x25aee876ca70d921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612379:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612383:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612388:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612391:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a586f200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143135.612393:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612397:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612406:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a55dd100) 00010000:00010000:2.0:1746143135.612407:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143135.612409:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612413:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f200/0x25aee876ca70d928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.612443:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fc00/0x25aee876ca70d91a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.612453:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 17 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.612458:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143135.612460:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143135.612462:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586f800, rc 0) 00000100:00100000:2.0:1746143135.612493:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:31057:x1830962858727552:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 14721us (17859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.612500:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8193 00000100:00100000:3.0:1746143135.612708:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6663 00000100:00100000:2.0:1746143135.617134:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.617228:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.617259:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.617282:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858728448 00000100:00100000:2.0:1746143135.617290:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858728448 00000100:00100000:2.0:1746143135.617348:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858728576 00000100:00100000:2.0:1746143135.617350:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858728576 00000100:00100000:2.0:1746143135.617366:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858728704 00000100:00100000:2.0:1746143135.617368:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858728704 00000100:00100000:2.0:1746143135.617382:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12552 00000100:00100000:2.0:1746143135.617389:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1971:x1830962858728448:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:3.0:1746143135.617405:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12553 00010000:00010000:2.0:1746143135.617408:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143135.617631:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858728576:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143135.617640:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.617643:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506f8 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.617651:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16506ff expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.617669:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.617669:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.617671:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.617671:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.617680:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.617680:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 6 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.617695:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.617695:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 6 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.617705:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12e200, rc 0) 00010000:00010000:2.0:1746143135.617705:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586ec00, rc 0) 00000100:00100000:1.0:1746143135.617767:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12554 00000100:00100000:1.0:1746143135.617776:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858728704:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143135.617783:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.617790:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650706 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.617799:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.617801:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.617804:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.617826:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.617833:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fb3c00, rc 0) 00000100:00080000:0.0:1746143135.617908:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143135.617913:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143135.618975:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858728576:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1558us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.618975:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858728448:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1581us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.618983:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12553 00000100:00100000:2.0:1746143135.618987:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12552 00000100:00100000:1.0:1746143135.619163:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858728704:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1387us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.619169:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12554 00000100:00100000:2.0:1746143135.619299:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.619361:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.619414:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.619444:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858728832 00000100:00100000:0.0:1746143135.619449:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858728832 00000100:00100000:0.0:1746143135.619700:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858728960 00000100:00100000:1.0:1746143135.619729:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858729088 00000100:00100000:1.0:1746143135.619732:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858729088 00000100:00100000:1.0:1746143135.619753:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12555 00000100:00100000:1.0:1746143135.619758:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858728832:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143135.619770:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.619781:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165070d expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.619797:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.619799:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.619805:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.619819:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.619828:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fb3600, rc 0) 00000100:00100000:1.0:1746143135.619851:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858728832:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 93us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.619857:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12555 00000100:00100000:1.0:1746143135.619869:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12556 00000100:00100000:1.0:1746143135.619873:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858729088:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143135.619880:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.619887:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d952 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165071b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.619927:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861281792:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143135.619980:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b630fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143135.620208:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858728960 00000100:00100000:0.0:1746143135.620237:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12557 00000100:00100000:0.0:1746143135.620243:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858728960:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:0.0:1746143135.620250:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143135.620257:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650714 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.620268:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.620269:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.620274:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.620289:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.620297:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941ba400, rc 0) 00000100:00100000:0.0:1746143135.620327:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858728960:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 84us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.620332:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12557 00000100:00100000:1.0:1746143135.623149:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861281792:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143135.623197:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d952 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165071b expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.623212:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d952 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165071b expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.623316:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fb3e00, rc 0) 00000100:00100000:1.0:1746143135.623369:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858729088:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 3493us (3954us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143135.623377:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12556 00000100:00100000:0.0:1746143135.627827:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.628275:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858729344 00000100:00100000:3.0:1746143135.628285:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858729344 00000100:00100000:3.0:1746143135.628330:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8194 00000100:00100000:3.0:1746143135.628338:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+17:31057:x1830962858729344:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143135.628360:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.628379:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12fe00/0x25aee876ca70d960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650722 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.628472:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.628486:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.628491:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.628517:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.628527:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 18 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.628537:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861281920:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.628616:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143135.630997:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861281920:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.631020:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143135.632786:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.632858:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858729472 00000100:00100000:3.0:1746143135.632867:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858729472 00010000:00010000:3.0:1746143135.632902:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 19 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.633190:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6664 00000100:00100000:3.0:1746143135.633199:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+19:1968:x1830962858729472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.633212:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.633218:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 19 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.633229:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 19 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.633251:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f800/0x25aee876ca70d92f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f1 expref: 19 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.633742:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143135.633748:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.633757:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.633764:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.633782:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143135.634049:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143135.634056:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143135.634076:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143135.634238:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12fe00/0x25aee876ca70d960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 20 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.634284:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+19:1968:x1830962858729472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1086us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.634291:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6664 00010000:00010000:0.0:1746143135.636124:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.636135:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143135.636137:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143135.636143:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12f400, rc 0) 00000100:00100000:0.0:1746143135.636199:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:31057:x1830962858729344:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7860us (8383us total) trans 8589942407 rc 0/0 00000100:00100000:0.0:1746143135.636210:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8194 00000100:00100000:0.0:1746143135.639707:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.639787:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858729600 00000100:00100000:2.0:1746143135.639796:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858729600 00000100:00100000:2.0:1746143135.640155:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8195 00000100:00100000:2.0:1746143135.640167:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:31057:x1830962858729600:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143135.640204:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.640223:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ee00/0x25aee876ca70d975 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650729 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.640312:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.640382:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 19 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.640390:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.640419:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 19 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.640431:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 19 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.640442:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861282048:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.641211:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143135.646056:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861282048:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.646083:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143135.646319:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.646402:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858729728 00000100:00100000:3.0:1746143135.646410:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858729728 00010000:00010000:3.0:1746143135.646623:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 20 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.646665:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6665 00000100:00100000:3.0:1746143135.646673:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:1968:x1830962858729728:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.646687:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.646693:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 20 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.646703:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 20 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.646726:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b12f400/0x25aee876ca70d967 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650722 expref: 20 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.646755:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143135.646760:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.646769:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.646776:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.646793:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143135.646845:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+19:1968:x1830962858729728:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 172us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.646851:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6665 00010000:00010000:2.0:1746143135.647258:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.647266:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143135.647314:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143135.647319:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143135.647336:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.647366:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ee00/0x25aee876ca70d975 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650729 expref: 19 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.647392:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650729 expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.647399:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143135.647401:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143135.647404:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586e400, rc 0) 00000100:00100000:2.0:1746143135.647876:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:31057:x1830962858729600:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 7706us (8173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.647884:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8195 00000100:00100000:0.0:1746143135.651611:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.651733:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858729856 00000100:00100000:1.0:1746143135.651740:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858729856 00000100:00100000:1.0:1746143135.651792:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12558 00000100:00100000:1.0:1746143135.651800:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858729856:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143135.651819:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.651837:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135fb2e00/0x25aee876ca70d983 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650730 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.651990:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861282176:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143135.652300:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b630fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143135.657092:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861282176:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143135.657131:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135fb2e00/0x25aee876ca70d983 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650730 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.657145:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135fb2e00/0x25aee876ca70d983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650730 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.657161:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fb2e00, rc 0) 00000100:00100000:2.0:1746143135.657412:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858729856:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5611us (5816us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143135.657421:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12558 00000100:00100000:0.0:1746143135.666157:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.666339:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858730112 00000100:00100000:2.0:1746143135.666349:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858730112 00000100:00100000:2.0:1746143135.666397:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8196 00000100:00100000:2.0:1746143135.666404:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+18:31057:x1830962858730112:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143135.666423:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.666442:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e000/0x25aee876ca70d98a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650737 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.666533:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fa00/0x25aee876ca70d991 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.666546:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fa00/0x25aee876ca70d991 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.666556:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fa00/0x25aee876ca70d991 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143135.666567:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143135.666681:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e000/0x25aee876ca70d98a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650737 expref: 21 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.666716:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fa00/0x25aee876ca70d991 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650737 expref: 20 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.666724:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143135.666727:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143135.666730:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586fa00, rc 0) 00000100:00100000:2.0:1746143135.666775:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:31057:x1830962858730112:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 372us (628us total) trans 8589942408 rc 0/0 00000100:00100000:2.0:1746143135.666781:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8196 00000100:00100000:0.0:1746143135.671008:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.671066:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.671099:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.671121:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.671140:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858730368 00000100:00100000:0.0:1746143135.671140:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858730240 00000100:00100000:1.0:1746143135.671148:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858730368 00000100:00100000:0.0:1746143135.671148:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858730240 00000100:00100000:1.0:1746143135.671199:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858730496 00000100:00100000:1.0:1746143135.671202:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858730496 00000100:00100000:2.0:1746143135.671229:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858730624 00000100:00100000:2.0:1746143135.671236:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858730624 00000100:00100000:3.0:1746143135.671287:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12559 00000100:00100000:3.0:1746143135.671297:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858730368:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:3.0:1746143135.671437:0:20836:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.671458:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 33 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.671466:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.671474:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.671480:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.671482:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.671485:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.671515:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.671527:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.671540:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861282304:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.671578:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12560 00000100:00100000:1.0:1746143135.671584:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12561 00000100:00100000:0.0:1746143135.671585:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858730240:12345-192.168.201.28@tcp:1:lfs.0 00000100:00100000:1.0:1746143135.671591:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858730496:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143135.671607:0:22204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.671608:0:8448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.671617:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.671619:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 33 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.671624:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 9 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.671626:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.671631:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.671636:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.671638:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.671638:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.671640:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.671643:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.671644:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.671646:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.671658:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.671662:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 19 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.671666:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 23 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:1.0:1746143135.671669:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 19 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143135.671675:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861282432:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143135.671676:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861282560:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.671736:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12562 00010000:00010000:1.0:1746143135.671740:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 8 pid: 22204 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143135.671742:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858730624:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:1.0:1746143135.671747:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 8 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:1.0:1746143135.671754:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861282688:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.671760:0:26949:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.671771:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.671777:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 9 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.671784:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.671789:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.671790:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.671791:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.671807:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.671988:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 23 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143135.671997:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861282816:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143135.672115:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 9 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.672120:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 33 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672124:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 9 pid: 20836 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143135.672133:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861282944:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143135.672134:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 33 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.672143:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861283072:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143135.672160:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 25 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672168:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 25 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.672169:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b630fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143135.672176:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861283200:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.672206:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.672222:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.672245:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858730752 00000100:00100000:0.0:1746143135.672249:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858730752 00000100:00100000:0.0:1746143135.672268:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12563 00000100:00100000:0.0:1746143135.672273:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858730752:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143135.672289:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672299:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672306:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 10 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.672312:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 25 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672318:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672323:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143135.672324:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143135.672326:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 7/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672338:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672344:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 23 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.672356:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861283328:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143135.672377:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 25 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672383:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 25 pid: 4756 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.672389:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861283456:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143135.672405:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 10 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.672410:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 10 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143135.672416:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861283584:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.672463:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.672472:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 10 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143135.672478:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861283712:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.672494:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.672500:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 25 pid: 4758 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.672507:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861283840:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.672515:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d425480 going to sleep for 11 seconds 00010000:00010000:3.0:1746143135.672573:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.672581:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 8 pid: 4756 timeout: 1017 lvb_type: 1 00000100:00100000:3.0:1746143135.672589:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861283968:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.672604:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 33 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.672610:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.672616:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861284096:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.672625:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ea180 going to sleep for 11 seconds 00010000:00010000:0.0:1746143135.672673:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 23 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.672680:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 23 pid: 4756 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.672687:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861284224:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.672696:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a341840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.674047:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.677265:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858730880 00000100:00100000:2.0:1746143135.677276:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858730880 00000100:00100000:2.0:1746143135.677339:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12564 00000100:00100000:2.0:1746143135.677346:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858730880:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:2.0:1746143135.677385:0:4756:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.677400:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.677406:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143135.677407:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143135.677409:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.677438:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.677447:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 19 pid: 4756 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.677458:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861284352:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.678134:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.691636:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861282560:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.698301:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.698338:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.698360:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861282432:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.698377:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861282944:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.698389:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.698418:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858731136 00000100:00100000:0.0:1746143135.698425:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858731136 00000100:00100000:3.0:1746143135.698642:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858731008 00000100:00100000:3.0:1746143135.698649:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858731008 00010000:00010000:0.0:1746143135.698657:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 11 pid: 20836 timeout: 1017 lvb_type: 1 00010000:00010000:3.0:1746143135.698678:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 10 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143135.698695:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858731264 00000100:00100000:0.0:1746143135.698698:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858731264 00010000:00010000:0.0:1746143135.698712:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 20 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:3.0:1746143135.698721:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6666 00000100:00100000:3.0:1746143135.698730:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858731136:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143135.698736:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6667 00000100:00100000:0.0:1746143135.698743:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858731008:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.698744:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143135.698757:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.698765:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 11 pid: 20836 timeout: 1017 lvb_type: 1 00010000:00010000:3.0:1746143135.698777:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 11 pid: 20836 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143135.698777:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 10 pid: 22204 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143135.698788:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 10 pid: 22204 timeout: 1017 lvb_type: 1 00010000:00010000:3.0:1746143135.698798:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a586ec00/0x25aee876ca70d936 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506f8 expref: 11 pid: 20836 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143135.698811:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.698815:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6668 00010000:00010000:3.0:1746143135.698816:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.698825:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1970:x1830962858731264:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.698833:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.698844:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 20 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143135.698853:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858731008:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 110us (518us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143135.698854:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 20 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143135.698859:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6667 00010000:00010000:1.0:1746143135.698867:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc0e00/0x25aee876ca70d825 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505f5 expref: 20 pid: 22204 timeout: 1017 lvb_type: 1 00010000:00010000:1.0:1746143135.698890:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143135.699706:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858731136:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 975us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.699714:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6666 00000100:00100000:1.0:1746143135.700088:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858731264:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1262us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.700096:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6668 00010000:00010000:1.0:1746143135.700163:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135fb3c00/0x25aee876ca70d944 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650706 expref: 9 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:1.0:1746143135.700173:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861282688:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143135.700198:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861283072:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143135.700224:0:8448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.700281:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.700382:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858731392 00000100:00100000:2.0:1746143135.700387:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858731392 00010000:00010000:2.0:1746143135.700412:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.700431:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6669 00000100:00100000:2.0:1746143135.700624:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1971:x1830962858731392:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.700633:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.700643:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.700652:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.700670:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af7a200/0x25aee876ca70d7fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505d2 expref: 34 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.700685:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.700687:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.700691:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700698:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700714:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.700732:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858731392:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 297us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.700738:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6669 00010000:00010000:2.0:1746143135.700754:0:8448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700760:0:8448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700780:0:8448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700787:0:8448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700799:0:8448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700805:0:8448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135fb3e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143135.700809:0:8448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700816:0:8448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700829:0:8448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.700834:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135fb3e00/0x25aee876ca70d9ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.700868:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858730496:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 29278us (29769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.700874:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12561 00000100:00100000:0.0:1746143135.701250:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861283328:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.701282:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861283456:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.701500:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861283200:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.701525:0:22204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.702174:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861282816:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.702193:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861283712:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.706367:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.706403:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.706427:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.706452:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.706602:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858731520 00000100:00100000:0.0:1746143135.706607:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858731776 00000100:00100000:2.0:1746143135.706611:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858731520 00000100:00100000:0.0:1746143135.706611:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858731776 00010000:00010000:2.0:1746143135.706644:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 27 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.706644:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 27 pid: 4756 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.706666:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858732032 00000100:00100000:0.0:1746143135.706668:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858732032 00010000:00010000:0.0:1746143135.706678:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 10 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143135.706691:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858731648 00000100:00100000:0.0:1746143135.706693:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858731648 00000100:00100000:2.0:1746143135.706699:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6670 00010000:00010000:0.0:1746143135.706700:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.706707:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858731776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143135.706709:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6671 00000100:00100000:0.0:1746143135.706714:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858731520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143135.706721:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.706722:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143135.706743:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 27 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.706744:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 27 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.706754:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 27 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.706754:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 27 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.706775:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b12e400/0x25aee876ca70d90c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506e3 expref: 27 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.706775:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8f4a00/0x25aee876ca70d864 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165063b expref: 27 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.706790:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143135.706790:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143135.707023:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858731520:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 109us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.707025:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858731776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 119us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.707047:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6671 00000100:00100000:2.0:1746143135.707052:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6670 00000100:00100000:0.0:1746143135.707067:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6672 00000100:00100000:2.0:1746143135.707071:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6673 00000100:00100000:0.0:1746143135.707073:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858732032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143135.707076:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858731648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143135.707079:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.707084:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143135.707090:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 10 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:2.0:1746143135.707092:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.707098:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 10 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:2.0:1746143135.707100:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.707110:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135fb3600/0x25aee876ca70d94b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165070d expref: 10 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:2.0:1746143135.707115:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b12f000/0x25aee876ca70d8b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650688 expref: 24 pid: 8449 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.707120:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143135.707124:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143135.707136:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858732032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 64us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.707140:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858731648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 64us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.707142:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6672 00000100:00100000:2.0:1746143135.707145:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6673 00000100:00100000:0.0:1746143135.707167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.707228:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858731904 00000100:00100000:1.0:1746143135.707231:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858731904 00010000:00010000:1.0:1746143135.707245:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 23 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:3.0:1746143135.707321:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6674 00000100:00100000:3.0:1746143135.707330:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858731904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.707338:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.707347:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 23 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:3.0:1746143135.707356:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 23 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:3.0:1746143135.707367:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x25aee876ca70d81e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505fc expref: 23 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:3.0:1746143135.707379:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143135.707399:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962858731904:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 71us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.707404:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6674 00000100:00100000:0.0:1746143135.708005:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.708228:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861282304:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143135.708244:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858732160 00000100:00100000:3.0:1746143135.708247:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858732160 00010000:00010000:3.0:1746143135.708263:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 24 pid: 4758 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.708277:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6675 00000100:00100000:3.0:1746143135.708283:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858732160:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.708289:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.708298:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 24 pid: 4758 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.708306:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 24 pid: 4758 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.708317:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.708319:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.708324:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.708333:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.708350:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143135.708370:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858732160:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 87us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.708375:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6675 00010000:00010000:2.0:1746143135.708455:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd18600/0x25aee876ca70d810 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16505e7 expref: 23 pid: 4758 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.708493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.708552:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861283840:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.708565:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143135.708575:0:26949:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.708578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143135.708584:0:26949:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.708590:0:26949:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.708609:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861283584:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.708612:0:26949:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.708620:0:26949:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.708632:0:26949:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.708638:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a708700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861284224:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.708639:0:26949:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a586f400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143135.708643:0:26949:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.708651:0:26949:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.708662:0:26949:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.708662:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.708668:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a586f400/0x25aee876ca70d9b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.708684:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.708695:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858732288 00000100:00100000:0.0:1746143135.708698:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858732288 00010000:00010000:0.0:1746143135.708708:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 22 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143135.708714:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858730624:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 36972us (37591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.708721:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12562 00000100:00100000:0.0:1746143135.708721:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858732416 00000100:00100000:0.0:1746143135.708723:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858732416 00010000:00010000:0.0:1746143135.708732:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 8 pid: 4756 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143135.708742:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858732544 00000100:00100000:0.0:1746143135.708743:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858732672 00000100:00100000:2.0:1746143135.708745:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858732544 00000100:00100000:0.0:1746143135.708745:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858732672 00010000:00010000:0.0:1746143135.708754:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.708757:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.708763:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6676 00000100:00100000:0.0:1746143135.708943:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858732288:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143135.708947:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6677 00010000:00010000:0.0:1746143135.708950:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143135.708953:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858732416:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143135.708960:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 22 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:2.0:1746143135.708962:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143135.708967:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 22 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:2.0:1746143135.708976:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 8 pid: 4756 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143135.708979:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136471600/0x25aee876ca70d879 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650650 expref: 22 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:2.0:1746143135.708985:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 8 pid: 4756 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143135.708989:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.708991:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.708994:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.708997:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143135.709000:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.709013:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.709067:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6678 00000100:00100000:1.0:1746143135.709074:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858732672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.709081:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.709090:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.709098:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.709109:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c007800/0x25aee876ca70d895 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165066c expref: 19 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.709118:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143135.710149:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6679 00000100:00100000:3.0:1746143135.710156:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858732544:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.710164:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.710184:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.710194:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 33 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.710206:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.710207:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.710210:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.710217:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.710229:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.710280:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858732416:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1326us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.710287:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6677 00000100:00100000:3.0:1746143135.710318:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858732544:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 162us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.710325:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6679 00010000:00010000:2.0:1746143135.710339:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70d93d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ff expref: 7 pid: 4756 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143135.710350:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861283968:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.710359:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b14dcc00/0x25aee876ca70d88e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650665 expref: 32 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.710366:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861284096:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.710383:0:20836:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.710385:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143135.710390:0:20836:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710396:0:20836:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.710400:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858732800 00000100:00100000:3.0:1746143135.710402:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858732800 00010000:00010000:2.0:1746143135.710413:0:20836:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710420:0:20836:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143135.710426:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3702784->4009983) req@ffff88008eaad500 x1830962858732800/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143135.710426:0:20836:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710433:0:20836:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b12f200 already unused, calling callback (ffffffffa0868d70) 00002000:00100000:3.0:1746143135.710436:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaad500 with x1830962858732800 ext(3702784->4009983) 00010000:00010000:2.0:1746143135.710437:0:20836:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710443:0:20836:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.710448:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 19 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.710452:0:20836:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710457:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70d99f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.710458:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 19 pid: 4756 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.710463:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008eaad500 00000100:00100000:3.0:1746143135.710476:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2013 00000100:00100000:3.0:1746143135.710480:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858732800:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143135.710499:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858730368:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 39203us (39432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.710505:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12559 00010000:00010000:2.0:1746143135.710528:0:22204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710535:0:22204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710549:0:22204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710556:0:22204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710562:0:22204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710568:0:22204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941bbc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143135.710570:0:22204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710577:0:22204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710587:0:22204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.710592:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941bbc00/0x25aee876ca70d9a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.710682:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858732672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1607us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.710689:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6678 00000100:00100000:1.0:1746143135.710721:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.710771:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.710782:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858732928 00000100:00100000:1.0:1746143135.710785:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858732928 00010000:00010000:1.0:1746143135.710797:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 22 pid: 4756 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.711010:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858733056 00000100:00100000:1.0:1746143135.711012:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858733056 00010000:00010000:1.0:1746143135.711023:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 8 pid: 22204 timeout: 1017 lvb_type: 1 00000100:00100000:1.0:1746143135.711056:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6680 00000100:00100000:1.0:1746143135.711062:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858732928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.711068:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.711079:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 22 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.711086:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 22 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.711098:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a586e600/0x25aee876ca70d8f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506ce expref: 22 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.711108:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.711123:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858732928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 62us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.711129:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6680 00000100:00100000:1.0:1746143135.711139:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6681 00000100:00100000:1.0:1746143135.711144:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858733056:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.711150:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.711156:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 8 pid: 22204 timeout: 1017 lvb_type: 1 00010000:00010000:1.0:1746143135.711164:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 8 pid: 22204 timeout: 1017 lvb_type: 1 00010000:00010000:1.0:1746143135.711174:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba400/0x25aee876ca70d959 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650714 expref: 8 pid: 22204 timeout: 1017 lvb_type: 1 00010000:00010000:1.0:1746143135.711194:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.711196:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.711198:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.711205:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.711225:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143135.711241:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858733056:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 97us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.711246:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6681 00000100:00100000:3.0:1746143135.711655:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861284352:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143135.711668:0:4756:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.711694:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1971:x1830962858730240:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 40109us (40696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.711701:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12560 00010000:00010000:0.0:1746143135.712328:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.712336:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.712353:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.712360:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.712371:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.712377:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941bac00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143135.712379:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.712385:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.712394:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.712399:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941bac00/0x25aee876ca70d9bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.713052:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1971:x1830962858730752:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 40777us (40829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.713059:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12563 00000100:00100000:0.0:1746143135.713084:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858732288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4315us (4592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.713090:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6676 00000100:00100000:3.0:1746143135.723083:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858732800:12345-192.168.201.28@tcp:4:cat.0 Request processed in 12587us (12683us total) trans 17179872793 rc 0/0 00000100:00100000:3.0:1746143135.723096:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2013 00002000:00100000:3.0:1746143135.723108:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3702784->4009983) req@ffff88008eaad500 x1830962858732800/t17179872793(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/448 e 0 to 0 dl 1746143146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143135.723117:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaad500 with x1830962858732800 ext(3702784->4009983) 00010000:00010000:3.0:1746143135.723127:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 20 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.723143:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 20 pid: 4756 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143135.723152:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008eaad500 00000100:00100000:0.0:1746143135.725102:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.725216:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858733184 00000100:00100000:2.0:1746143135.725223:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858733184 00010000:00010000:2.0:1746143135.725253:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 20 pid: 4756 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.725276:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6682 00000100:00100000:2.0:1746143135.725283:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858733184:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.725296:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.725314:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 20 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.725324:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 20 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.725345:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12ec00/0x25aee876ca70d905 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->4009983) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16506dc expref: 20 pid: 4756 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.725363:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.725365:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.725369:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.725377:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.725404:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143135.725437:0:4756:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.725437:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858733184:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 155us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.725444:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6682 00010000:00010000:3.0:1746143135.725447:0:4756:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.725465:0:4756:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.725472:0:4756:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.725479:0:4756:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.725485:0:4756:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a586e000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143135.725489:0:4756:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.725496:0:4756:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.725506:0:4756:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.725516:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a586e000/0x25aee876ca70d9c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.725562:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1971:x1830962858730880:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 48216us (51537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.725569:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12564 00000100:00100000:0.0:1746143135.727750:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.727870:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858733440 00000100:00100000:2.0:1746143135.727876:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858733440 00000100:00100000:2.0:1746143135.727906:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8197 00000100:00100000:2.0:1746143135.727912:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+20:31057:x1830962858733440:12345-192.168.201.28@tcp:36:lfs.0 00010000:00010000:2.0:1746143135.727956:0:17079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.727975:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586e400/0x25aee876ca70d97c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650729 expref: 20 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.727988:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143135.727991:0:17079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143135.728016:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.728025:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 219 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728054:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 219 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728060:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 28 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728066:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 219 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728071:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 28 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728078:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 28 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728084:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 219 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728089:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.728114:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 219 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728123:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 219 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.728135:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284480:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.728640:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 28 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728648:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 28 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.728656:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284608:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.728681:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 28 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728687:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 28 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.728695:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284736:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.728714:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 219 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728721:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 219 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.728728:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284864:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.728745:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 28 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728752:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 28 pid: 14796 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.728758:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919de300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284992:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.728776:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 219 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728783:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 219 pid: 14796 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.728789:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861285120:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.728807:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 219 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.728818:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 219 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.728825:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861285248:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.728839:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b24503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143135.733172:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.733215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.733232:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.733273:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284480:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.733275:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.733286:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284608:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143135.733292:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.733294:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284736:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.733300:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284864:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.733308:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919de300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861284992:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.733316:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861285120:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143135.733323:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861285248:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143135.733357:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143135.733364:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.733383:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858733568 00000100:00100000:0.0:1746143135.733383:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858734208 00000100:00100000:2.0:1746143135.733387:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858733568 00000100:00100000:0.0:1746143135.733387:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858734208 00010000:00010000:2.0:1746143135.733408:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 220 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.733409:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 29 pid: 14796 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.733425:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858734336 00000100:00100000:2.0:1746143135.733426:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858734336 00010000:00010000:2.0:1746143135.733432:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 30 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.733486:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858733824 00000100:00100000:3.0:1746143135.733490:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858733824 00000100:00100000:3.0:1746143135.733511:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858734080 00000100:00100000:3.0:1746143135.733513:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858734080 00000100:00100000:3.0:1746143135.733526:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3466 00000100:00100000:3.0:1746143135.733533:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+221:30386:x1830962858733824:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143135.733735:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+222:30386:x1830962858733824:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 201us (522us total) trans 8589942409 rc 0/0 00000100:00100000:1.0:1746143135.733736:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3467 00000100:00100000:3.0:1746143135.733742:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3466 00000100:00100000:1.0:1746143135.733745:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:26839:x1830962858734080:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143135.733833:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+32:26839:x1830962858734080:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 89us (599us total) trans 8589942410 rc 0/0 00000100:00100000:1.0:1746143135.733840:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3467 00000100:00100000:0.0:1746143135.734012:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858734464 00000100:00100000:0.0:1746143135.734015:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858734464 00000100:00100000:1.0:1746143135.734016:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6683 00000100:00100000:1.0:1746143135.734023:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+222:1969:x1830962858733568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143135.734028:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 222 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.734053:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.734060:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 222 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.734063:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6684 00010000:00010000:1.0:1746143135.734071:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 222 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.734079:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1969:x1830962858734208:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143135.734086:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143135.734091:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 31 pid: 14796 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.734092:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7a200/0x25aee876ca70d39b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502de expref: 222 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.734095:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6685 00010000:00010000:0.0:1746143135.734099:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 31 pid: 14796 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.734107:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00000100:00100000:2.0:1746143135.734112:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+31:1970:x1830962858734336:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.734112:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.734120:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143135.734131:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143135.734138:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+221:1969:x1830962858733568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 116us (977us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143135.734142:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 31 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.734145:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6683 00000100:00100000:1.0:1746143135.734161:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6686 00000100:00100000:1.0:1746143135.734166:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+220:1970:x1830962858734464:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143135.734174:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143135.734193:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 220 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.734589:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efa3e00/0x25aee876ca70d0d1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165012c expref: 31 pid: 14796 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.734594:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 31 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.734606:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 220 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.734627:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b43b800/0x25aee876ca70d339 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16502bb expref: 30 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.734631:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee800/0x25aee876ca70d0a0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650117 expref: 220 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.734641:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:1.0:1746143135.734644:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.734650:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143135.734651:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143135.734656:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.734663:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143135.734665:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00000100:00100000:1.0:1746143135.734666:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+219:1970:x1830962858734464:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 499us (1301us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143135.734669:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143135.734672:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6686 00010000:00010000:0.0:1746143135.734680:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143135.734703:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858734208:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 635us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.734705:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1970:x1830962858734336:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 600us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.734710:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6684 00000100:00100000:2.0:1746143135.734716:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6685 00000100:00100000:0.0:1746143135.734758:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.734802:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858734592 00000100:00100000:2.0:1746143135.734808:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858734592 00010000:00010000:2.0:1746143135.734823:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 219 pid: 14796 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.734853:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6687 00000100:00100000:2.0:1746143135.734862:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+219:1969:x1830962858734592:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.734869:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.734873:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 219 pid: 14796 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.734880:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 219 pid: 14796 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.734891:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a000/0x25aee876ca70d0a7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165011e expref: 219 pid: 14796 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.734900:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143135.734903:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.734909:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.734926:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+218:1969:x1830962858734592:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.734932:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6687 00000100:00100000:1.0:1746143135.740326:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.740554:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.740634:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858734720 00000100:00100000:3.0:1746143135.740643:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858734720 00010000:00010000:3.0:1746143135.740675:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 28 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.740703:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858734848 00000100:00100000:3.0:1746143135.740706:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858734848 00010000:00010000:3.0:1746143135.740716:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 218 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.740739:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6688 00000100:00100000:3.0:1746143135.740746:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858734720:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.740760:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.740765:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 28 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.740793:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 28 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.740812:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093244800/0x25aee876ca70d1db lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501e9 expref: 28 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.740826:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143135.740830:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.740838:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143135.740876:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858734720:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 130us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.740882:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6688 00000100:00100000:3.0:1746143135.740896:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6689 00000100:00100000:3.0:1746143135.740900:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+218:1969:x1830962858734848:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.740906:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.740910:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 218 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.740918:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 218 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.740929:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70d1b1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16501cd expref: 218 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.740937:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143135.740940:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.740947:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.740953:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.741971:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143135.742673:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.742681:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:3.0:1746143135.743601:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+217:1969:x1830962858734848:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2695us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.743610:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6689 00000040:00080000:2.0:1746143135.743733:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2396, 88 off203560 00000004:00080000:2.0:1746143135.743740:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917583708315ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.743969:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2412, 88 off204704 00000004:00080000:2.0:1746143135.743975:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917583943526ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.744012:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2414, 88 off204888 00000004:00080000:2.0:1746143135.744015:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917583983945ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.744024:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2397, 88 off203648 00000004:00080000:2.0:1746143135.744027:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917583995219ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.744050:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2398, 88 off203736 00000004:00080000:2.0:1746143135.744055:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917584023115ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.744061:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2415, 88 off204976 00000004:00080000:2.0:1746143135.744064:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917584032515ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.744069:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2416, 88 off205064 00000004:00080000:2.0:1746143135.744072:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917584040119ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.744078:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2417, 88 off205152 00000004:00080000:2.0:1746143135.744080:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917584048750ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.744086:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2399, 88 off203824 00000004:00080000:2.0:1746143135.744089:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917584057525ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.744095:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2418, 88 off205240 00000004:00080000:2.0:1746143135.744097:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917584066065ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.744103:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2400, 88 off203912 00000004:00080000:2.0:1746143135.744106:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917584074335ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.744111:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2419, 88 off205328 00000004:00080000:2.0:1746143135.744114:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917584082912ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.744126:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2401, 88 off204000 00000004:00080000:2.0:1746143135.744128:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917584096867ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.744134:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2402, 88 off204088 00000004:00080000:2.0:1746143135.744137:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917584105539ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.744142:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2403, 88 off204176 00000004:00080000:2.0:1746143135.744145:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917584113595ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.744151:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2404, 88 off204264 00000004:00080000:2.0:1746143135.744154:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917584122445ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.744160:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2420, 88 off205416 00000004:00080000:2.0:1746143135.744162:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917584130887ns, next at 860119223596ns, rc = 0 00000001:00080000:0.0:1746143135.772824:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942407 is committed 00000001:00080000:0.0:1746143135.772837:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942406 is committed 00000001:00080000:0.0:1746143135.772842:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942398 is committed 00000001:00080000:0.0:1746143135.772868:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942410 is committed 00000004:00010000:3.0:1746143135.772885:0:17079:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092994000 reply state ffff88009300d000 transno 8589942411 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:3.0:1746143135.772898:0:17079:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746143135.772910:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942411 is committed 00000004:00080000:0.0:1746143135.772914:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1837 committed 00000004:00080000:0.0:1746143135.772925:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1827 committed 00000004:00080000:0.0:1746143135.772930:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1826 committed 00000004:00080000:0.0:1746143135.772932:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1825 committed 00000004:00080000:0.0:1746143135.772934:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1824 committed 00000004:00080000:0.0:1746143135.772935:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1836 committed 00000004:00080000:0.0:1746143135.772937:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1823 committed 00000004:00080000:0.0:1746143135.772938:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1835 committed 00000004:00080000:0.0:1746143135.772940:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1822 committed 00000004:00080000:0.0:1746143135.772941:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1834 committed 00000004:00080000:0.0:1746143135.772943:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1833 committed 00000004:00080000:0.0:1746143135.772945:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1832 committed 00000004:00080000:0.0:1746143135.772946:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1821 committed 00000004:00080000:0.0:1746143135.772948:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1820 committed 00000004:00080000:0.0:1746143135.772950:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1831 committed 00000004:00080000:0.0:1746143135.772951:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1830 committed 00000004:00080000:0.0:1746143135.772953:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1819 committed 00000001:00080000:0.0:1746143135.772995:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942409 is committed 00010000:00080000:3.0:1746143135.773003:0:17079:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143135.773019:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31057:x1830962858733440:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 45102us (45270us total) trans 8589942411 rc 0/0 00000100:00100000:3.0:1746143135.773027:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8197 00000100:00100000:0.0:1746143135.773140:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143135.773154:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861285376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.773218:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.773251:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861285760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.773265:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.773275:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861286272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.773286:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.773297:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861286784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.773309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.773320:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861287296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.773331:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.773340:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746143135.773344:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861285888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.773354:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861285504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.773358:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.773368:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861286400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.773378:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.773592:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861286016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.773596:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861285376 00000100:00100000:0.0:1746143135.773603:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861285376 00000100:00100000:1.0:1746143135.773606:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.773616:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861286528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.773627:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.773636:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861287040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.773639:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861285760 00000100:00100000:0.0:1746143135.773641:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861285760 00000100:00100000:1.0:1746143135.773646:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.773651:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861286272 00000100:00100000:0.0:1746143135.773653:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861286272 00000100:00100000:0.0:1746143135.773658:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861286784 00010000:00010000:2.0:1746143135.773659:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143135.773659:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746143135.773659:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861286784 00000100:00100000:1.0:1746143135.773663:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861285632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.773664:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861287296 00000100:00100000:0.0:1746143135.773666:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861287296 00000100:00100000:0.0:1746143135.773671:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861285888 00010000:00010000:2.0:1746143135.773672:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143135.773675:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143135.773678:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143135.773681:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861286144:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143135.773683:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944e7a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143135.773686:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143135.773691:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143135.773692:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143135.773697:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861286656:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143135.773706:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00000100:00100000:1.0:1746143135.773707:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143135.773709:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143135.773712:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143135.773713:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861287168:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143135.773716:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944e7a00/0x25aee876ca70d9c9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143135.773724:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.773741:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861285504 00000100:00100000:1.0:1746143135.773744:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861285504 00000100:00100000:1.0:1746143135.773761:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861286016 00000100:00100000:1.0:1746143135.773763:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861286016 00000100:00100000:1.0:1746143135.773769:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861286528 00000100:00100000:1.0:1746143135.773771:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861286528 00000100:00100000:1.0:1746143135.773776:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861287040 00000100:00100000:1.0:1746143135.773778:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861287040 00000100:00100000:1.0:1746143135.773783:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861285632 00000100:00100000:1.0:1746143135.773784:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861285632 00000100:00100000:1.0:1746143135.773789:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861286144 00000100:00100000:1.0:1746143135.773790:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861286144 00000100:00100000:1.0:1746143135.773797:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861286656 00000100:00100000:1.0:1746143135.773798:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861286656 00000100:00100000:1.0:1746143135.773804:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861287168 00000100:00100000:1.0:1746143135.773805:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861287168 00000100:00100000:1.0:1746143135.773814:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12565 00000100:00100000:1.0:1746143135.773820:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861285376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.773841:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12566 00000100:00100000:2.0:1746143135.773853:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861285760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.774006:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861285376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (787us total) trans 17179872794 rc 0/0 00000100:00100000:1.0:1746143135.774014:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12565 00000100:00100000:1.0:1746143135.774025:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12567 00000100:00100000:1.0:1746143135.774048:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861286272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.774074:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861285760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (807us total) trans 17179872795 rc 0/0 00000100:00100000:2.0:1746143135.774081:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12566 00000100:00100000:2.0:1746143135.774102:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12568 00000100:00100000:2.0:1746143135.774109:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861286784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.774137:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861286272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (848us total) trans 17179872796 rc 0/0 00000100:00100000:1.0:1746143135.774142:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12567 00000100:00100000:1.0:1746143135.774152:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12569 00000100:00100000:1.0:1746143135.774156:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861287296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.774218:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861286784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (906us total) trans 17179872797 rc 0/0 00000100:00100000:2.0:1746143135.774224:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12568 00000100:00100000:2.0:1746143135.774237:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12570 00000100:00100000:2.0:1746143135.774242:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861285504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.774256:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861287296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (923us total) trans 17179872798 rc 0/0 00000100:00100000:1.0:1746143135.774262:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12569 00000100:00100000:1.0:1746143135.774274:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12571 00000100:00100000:1.0:1746143135.774278:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3301:x1830962861286016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.774361:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3301:x1830962861285504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (982us total) trans 21474840055 rc 0/0 00000100:00100000:2.0:1746143135.774367:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12570 00000100:00100000:2.0:1746143135.774380:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12572 00000100:00100000:2.0:1746143135.774384:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861286528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.774390:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861286016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (782us total) trans 17179872799 rc 0/0 00000100:00100000:1.0:1746143135.774395:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12571 00000100:00100000:1.0:1746143135.774405:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12573 00000100:00100000:1.0:1746143135.774409:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861287040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.774417:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861285888 00000100:00080000:0.0:1746143135.774429:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143135.774651:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143135.774671:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12574 00000100:00100000:0.0:1746143135.774677:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861285632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.774690:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861286528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 305us (1061us total) trans 17179872800 rc 0/0 00000100:00100000:2.0:1746143135.774697:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12572 00000100:00100000:2.0:1746143135.774707:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12575 00000100:00100000:2.0:1746143135.774712:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3301:x1830962861286144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143135.774722:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143135.774725:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143135.774727:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143135.774729:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143135.774731:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143135.774750:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3301:x1830962861287040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 341us (1102us total) trans 21474840056 rc 0/0 00000100:00100000:1.0:1746143135.774756:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12573 00000100:00100000:1.0:1746143135.774767:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12576 00000100:00100000:1.0:1746143135.774771:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3301:x1830962861286656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.774778:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861285632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (1101us total) trans 17179872801 rc 0/0 00000100:00100000:0.0:1746143135.774784:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12574 00000100:00100000:0.0:1746143135.774795:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12577 00000100:00100000:0.0:1746143135.774799:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3301:x1830962861287168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.774822:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3301:x1830962861286144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (1128us total) trans 21474840057 rc 0/0 00000100:00100000:2.0:1746143135.774828:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12575 00000100:00100000:2.0:1746143135.774840:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12578 00000100:00100000:2.0:1746143135.774845:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3299:x1830962861285888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.775336:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.775861:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800906a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861286912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.775899:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143135.775954:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dd500/2, rc 0, transno 17179872798 00000100:00100000:1.0:1746143135.775960:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861287296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.775970:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919de300/2, rc 0, transno 17179872795 00000100:00100000:1.0:1746143135.775973:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861285760:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.775980:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919df800/2, rc 0, transno 17179872796 00000100:00100000:1.0:1746143135.775982:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861286272:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.775989:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dca80/2, rc 0, transno 17179872797 00000100:00100000:1.0:1746143135.775992:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861286784:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.775998:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919ddc00/2, rc 0, transno 17179872794 00000100:00100000:1.0:1746143135.776001:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861285376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.776023:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dc700/2, rc 0, transno 17179872801 00000100:00100000:1.0:1746143135.776026:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861285632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.776063:0:3301:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840039 gen 2 00000004:00080000:1.0:1746143135.776068:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a709f80, transno 21474839970 00000004:00080000:1.0:1746143135.776074:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a70b800, transno 21474839971 00000004:00080000:1.0:1746143135.776076:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b8aa00, transno 21474839972 00000004:00080000:1.0:1746143135.776078:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a709c00, transno 21474839973 00000004:00080000:1.0:1746143135.776081:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a708a80, transno 21474839974 00000004:00080000:1.0:1746143135.776082:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a709880, transno 21474839975 00000004:00080000:1.0:1746143135.776085:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb23b80, transno 21474839976 00000004:00080000:1.0:1746143135.776087:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b8a680, transno 21474839977 00000004:00080000:1.0:1746143135.776089:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b8b100, transno 21474839978 00000004:00080000:1.0:1746143135.776091:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb74000, transno 21474839982 00000004:00080000:1.0:1746143135.776092:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe78e00, transno 21474839983 00000004:00080000:1.0:1746143135.776094:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb20000, transno 21474839984 00000004:00080000:1.0:1746143135.776096:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7b100, transno 21474839985 00000004:00080000:1.0:1746143135.776098:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b5aa00, transno 21474839986 00000004:00080000:1.0:1746143135.776100:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe79500, transno 21474839987 00000004:00080000:1.0:1746143135.776101:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb23480, transno 21474839988 00000004:00080000:1.0:1746143135.776103:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eb74700, transno 21474839989 00000004:00080000:1.0:1746143135.776105:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d5f80, transno 21474839990 00000004:00080000:1.0:1746143135.776108:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314f100, transno 21474839991 00000004:00080000:1.0:1746143135.776109:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e300, transno 21474839992 00000004:00080000:1.0:1746143135.776111:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314fb80, transno 21474839993 00000004:00080000:1.0:1746143135.776113:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314d180, transno 21474839994 00000004:00080000:1.0:1746143135.776115:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314c380, transno 21474839995 00000004:00080000:1.0:1746143135.776117:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314df80, transno 21474839996 00000004:00080000:1.0:1746143135.776118:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e680, transno 21474839997 00000004:00080000:1.0:1746143135.776120:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ccbb80, transno 21474839998 00000004:00080000:1.0:1746143135.776122:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b11500, transno 21474839999 00000004:00080000:1.0:1746143135.776124:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135182d80, transno 21474840003 00000004:00080000:1.0:1746143135.776126:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135181880, transno 21474840004 00000004:00080000:1.0:1746143135.776127:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135180a80, transno 21474840005 00000004:00080000:1.0:1746143135.776129:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135183480, transno 21474840006 00000004:00080000:1.0:1746143135.776131:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135182a00, transno 21474840007 00000004:00080000:1.0:1746143135.776133:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135182680, transno 21474840008 00000004:00080000:1.0:1746143135.776135:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135181500, transno 21474840009 00000004:00080000:1.0:1746143135.776137:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135180e00, transno 21474840010 00000004:00080000:1.0:1746143135.776139:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb55f80, transno 21474840011 00000004:00080000:1.0:1746143135.776141:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5841880, transno 21474840012 00000004:00080000:1.0:1746143135.776143:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d4380, transno 21474840013 00000004:00080000:1.0:1746143135.776145:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa1c00, transno 21474840014 00000004:00080000:1.0:1746143135.776147:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d5500, transno 21474840015 00000004:00080000:1.0:1746143135.776149:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d6d80, transno 21474840016 00000004:00080000:1.0:1746143135.776151:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d5880, transno 21474840017 00000004:00080000:1.0:1746143135.776153:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d4a80, transno 21474840018 00000004:00080000:1.0:1746143135.776156:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80ea00, transno 21474840019 00000004:00080000:1.0:1746143135.776158:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d6a00, transno 21474840020 00000004:00080000:1.0:1746143135.776160:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913dc380, transno 21474840022 00000004:00080000:1.0:1746143135.776162:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e4e00, transno 21474840023 00000004:00080000:1.0:1746143135.776163:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913de680, transno 21474840024 00000004:00080000:1.0:1746143135.776165:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913dce00, transno 21474840025 00000004:00080000:1.0:1746143135.776167:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e5180, transno 21474840026 00000004:00080000:1.0:1746143135.776169:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e5500, transno 21474840027 00000004:00080000:1.0:1746143135.776171:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913dc000, transno 21474840028 00000004:00080000:1.0:1746143135.776173:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913dd880, transno 21474840029 00000004:00080000:1.0:1746143135.776175:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e4000, transno 21474840030 00000100:00100000:0.0:1746143135.776235:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861286400 00000100:00100000:0.0:1746143135.776241:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861286400 00000100:00100000:0.0:1746143135.776265:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861286912 00000100:00100000:0.0:1746143135.776267:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861286912 00000100:00100000:0.0:1746143135.776288:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12579 00000100:00100000:0.0:1746143135.776293:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861286400:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143135.776305:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b88380, transno 21474840031 00000100:00100000:0.0:1746143135.776306:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12580 00000004:00080000:1.0:1746143135.776308:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb56d80, transno 21474840032 00000004:00080000:1.0:1746143135.776310:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb55880, transno 21474840033 00000100:00100000:0.0:1746143135.776310:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861286912:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143135.776312:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b89180, transno 21474840034 00000004:00080000:1.0:1746143135.776314:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb57100, transno 21474840035 00000004:00080000:1.0:1746143135.776316:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb56300, transno 21474840036 00000004:00080000:1.0:1746143135.776318:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a72a00, transno 21474840037 00000004:00080000:1.0:1746143135.776320:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5cca680, transno 21474840038 00000004:00080000:1.0:1746143135.776322:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb57480, transno 21474840039 00000100:00100000:1.0:1746143135.776329:0:3301:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800906a4a80 x1830962861286144/t21474840057(21474840057) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143151 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143135.776337:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800906a4a80/2, rc 0, transno 21474840057 00000100:00100000:1.0:1746143135.776340:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861286144:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143135.776353:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800906a5500/2, rc 0, transno 21474840055 00000100:00100000:1.0:1746143135.776356:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861285504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143135.776363:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919ded80/2, rc 0, transno 17179872799 00000100:00100000:1.0:1746143135.776366:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861286016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.776371:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dfb80/2, rc 0, transno 17179872800 00000100:00100000:1.0:1746143135.776374:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861286528:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.776380:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800906a5f80/2, rc 0, transno 21474840056 00000100:00100000:1.0:1746143135.776382:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861287040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143135.776717:0:14835:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 5 in flight, 63 done 00000100:00100000:2.0:1746143135.776750:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861287424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.776768:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.776816:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861287424 00000100:00100000:2.0:1746143135.776820:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861287424 00000100:00100000:1.0:1746143135.776823:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3301:x1830962861286656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2050us (3113us total) trans 21474840058 rc 0/0 00000100:00100000:1.0:1746143135.776830:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12576 00000100:00100000:2.0:1746143135.776835:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12581 00000100:00100000:2.0:1746143135.776838:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3300:x1830962861287424:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143135.776851:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800906a4e00/2, rc 0, transno 21474840058 00000100:00100000:1.0:1746143135.776854:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861286656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143135.776860:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800906a5880/2, rc 0, transno 21474840059 00000100:00100000:0.0:1746143135.776861:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3301:x1830962861287168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2061us (3135us total) trans 21474840059 rc 0/0 00000100:00100000:1.0:1746143135.776862:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861287168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.776867:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12577 00000100:00100000:2.0:1746143135.776929:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3300:x1830962861287424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (160us total) trans 21474840061 rc 0/0 00000100:00100000:2.0:1746143135.776933:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12581 00000100:00100000:3.0:1746143135.776939:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861285888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2091us (3577us total) trans 21474840060 rc 0/0 00000100:00100000:3.0:1746143135.776947:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12578 00000004:00080000:2.0:1746143135.776948:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092a7b100/2, rc 0, transno 21474840061 00000100:00100000:2.0:1746143135.776950:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861287424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.776977:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3299:x1830962861286400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 683us (1641us total) trans 21474840062 rc 0/0 00000100:00100000:1.0:1746143135.776983:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3299:x1830962861286912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 672us (1084us total) trans 21474840063 rc 0/0 00000100:00100000:0.0:1746143135.776983:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12579 00000100:00100000:1.0:1746143135.776988:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12580 00000004:00080000:0.0:1746143135.777011:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800906a4000/2, rc 0, transno 21474840060 00000100:00100000:0.0:1746143135.777014:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861285888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143135.777021:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800906a4380/2, rc 0, transno 21474840062 00000100:00100000:0.0:1746143135.777023:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861286400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143135.777060:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800906a7800/2, rc 0, transno 21474840063 00000100:00100000:0.0:1746143135.777063:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800906a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861286912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.778276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.778340:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858734976 00000100:00100000:3.0:1746143135.778346:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858734976 00000100:00100000:3.0:1746143135.778600:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8198 00000100:00100000:3.0:1746143135.778607:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31057:x1830962858734976:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143135.778627:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.778644:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165073e expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.778692:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.778705:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.778721:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143135.778724:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143135.778727:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009532cc00, rc 0) 00000100:00100000:3.0:1746143135.778771:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31057:x1830962858734976:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 164us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.778777:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8198 00000100:00100000:0.0:1746143135.780737:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.782193:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858735104 00000100:00100000:2.0:1746143135.782312:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858735104 00000100:00100000:2.0:1746143135.782366:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8199 00000100:00100000:2.0:1746143135.782374:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31057:x1830962858735104:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143135.782390:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.782407:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f000/0x25aee876ca70d9d7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650745 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.782470:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d9de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.782481:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d9de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.782490:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d9de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143135.782510:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143135.782514:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143135.782527:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d9de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.782551:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586f000/0x25aee876ca70d9d7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650745 expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.782565:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d9de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650745 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.782573:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143135.782575:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143135.782578:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586ea00, rc 0) 00000100:00100000:2.0:1746143135.782633:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31057:x1830962858735104:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 260us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.782638:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8199 00000100:00100000:0.0:1746143135.786242:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.786278:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.786293:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.786312:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858735232 00000100:00100000:0.0:1746143135.786316:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.786320:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858735232 00000100:00100000:0.0:1746143135.786330:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.786358:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858735488 00000100:00100000:1.0:1746143135.786360:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858735488 00000100:00100000:1.0:1746143135.786373:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858735744 00000100:00100000:1.0:1746143135.786374:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858735744 00000100:00100000:1.0:1746143135.786384:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858735360 00000100:00100000:1.0:1746143135.786386:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858735360 00000100:00100000:1.0:1746143135.786397:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858735616 00000100:00100000:1.0:1746143135.786398:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858735616 00000100:00100000:0.0:1746143135.786398:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.786412:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12582 00000100:00100000:0.0:1746143135.786420:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858735872 00000100:00100000:0.0:1746143135.786423:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858735872 00000100:00100000:3.0:1746143135.786426:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858735232:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:1.0:1746143135.786429:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12583 00000100:00100000:1.0:1746143135.786436:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858735488:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143135.786443:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143135.786446:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12584 00010000:00010000:1.0:1746143135.786450:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143135.786453:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858735744:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143135.786459:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165074c expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.786461:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.786465:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165075a expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.786472:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650768 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143135.786479:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x6814079d, atime: 0x6814079d, ctime: 0x6814079d, blocks: 0x7cf 00002000:00010000:1.0:1746143135.786487:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x6814079d, atime: 0x6814079d, ctime: 0x6814079c, blocks: 0x821 00002000:00010000:0.0:1746143135.786487:0:4758:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x6814079e, atime: 0x6814079e, ctime: 0x6814079e, blocks: 0x180b 00010000:00010000:3.0:1746143135.786497:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.786499:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.786503:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.786503:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.786505:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.786505:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.786508:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.786512:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.786513:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.786527:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.786528:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.786530:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 9 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.786537:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7d6c00, rc 0) 00010000:00010000:3.0:1746143135.786539:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009532c400, rc 0) 00010000:00010000:0.0:1746143135.786540:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e935a00, rc 0) 00000100:00100000:1.0:1746143135.786580:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858735488:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 143us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.786580:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858735744:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 127us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.786586:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12584 00000100:00100000:1.0:1746143135.786590:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12583 00000100:00100000:2.0:1746143135.786596:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12585 00000100:00100000:0.0:1746143135.786602:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12586 00000100:00100000:2.0:1746143135.786605:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858735360:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:1.0:1746143135.786606:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12587 00000100:00100000:0.0:1746143135.786607:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858735616:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:1.0:1746143135.786611:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858735872:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143135.786613:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143135.786613:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.786618:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143135.786621:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650761 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.786623:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650753 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.786626:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165076f expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143135.786631:0:4758:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x6814079d, atime: 0x6814079d, ctime: 0x6814079d, blocks: 0x81d 00002000:00010000:2.0:1746143135.786633:0:8448:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x6814079d, atime: 0x6814079d, ctime: 0x6814079d, blocks: 0x81d 00002000:00010000:1.0:1746143135.786636:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x6814079e, atime: 0x6814079e, ctime: 0x6814079e, blocks: 0x1029 00010000:00010000:0.0:1746143135.786638:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.786640:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.786640:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.786641:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.786644:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.786644:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.786645:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.786645:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.786649:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.786651:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143135.786652:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143135.786657:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.786659:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586f800, rc 0) 00010000:00010000:0.0:1746143135.786659:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e935800, rc 0) 00010000:00010000:1.0:1746143135.786664:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7d7000, rc 0) 00000100:00100000:0.0:1746143135.786673:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858735616:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 66us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.786678:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12586 00000100:00100000:2.0:1746143135.786686:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858735360:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 84us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.786688:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858735872:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.786691:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12585 00000100:00100000:1.0:1746143135.786695:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12587 00000100:00100000:3.0:1746143135.787085:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858735232:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 664us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.787090:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12582 00000100:00100000:0.0:1746143135.797417:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.797452:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.797478:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.797495:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858736256 00000100:00100000:0.0:1746143135.797507:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.797509:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858736256 00000100:00100000:3.0:1746143135.797582:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858736512 00000100:00100000:3.0:1746143135.797585:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858736512 00000100:00100000:1.0:1746143135.797606:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858736640 00000100:00100000:3.0:1746143135.797607:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858736896 00000100:00100000:3.0:1746143135.797609:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858736896 00000100:00100000:1.0:1746143135.797614:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858736640 00000100:00100000:3.0:1746143135.797631:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6130 00000100:00100000:3.0:1746143135.797639:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858736256:12345-192.168.201.28@tcp:3:lfs.0 00000100:00100000:1.0:1746143135.797660:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6131 00000100:00100000:1.0:1746143135.797667:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858736512:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:3.0:1746143135.797678:0:21568:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.797694:0:21568:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.797696:0:21568:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.797697:0:31431:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.797701:0:21568:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.797708:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.797709:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.797714:0:31431:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.797715:0:21568:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.797726:0:31431:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.797936:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6132 00000100:00100000:3.0:1746143135.797943:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858736896:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:3.0:1746143135.797956:0:31806:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.797963:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.797964:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.797967:0:31806:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.797974:0:31806:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.798051:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6133 00000100:00100000:0.0:1746143135.798060:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858736640:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143135.798076:0:31432:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.798090:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.798091:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143135.798094:0:31432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143135.798102:0:31432:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.798305:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.798426:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858737280 00000100:00100000:2.0:1746143135.798430:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858737280 00000100:00100000:2.0:1746143135.798453:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6134 00000100:00100000:2.0:1746143135.798459:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858737280:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:2.0:1746143135.798473:0:31430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.798481:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.798482:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.798485:0:31430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.798492:0:31430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.798496:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.798532:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858737408 00000100:00100000:1.0:1746143135.798535:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858737408 00000100:00100000:1.0:1746143135.798570:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6135 00000100:00100000:1.0:1746143135.798575:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858737408:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:1.0:1746143135.798589:0:21522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.798596:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.798598:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143135.798600:0:21522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.798608:0:21522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.803424:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.803729:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858737664 00000100:00100000:2.0:1746143135.803737:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858737664 00000100:00100000:2.0:1746143135.803783:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6136 00000100:00100000:2.0:1746143135.803791:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858737664:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:2.0:1746143135.803816:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.803831:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.803833:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.803838:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.803849:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.807306:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143135.807838:0:31806:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.807875:0:31806:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.807882:0:31806:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.807888:0:31806:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093463e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143135.807892:0:31806:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.807899:0:31806:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.807915:0:31806:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.807922:0:31806:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093463e00/0x25aee876ca70da1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.807951:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858737920 00000100:00100000:2.0:1746143135.807958:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858737920 00000100:00100000:3.0:1746143135.807972:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858736896:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 10028us (10463us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.807981:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6132 00000100:00100000:3.0:1746143135.807999:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6137 00000100:00100000:3.0:1746143135.808006:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858737920:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:3.0:1746143135.808046:0:31806:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.808054:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.808056:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.808061:0:31806:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.808070:0:31806:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.814710:0:21522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.814723:0:21522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.814732:0:21522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.814743:0:21522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e7d6600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143135.814746:0:21522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.814753:0:21522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.814767:0:21522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.814773:0:21522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.814859:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858737408:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 16279us (16358us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143135.814870:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6135 00010000:00010000:1.0:1746143135.819151:0:31431:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.819165:0:31431:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.819172:0:31431:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.819189:0:31431:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e7d7400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143135.819194:0:31431:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.819202:0:31431:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.819217:0:31431:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.819222:0:31431:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70da16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.819306:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1969:x1830962858736512:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 21635us (21849us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143135.819315:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6131 00010000:00010000:1.0:1746143135.827102:0:31432:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.827122:0:31432:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.827132:0:31432:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.827138:0:31432:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e935600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143135.827143:0:31432:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.827151:0:31432:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.827280:0:31432:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.827288:0:31432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e935600/0x25aee876ca70da24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.827375:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858736640:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 29311us (29890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143135.827385:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6133 00010000:00010000:3.0:1746143135.829559:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.829572:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.829577:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.829583:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094577e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143135.829586:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.829591:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.829606:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.829612:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094577e00/0x25aee876ca70da39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.830060:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858737664:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 26264us (26637us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.830069:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6136 00010000:00010000:3.0:1746143135.832439:0:31430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.832455:0:31430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.832462:0:31430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.832468:0:31430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094576400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143135.832471:0:31430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.832479:0:31430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.832496:0:31430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.832502:0:31430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094576400/0x25aee876ca70da2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.832566:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858737280:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 34103us (34257us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.832575:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6134 00010000:00010000:2.0:1746143135.837961:0:21568:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.837980:0:21568:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.837989:0:21568:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.837996:0:21568:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093462200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143135.838000:0:21568:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.838009:0:21568:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.838050:0:21568:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.838063:0:21568:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093462200/0x25aee876ca70da0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.838145:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858736256:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 40502us (40732us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143135.838154:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6130 00010000:00010000:3.0:1746143135.840138:0:31806:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.840149:0:31806:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.840153:0:31806:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.840157:0:31806:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b12e000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143135.840159:0:31806:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.840164:0:31806:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.840353:0:31806:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.840361:0:31806:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12e000/0x25aee876ca70da40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.840425:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858737920:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 32412us (33117us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143135.840434:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6137 00000100:00100000:1.0:1746143135.843612:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.844305:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858738176 00000100:00100000:2.0:1746143135.844314:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858738176 00000100:00100000:2.0:1746143135.844372:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8200 00000100:00100000:2.0:1746143135.844380:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31057:x1830962858738176:12345-192.168.201.28@tcp:36:lfs.0 00010000:00010000:2.0:1746143135.844433:0:17079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.844460:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70d9de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650745 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.844476:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:2.0:1746143135.844480:0:17079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143135.844519:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.844531:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.844541:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00010000:2.0:1746143135.844730:0:17079:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092a78e00 reply state ffff88012ffe8000 transno 8589942412 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143135.844742:0:17079:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143135.845063:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:31057:x1830962858738176:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 682us (1460us total) trans 8589942412 rc 0/0 00000100:00100000:2.0:1746143135.845070:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8200 00010000:00010000:3.0:1746143135.847341:0:3285:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.847355:0:3285:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.847362:0:3285:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.847368:0:3285:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b806c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143135.847372:0:3285:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.847379:0:3285:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.847392:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143135.847395:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143135.847399:0:3285:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.847408:0:3285:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70da47 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143135.847895:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.847964:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858738432 00000100:00100000:3.0:1746143135.847971:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858738432 00000100:00100000:3.0:1746143135.848005:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12588 00000100:00100000:3.0:1746143135.848011:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858738432:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:3.0:1746143135.848269:0:22204:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143135.848272:0:22204:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.848275:0:22204:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.848277:0:22204:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.848279:0:22204:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746143135.848605:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858738432:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 592us (713us total) trans 17179872802 rc 0/0 00000100:00100000:3.0:1746143135.848611:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12588 00000100:00100000:0.0:1746143135.850064:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.850093:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.850125:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858738688 00000100:00100000:1.0:1746143135.850131:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858738688 00000100:00100000:1.0:1746143135.850155:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858738944 00000100:00100000:1.0:1746143135.850157:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858738944 00000100:00100000:1.0:1746143135.850169:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12589 00000100:00100000:1.0:1746143135.850188:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858738688:12345-192.168.201.28@tcp:2:lfs.0 00000100:00100000:3.0:1746143135.850237:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12590 00000100:00100000:3.0:1746143135.850244:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858738944:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:1.0:1746143135.850312:0:4756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143135.850313:0:22204:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143135.850315:0:22204:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.850315:0:4756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.850317:0:22204:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.850317:0:4756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.850319:0:22204:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.850319:0:4756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.850321:0:22204:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00002000:00010000:1.0:1746143135.850321:0:4756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746143135.850447:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.850651:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858738944:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 407us (555us total) trans 17179872803 rc 0/0 00000100:00100000:3.0:1746143135.850657:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12590 00000100:00100000:3.0:1746143135.850672:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858738304 00000100:00100000:3.0:1746143135.850674:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858738304 00000100:00100000:3.0:1746143135.850688:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12591 00000100:00100000:3.0:1746143135.850692:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858738304:12345-192.168.201.28@tcp:2:lfs.0 00000100:00100000:1.0:1746143135.850762:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858738688:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 585us (698us total) trans 21474840064 rc 0/0 00000100:00100000:1.0:1746143135.850768:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12589 00002000:00010000:3.0:1746143135.850963:0:22204:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143135.850965:0:22204:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.850967:0:22204:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.850969:0:22204:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.850971:0:22204:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1999 -> 1999 00000100:00100000:3.0:1746143135.850988:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858738304:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 295us (541us total) trans 21474840065 rc 0/0 00000100:00100000:3.0:1746143135.850993:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12591 00000100:00100000:1.0:1746143135.851135:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.851222:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.851273:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858738560 00000100:00100000:3.0:1746143135.851279:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858738560 00000100:00100000:3.0:1746143135.851294:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858738816 00000100:00100000:3.0:1746143135.851296:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858738816 00000100:00100000:3.0:1746143135.851306:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12592 00000100:00100000:3.0:1746143135.851310:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858738560:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:3.0:1746143135.851383:0:22204:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143135.851386:0:22204:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.851388:0:22204:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143133 -> 1746143134 00002000:00010000:3.0:1746143135.851390:0:22204:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143132 -> 1746143134 00002000:00010000:3.0:1746143135.851391:0:22204:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143135.851408:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12593 00000100:00100000:0.0:1746143135.851417:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858738816:12345-192.168.201.28@tcp:2:lfs.0 00000100:00100000:3.0:1746143135.851591:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858738560:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 278us (454us total) trans 17179872804 rc 0/0 00000100:00100000:3.0:1746143135.851597:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12592 00002000:00010000:0.0:1746143135.851598:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:0.0:1746143135.851600:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.851602:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.851604:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.851606:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:0.0:1746143135.851623:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858738816:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 208us (401us total) trans 21474840066 rc 0/0 00000100:00100000:0.0:1746143135.851628:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12593 00000100:00100000:0.0:1746143135.854399:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.854455:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858739200 00000100:00100000:1.0:1746143135.854463:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858739200 00000100:00100000:1.0:1746143135.854511:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3468 00000100:00100000:1.0:1746143135.854518:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31057:x1830962858739200:12345-192.168.201.28@tcp:35:lfs.0 00000004:00010000:1.0:1746143135.854575:0:16950:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x27a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fa00/0x25aee876ca70d991 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650737 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.854621:0:16950:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16950 initiator: MDT0 00010000:00010000:1.0:1746143135.854633:0:16950:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.854640:0:16950:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 4/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16950 initiator: MDT0 00010000:00010000:1.0:1746143135.854668:0:16950:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.854679:0:16950:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 9 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.854690:0:16950:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16950:1830962861287552:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143135.854779:0:16950:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143135.856592:0:16950:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16950:1830962861287552:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143135.856617:0:16950:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16950 initiator: MDT0 00000100:00100000:0.0:1746143135.857404:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.857475:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858739328 00000100:00100000:3.0:1746143135.857482:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858739328 00010000:00010000:3.0:1746143135.857512:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 10 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:3.0:1746143135.857595:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6690 00000100:00100000:3.0:1746143135.857602:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858739328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.857617:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.857622:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 10 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.857633:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 10 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.857659:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70d9d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165073e expref: 10 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.857690:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:3.0:1746143135.857695:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16950 initiator: MDT0 00010000:00010000:3.0:1746143135.857703:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16950 initiator: MDT0 00010000:00010000:3.0:1746143135.857709:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16950 initiator: MDT0 00010000:00010000:3.0:1746143135.857891:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143135.858054:0:16950:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16950 initiator: MDT0 00010000:00010000:0.0:1746143135.858061:0:16950:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16950 initiator: MDT0 00000040:00080000:0.0:1746143135.858646:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2405, 88 off204352 00000004:00080000:0.0:1746143135.858652:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917698620273ns, next at 860071159912ns, rc = 0 00000100:00100000:3.0:1746143135.858694:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858739328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1091us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.858704:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6690 00000040:00080000:0.0:1746143135.859822:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2421, 88 off205504 00000004:00080000:0.0:1746143135.859827:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917699795301ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143135.860628:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2422, 88 off205592 00000004:00080000:0.0:1746143135.860636:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917700604047ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143135.860650:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2406, 88 off204440 00000004:00080000:0.0:1746143135.860652:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917700620862ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143135.860659:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2407, 88 off204528 00000004:00080000:0.0:1746143135.860661:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917700629724ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143135.860667:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2423, 88 off205680 00000004:00080000:0.0:1746143135.860670:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917700638091ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143135.860675:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2424, 88 off205768 00000004:00080000:0.0:1746143135.860677:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917700646042ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143135.860683:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2425, 88 off205856 00000004:00080000:0.0:1746143135.860687:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917700655716ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143135.860693:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2408, 88 off204616 00000004:00080000:0.0:1746143135.860696:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917700664364ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143135.860702:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2426, 88 off205944 00000004:00080000:0.0:1746143135.860704:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917700672852ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143135.860710:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2409, 88 off204704 00000004:00080000:0.0:1746143135.860712:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917700680661ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143135.860718:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2427, 88 off206032 00000004:00080000:0.0:1746143135.860720:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917700688414ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143135.860766:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2411, 88 off204888 00000004:00080000:0.0:1746143135.860769:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917700737306ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143135.860776:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2412, 88 off204976 00000004:00080000:0.0:1746143135.860778:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917700746795ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143135.860784:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2413, 88 off205064 00000004:00080000:0.0:1746143135.860786:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917700754854ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143135.860995:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2414, 88 off205152 00000004:00080000:0.0:1746143135.860998:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917700966545ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143135.861004:0:16950:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2428, 88 off206120 00000004:00080000:0.0:1746143135.861007:0:16950:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917700975411ns, next at 860119223596ns, rc = 0 00000004:00010000:0.0:1746143135.899868:0:16950:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093b5b800 reply state ffff8800a51ff400 transno 8589942413 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16950 initiator: MDT0 00000100:00100000:0.0:1746143135.899885:0:16950:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746143135.899896:0:16950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143135.899899:0:16950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143135.899908:0:16950:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586fa00/0x25aee876ca70d991 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650737 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143135.900332:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31057:x1830962858739200:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 45812us (45940us total) trans 8589942413 rc 0/0 00000100:00100000:0.0:1746143135.900342:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3468 00000001:00080000:0.0:1746143135.900379:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942413 is committed 00000004:00080000:0.0:1746143135.900385:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1845 committed 00000004:00080000:0.0:1746143135.900392:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1836 committed 00000004:00080000:0.0:1746143135.901400:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1835 committed 00000004:00080000:0.0:1746143135.901404:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1834 committed 00000004:00080000:0.0:1746143135.901406:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1833 committed 00000004:00080000:0.0:1746143135.901407:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1844 committed 00000004:00080000:0.0:1746143135.901410:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1832 committed 00000004:00080000:0.0:1746143135.901412:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1843 committed 00000004:00080000:0.0:1746143135.901413:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1831 committed 00000004:00080000:0.0:1746143135.901415:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1842 committed 00000004:00080000:0.0:1746143135.901416:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1841 committed 00000004:00080000:0.0:1746143135.901419:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1840 committed 00000004:00080000:0.0:1746143135.901420:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1830 committed 00000004:00080000:0.0:1746143135.901422:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1829 committed 00000004:00080000:0.0:1746143135.901423:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1839 committed 00000004:00080000:0.0:1746143135.901425:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1838 committed 00000004:00080000:0.0:1746143135.901427:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1828 committed 00010000:00010000:0.0:1746143135.901542:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16950 initiator: MDT0 00010000:00010000:0.0:1746143135.901551:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16950 initiator: MDT0 00010000:00010000:0.0:1746143135.901557:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16950 initiator: MDT0 00010000:00010000:0.0:1746143135.901567:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e7d6600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143135.901572:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16950 initiator: MDT0 00010000:00010000:0.0:1746143135.901579:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16950 initiator: MDT0 00010000:00010000:0.0:1746143135.901592:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff88009be92800) 00010000:00010000:0.0:1746143135.901595:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143135.901598:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16950 initiator: MDT0 00010000:00010000:0.0:1746143135.901603:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6600/0x25aee876ca70da4e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16950 initiator: MDT0 00000100:00100000:2.0:1746143135.902517:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861287808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.902569:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.902607:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746143135.902613:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861287680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.902629:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.902689:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861287936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143135.902740:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861288064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.902874:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861288192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.903074:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861288320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.903091:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.903100:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861288832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.903112:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.903121:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861289344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.903134:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.903154:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861287808 00000100:00100000:2.0:1746143135.903160:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861287808 00000100:00100000:2.0:1746143135.903200:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861287680 00000100:00100000:2.0:1746143135.903202:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861287680 00000100:00100000:2.0:1746143135.903214:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861288320 00000100:00100000:2.0:1746143135.903215:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861288320 00000100:00100000:2.0:1746143135.903223:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861288832 00000100:00100000:2.0:1746143135.903225:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861288832 00000100:00100000:2.0:1746143135.903232:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861289344 00000100:00100000:2.0:1746143135.903234:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861289344 00000100:00100000:2.0:1746143135.903244:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12594 00000100:00100000:2.0:1746143135.903250:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3302:x1830962861287808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143135.903426:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143135.903429:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.903432:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.903434:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.903436:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1999 -> 1999 00000100:00100000:2.0:1746143135.903459:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3302:x1830962861287808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (890us total) trans 21474840067 rc 0/0 00000100:00100000:2.0:1746143135.903464:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12594 00000100:00100000:2.0:1746143135.903478:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12595 00000100:00100000:2.0:1746143135.903482:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3302:x1830962861287680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143135.903576:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143135.903579:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.903580:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.903582:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.903584:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746143135.903600:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3302:x1830962861287680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (970us total) trans 17179872805 rc 0/0 00000100:00100000:2.0:1746143135.903605:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12595 00000100:00100000:2.0:1746143135.903614:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12596 00000100:00100000:2.0:1746143135.903618:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3302:x1830962861288320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.903687:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3302:x1830962861288320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (595us total) trans 17179872806 rc 0/0 00000100:00100000:2.0:1746143135.903693:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12596 00000100:00100000:2.0:1746143135.903703:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12597 00000100:00100000:2.0:1746143135.903707:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3302:x1830962861288832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143135.903772:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3302:x1830962861288832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (660us total) trans 17179872807 rc 0/0 00000100:00100000:2.0:1746143135.903777:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12597 00000100:00100000:2.0:1746143135.903784:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12598 00000100:00100000:2.0:1746143135.903788:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3302:x1830962861289344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.903855:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3302:x1830962861289344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (720us total) trans 21474840068 rc 0/0 00000100:00100000:2.0:1746143135.903860:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12598 00000004:00080000:2.0:1746143135.903918:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314fb80/2, rc 0, transno 17179872806 00000100:00100000:2.0:1746143135.903922:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861288320:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143135.903928:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e680/2, rc 0, transno 17179872807 00000100:00100000:2.0:1746143135.903930:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861288832:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143135.903936:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130765880/2, rc 0, transno 21474840068 00000100:00100000:2.0:1746143135.903942:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861289344:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143135.903947:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b5b100/2, rc 0, transno 17179872805 00000100:00100000:2.0:1746143135.903949:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861287680:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143135.903954:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092a7a300/2, rc 0, transno 21474840067 00000100:00100000:2.0:1746143135.903956:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861287808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.903995:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746143135.903999:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861289728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.904016:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.904053:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861289728 00000100:00100000:2.0:1746143135.904056:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861289728 00000100:00100000:2.0:1746143135.904069:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12599 00000100:00100000:2.0:1746143135.904073:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3302:x1830962861289728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.904143:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3302:x1830962861289728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (126us total) trans 21474840069 rc 0/0 00000100:00100000:2.0:1746143135.904148:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12599 00000004:00080000:2.0:1746143135.904164:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dc000/2, rc 0, transno 21474840069 00000100:00100000:2.0:1746143135.904166:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861289728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.904279:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.904307:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861288576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.904324:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.904336:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861289088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.904347:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.904353:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861289600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.904365:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.904373:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143135.904377:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861288960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.904390:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.904396:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861289472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.904410:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.904423:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861288064 00000100:00100000:0.0:1746143135.904426:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861288064 00000100:00100000:0.0:1746143135.904439:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861288576 00000100:00100000:0.0:1746143135.904440:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861288576 00000100:00100000:0.0:1746143135.904447:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861289088 00000100:00100000:0.0:1746143135.904448:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861289088 00000100:00100000:0.0:1746143135.904456:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861289600 00000100:00100000:0.0:1746143135.904457:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861289600 00000100:00100000:0.0:1746143135.904464:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861288960 00000100:00100000:0.0:1746143135.904465:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861288960 00000100:00100000:0.0:1746143135.904470:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861289472 00000100:00100000:0.0:1746143135.904471:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861289472 00000100:00100000:0.0:1746143135.904477:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12600 00000100:00100000:0.0:1746143135.904481:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861288064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143135.904562:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143135.904564:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.904566:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.904568:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.904570:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746143135.904578:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12601 00000100:00100000:1.0:1746143135.904587:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3300:x1830962861288576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.904589:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861288064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (310us total) trans 21474840070 rc 0/0 00000100:00100000:0.0:1746143135.904594:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12600 00000100:00100000:0.0:1746143135.904604:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12602 00000100:00100000:0.0:1746143135.904607:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861289088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.904679:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861289088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (330us total) trans 21474840071 rc 0/0 00000100:00100000:0.0:1746143135.904683:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12602 00000100:00100000:0.0:1746143135.904693:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12603 00000100:00100000:1.0:1746143135.904699:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3300:x1830962861288576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (372us total) trans 17179872808 rc 0/0 00000100:00100000:0.0:1746143135.904700:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861289600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.904705:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12601 00000100:00100000:1.0:1746143135.904717:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12604 00000100:00100000:1.0:1746143135.904721:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861288960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143135.904773:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861289600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (406us total) trans 21474840072 rc 0/0 00000100:00100000:0.0:1746143135.904778:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12603 00000100:00100000:0.0:1746143135.904788:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12605 00000100:00100000:0.0:1746143135.904792:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861289472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143135.904802:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:1.0:1746143135.904805:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.904807:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.905017:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.905020:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:1.0:1746143135.905065:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861288960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 343us (673us total) trans 21474840073 rc 0/0 00000100:00100000:1.0:1746143135.905070:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12604 00002000:00010000:0.0:1746143135.905085:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143135.905088:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143135.905090:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143135.905091:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:1.0:1746143135.905092:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143135.905093:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143135.905113:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861289472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 321us (701us total) trans 21474840074 rc 0/0 00000100:00100000:0.0:1746143135.905119:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12605 00000100:00100000:1.0:1746143135.905122:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861288704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.905126:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861288192 00000100:00100000:0.0:1746143135.905129:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861288192 00000100:00100000:0.0:1746143135.905140:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12606 00000100:00100000:1.0:1746143135.905143:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.905144:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3301:x1830962861288192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.905152:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861289216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.905166:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.905203:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861288704 00000100:00100000:1.0:1746143135.905207:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861288704 00000100:00100000:1.0:1746143135.905222:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861289216 00000100:00100000:1.0:1746143135.905225:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861289216 00002000:00010000:0.0:1746143135.905226:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143135.905228:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.905230:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.905231:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00000100:00100000:1.0:1746143135.905233:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12607 00002000:00010000:0.0:1746143135.905233:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143135.905238:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861288704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.905255:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861288192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (162us total) trans 17179872809 rc 0/0 00000100:00100000:0.0:1746143135.905263:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12606 00000100:00100000:0.0:1746143135.905271:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12608 00000100:00100000:0.0:1746143135.905275:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861289216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.905329:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861288704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (184us total) trans 17179872810 rc 0/0 00000100:00100000:1.0:1746143135.905334:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12607 00000100:00100000:0.0:1746143135.905349:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3301:x1830962861289216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (181us total) trans 21474840075 rc 0/0 00000100:00100000:0.0:1746143135.905354:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12608 00000004:00080000:1.0:1746143135.905358:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e300/2, rc 0, transno 17179872809 00000100:00100000:1.0:1746143135.905363:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861288192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.905369:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314df80/2, rc 0, transno 17179872810 00000100:00100000:1.0:1746143135.905372:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861288704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.905379:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130767100/2, rc 0, transno 21474840075 00000100:00100000:1.0:1746143135.905382:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861289216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143135.905385:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130766300/2, rc 0, transno 21474840073 00000100:00100000:0.0:1746143135.905389:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861288960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.905396:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143135.905396:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130765180/2, rc 0, transno 21474840074 00000100:00100000:0.0:1746143135.905399:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861289472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143135.905404:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130767b80/2, rc 0, transno 21474840071 00000100:00100000:0.0:1746143135.905406:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861289088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143135.905411:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130764700/2, rc 0, transno 21474840072 00000100:00100000:0.0:1746143135.905414:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861289600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143135.905415:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861288448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143135.905420:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130764380/2, rc 0, transno 21474840070 00000100:00100000:0.0:1746143135.905422:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861288064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143135.905429:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314c380/2, rc 0, transno 17179872808 00000100:00100000:0.0:1746143135.905431:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861288576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.905434:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.906069:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861287936 00000100:00100000:0.0:1746143135.906073:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861287936 00000100:00100000:0.0:1746143135.906086:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861288448 00000100:00100000:0.0:1746143135.906088:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861288448 00000100:00100000:0.0:1746143135.906096:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12609 00000100:00100000:0.0:1746143135.906101:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3299:x1830962861287936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143135.906196:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143135.906199:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.906201:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.906202:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.906204:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143135.906229:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861287936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (832us total) trans 17179872811 rc 0/0 00000100:00100000:0.0:1746143135.906234:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12609 00000100:00100000:0.0:1746143135.906694:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12610 00000100:00100000:0.0:1746143135.906699:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3299:x1830962861288448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.906947:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861288448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 247us (1511us total) trans 17179872812 rc 0/0 00000100:00100000:0.0:1746143135.906952:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12610 00000004:00080000:1.0:1746143135.907054:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314f100/2, rc 0, transno 17179872811 00000100:00100000:1.0:1746143135.907058:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861287936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.907065:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314d180/2, rc 0, transno 17179872812 00000100:00100000:1.0:1746143135.907068:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861288448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.907318:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.907452:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858739456 00000100:00100000:2.0:1746143135.907456:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858739456 00000100:00100000:2.0:1746143135.907482:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8201 00000100:00100000:2.0:1746143135.907487:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:31057:x1830962858739456:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143135.907501:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.907517:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650776 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.907562:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.907574:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.907588:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143135.907591:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143135.907593:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b806e00, rc 0) 00000100:00100000:2.0:1746143135.907635:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31057:x1830962858739456:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 148us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.907640:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8201 00000100:00100000:2.0:1746143135.912362:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.912406:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858739712 00000100:00100000:0.0:1746143135.912415:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858739712 00000100:00100000:0.0:1746143135.912458:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3469 00000100:00100000:0.0:1746143135.912463:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31057:x1830962858739712:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:0.0:1746143135.912680:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31057:x1830962858739712:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 216us (326us total) trans 8589942414 rc 0/0 00000100:00100000:0.0:1746143135.912686:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3469 00000100:00100000:0.0:1746143135.927826:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.928100:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.928135:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858739968 00000100:00100000:1.0:1746143135.928143:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858739968 00000100:00100000:1.0:1746143135.928190:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858740224 00000100:00100000:1.0:1746143135.928193:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858740224 00000100:00100000:1.0:1746143135.928212:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8202 00000100:00100000:1.0:1746143135.928218:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:31068:x1830962858739968:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.928240:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.928257:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70da5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165077d expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.928272:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8203 00000100:00100000:2.0:1746143135.928281:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:31063:x1830962858740224:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143135.928291:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.928431:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928441:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928450:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928459:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928462:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928466:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928554:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928558:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928561:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:1.0:1746143135.928568:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143135.928585:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807600/0x25aee876ca70da7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650784 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.928647:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928655:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928660:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928663:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f390400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143135.928667:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928671:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928678:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143135.928680:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143135.928682:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928685:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390400/0x25aee876ca70da63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928706:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928709:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928713:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928715:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f391400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143135.928716:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928722:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928725:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800945b2c00) 00010000:00010000:1.0:1746143135.928727:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143135.928728:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928730:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391400/0x25aee876ca70da6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.928761:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70da5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.928768:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.928772:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143135.928773:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143135.928774:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f391200, rc 0) 00010000:00010000:2.0:1746143135.929189:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929198:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929205:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929216:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929222:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929227:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929282:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70da94 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929289:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70da94 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929294:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70da94 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143135.929300:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143135.929340:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929345:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929350:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929354:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b807400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143135.929356:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929361:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929367:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143135.929370:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143135.929372:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929376:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70da86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929390:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929394:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929399:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929402:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b807c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143135.929404:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929409:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929414:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099d54300) 00010000:00010000:2.0:1746143135.929428:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143135.929430:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929435:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70da8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.929465:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807600/0x25aee876ca70da7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650784 expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.929475:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70da94 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650784 expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.929481:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143135.929482:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143135.929484:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b807800, rc 0) 00000100:00100000:2.0:1746143135.929776:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31063:x1830962858740224:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1495us (1674us total) trans 8589942416 rc 0/0 00000100:00100000:1.0:1746143135.929777:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31068:x1830962858739968:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1557us (1962us total) trans 8589942415 rc 0/0 00000100:00100000:1.0:1746143135.929783:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8202 00000100:00100000:2.0:1746143135.929787:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8203 00000100:00100000:0.0:1746143135.935119:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.935350:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858740480 00000100:00100000:1.0:1746143135.935359:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858740480 00000100:00100000:1.0:1746143135.935418:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8204 00000100:00100000:1.0:1746143135.935442:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31069:x1830962858740480:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.935470:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.935490:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390c00/0x25aee876ca70daa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165078b expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.935586:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143135.935600:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143135.935611:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:1.0:1746143135.935621:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143135.935743:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390c00/0x25aee876ca70daa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 202 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.935776:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 201 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.935784:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143135.935787:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143135.935790:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f391c00, rc 0) 00000100:00100000:1.0:1746143135.936567:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31069:x1830962858740480:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1125us (1457us total) trans 8589942417 rc 0/0 00000100:00100000:1.0:1746143135.936575:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8204 00000100:00100000:0.0:1746143135.937487:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.937541:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.937618:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858740608 00000100:00100000:2.0:1746143135.937622:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858740608 00000100:00100000:2.0:1746143135.937660:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12611 00000100:00100000:2.0:1746143135.937667:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31068:x1830962858740608:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.937678:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.937692:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650792 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.937715:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.937717:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.937725:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 21 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.937737:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 21 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143135.937740:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858740864 00010000:00010000:2.0:1746143135.937745:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b806600, rc 0) 00000100:00100000:1.0:1746143135.937745:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858740864 00000100:00100000:1.0:1746143135.937766:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8205 00000100:00100000:2.0:1746143135.937772:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31068:x1830962858740608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.937772:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31063:x1830962858740864:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:2.0:1746143135.937778:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12611 00010000:00010000:1.0:1746143135.937782:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.937784:0:20619:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143135.937799:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70da94 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650784 expref: 201 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.937811:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143135.937814:0:20619:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143135.937822:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391000/0x25aee876ca70dabe lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650799 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.937849:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143135.937859:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.937865:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 201 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.937872:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.937878:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143135.937927:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.937939:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 7 pid: 17079 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.937949:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b803480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861289856:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143135.938016:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 201 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.938024:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 201 pid: 20619 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.938050:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861289984:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143135.938088:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.938096:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 7 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.938104:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861290112:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143135.938123:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143135.939285:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.939726:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858741120 00000100:00100000:2.0:1746143135.939731:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858741120 00000100:00100000:2.0:1746143135.939771:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8206 00000100:00100000:2.0:1746143135.939777:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31065:x1830962858741120:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143135.939795:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.939807:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806800/0x25aee876ca70dacc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507a0 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.939887:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.939898:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143135.939905:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143135.940995:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143135.941090:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.941119:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858741248 00000100:00100000:2.0:1746143135.941121:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b803480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861289856:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143135.941124:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858741248 00000100:00100000:1.0:1746143135.941155:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8207 00000100:00100000:1.0:1746143135.941161:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31069:x1830962858741248:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143135.941166:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858741376 00000100:00100000:3.0:1746143135.941170:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858741376 00010000:00010000:1.0:1746143135.941195:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.941200:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 10 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.941206:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7b800/0x25aee876ca70dada lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507a7 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143135.941221:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6691 00000100:00100000:3.0:1746143135.941226:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858741376:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143135.941235:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143135.941240:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 10 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143135.941249:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 10 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.941259:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.941265:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70da71 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165077d expref: 10 pid: 17079 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.941268:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143135.941276:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143135.941281:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.941568:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143135.941573:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000020 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.941581:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000020 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.941587:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 5/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000020 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143135.941597:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.941602:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000020 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143135.941607:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000020 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143135.941612:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143135.941626:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143135.941908:0:17079:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143135.941915:0:17079:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143135.941922:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:2.0:1746143135.942387:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861289984:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143135.942395:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14794 initiator: MDT0 00000100:00100000:2.0:1746143135.942399:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861290112:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143135.942402:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143135.942404:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000004:00200000:1.0:1746143135.942417:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:0.0:1746143135.942419:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143135.942424:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20619 initiator: MDT0 00000100:00100000:2.0:1746143135.942441:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858741632 00000100:00100000:2.0:1746143135.942444:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858741632 00000100:00100000:0.0:1746143135.942449:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143135.942459:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 8 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.942474:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858741504 00000100:00100000:2.0:1746143135.942476:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858741504 00010000:00010000:2.0:1746143135.942485:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 204 pid: 20619 timeout: 1017 lvb_type: 0 00000100:00100000:0.0:1746143135.942485:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6692 00000100:00100000:0.0:1746143135.942493:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858741632:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143135.942498:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6693 00010000:00010000:0.0:1746143135.942501:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143135.942502:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:1971:x1830962858741504:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143135.942505:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 8 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.942508:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.942511:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 204 pid: 20619 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.942512:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 8 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.942519:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 204 pid: 20619 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.942916:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70da55 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650776 expref: 8 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:0.0:1746143135.942935:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143135.942938:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143135.942944:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143135.942949:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143135.942953:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143135.942957:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143135.942989:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858741632:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 498us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143135.942995:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6692 00010000:00010000:1.0:1746143135.943246:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806800/0x25aee876ca70dacc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a0 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.943262:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a0 expref: 10 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.943270:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a0 expref: 10 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143135.943276:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b806a00, rc 0) 00000100:00100000:1.0:1746143135.943307:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31065:x1830962858741120:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3529us (4025us total) trans 8589942418 rc 0/0 00000100:00100000:1.0:1746143135.943313:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8206 00000100:00100000:1.0:1746143135.943329:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858741760 00000100:00100000:1.0:1746143135.943333:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858741760 00000100:00100000:3.0:1746143135.943355:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858741376:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2128us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.943359:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8208 00000100:00100000:3.0:1746143135.943363:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6691 00000100:00100000:1.0:1746143135.943365:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31068:x1830962858741760:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.943376:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.943385:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507ae expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.943414:0:1037:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.943421:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 10 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.943430:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143135.943432:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143135.943434:0:1037:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143135.943438:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7aa00, rc 0) 00000100:00100000:1.0:1746143135.943455:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31068:x1830962858741760:12345-192.168.201.28@tcp:101:cat.0 Request processed in 91us (1005us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143135.943456:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391c00/0x25aee876ca70daa9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165078b expref: 204 pid: 20619 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143135.943460:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8208 00010000:00010000:2.0:1746143135.943478:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143135.943481:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.943486:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143135.943492:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143135.943502:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143135.943507:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.943513:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.943518:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.943529:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.943544:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:1971:x1830962858741504:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1043us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.943550:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6693 00010000:00010000:2.0:1746143135.943567:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143135.943572:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20619 initiator: MDT0 00000040:00080000:2.0:1746143135.944188:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2415, 88 off205240 00000004:00080000:2.0:1746143135.944195:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784163486ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944239:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2429, 88 off206208 00000004:00080000:2.0:1746143135.944242:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917784210656ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.944269:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2430, 88 off206296 00000004:00080000:2.0:1746143135.944273:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917784241414ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.944280:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2416, 88 off205328 00000004:00080000:2.0:1746143135.944282:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784251002ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944289:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2417, 88 off205416 00000004:00080000:2.0:1746143135.944291:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784260036ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944298:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2431, 88 off206384 00000004:00080000:2.0:1746143135.944300:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917784268667ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.944306:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2432, 88 off206472 00000004:00080000:2.0:1746143135.944309:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917784277389ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.944315:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2433, 88 off206560 00000004:00080000:2.0:1746143135.944317:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917784285616ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.944324:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2418, 88 off205504 00000004:00080000:2.0:1746143135.944327:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784295956ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944334:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2434, 88 off206648 00000004:00080000:2.0:1746143135.944336:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917784304676ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.944343:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2419, 88 off205592 00000004:00080000:2.0:1746143135.944346:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784314492ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944353:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2435, 88 off206736 00000004:00080000:2.0:1746143135.944355:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917784324082ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143135.944361:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2420, 88 off205680 00000004:00080000:2.0:1746143135.944364:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784332282ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944371:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2421, 88 off205768 00000004:00080000:2.0:1746143135.944373:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784341803ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944379:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2422, 88 off205856 00000004:00080000:2.0:1746143135.944381:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784350196ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944388:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2423, 88 off205944 00000004:00080000:2.0:1746143135.944390:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 917784358359ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143135.944396:0:20619:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2436, 88 off206824 00000004:00080000:2.0:1746143135.944398:0:20619:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 917784366696ns, next at 860119223596ns, rc = 0 00000100:00100000:1.0:1746143135.957148:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143135.957202:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858741888 00000100:00100000:2.0:1746143135.957211:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858741888 00010000:00010000:2.0:1746143135.957250:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a0 expref: 10 pid: 14794 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143135.957588:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6694 00000100:00100000:2.0:1746143135.957597:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858741888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143135.957609:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143135.957614:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a0 expref: 10 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.957625:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a0 expref: 10 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.957645:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806a00/0x25aee876ca70dad3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a0 expref: 10 pid: 14794 timeout: 1017 lvb_type: 0 00010000:00010000:2.0:1746143135.957657:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143135.957661:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.957672:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.957678:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 9 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.957684:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.957689:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143135.957740:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858741888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 144us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.957747:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6694 00010000:00010000:2.0:1746143135.978023:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 204 pid: 20619 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746143135.978158:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942414 is committed 00000001:00080000:0.0:1746143135.978182:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942418 is committed 00000001:00080000:0.0:1746143135.978186:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942417 is committed 00000001:00080000:0.0:1746143135.978192:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942419 is committed 00000004:00080000:0.0:1746143135.978196:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1853 committed 00000004:00080000:0.0:1746143135.978202:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1845 committed 00000004:00080000:0.0:1746143135.978209:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1844 committed 00000004:00080000:0.0:1746143135.978210:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1843 committed 00000004:00080000:0.0:1746143135.978212:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1842 committed 00000004:00080000:0.0:1746143135.978213:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1852 committed 00000004:00080000:0.0:1746143135.978214:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1841 committed 00000004:00080000:0.0:1746143135.978216:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1851 committed 00000004:00080000:0.0:1746143135.978217:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1840 committed 00000004:00080000:0.0:1746143135.978218:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1850 committed 00000004:00080000:0.0:1746143135.978220:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1849 committed 00000004:00080000:0.0:1746143135.978221:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1848 committed 00000004:00080000:0.0:1746143135.978222:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1839 committed 00000004:00080000:0.0:1746143135.978224:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1838 committed 00000004:00080000:0.0:1746143135.978225:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1847 committed 00000004:00080000:0.0:1746143135.978226:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1846 committed 00000004:00080000:0.0:1746143135.978228:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1837 committed 00010000:00010000:2.0:1746143135.978286:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143135.978289:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143135.978292:0:20619:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.978301:0:20619:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.978306:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143135.978313:0:20619:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 6 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.978319:0:20619:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 6 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.978326:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 6 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.978362:0:20619:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 6 pid: 1037 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143135.978374:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861290240:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143135.978459:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143135.978549:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861290368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.978590:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.978613:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861290880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.978627:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.978642:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143135.978646:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861290752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.978658:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.978666:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861291264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.978676:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.978690:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861290496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.978702:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.978710:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861291008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.978720:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.978728:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143135.978731:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861290624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.978743:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.978751:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861291136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.978761:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143135.978779:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861290368 00000100:00100000:2.0:1746143135.978784:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861290368 00000100:00100000:2.0:1746143135.978809:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861290880 00000100:00100000:2.0:1746143135.978811:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861290880 00000100:00100000:2.0:1746143135.978819:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861290752 00000100:00100000:2.0:1746143135.978820:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861290752 00000100:00100000:2.0:1746143135.978827:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861291264 00000100:00100000:2.0:1746143135.978829:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861291264 00000100:00100000:2.0:1746143135.978836:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861290496 00000100:00100000:2.0:1746143135.978837:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861290496 00000100:00100000:2.0:1746143135.978842:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861291008 00000100:00100000:2.0:1746143135.978843:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861291008 00000100:00100000:2.0:1746143135.978848:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861290624 00000100:00100000:2.0:1746143135.978850:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861290624 00000100:00100000:2.0:1746143135.978854:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861291136 00000100:00100000:2.0:1746143135.978855:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861291136 00000100:00100000:2.0:1746143135.978863:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12612 00000100:00100000:2.0:1746143135.978867:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3302:x1830962861290368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143135.979277:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143135.979280:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979282:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979284:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979285:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1999 -> 1999 00000100:00100000:2.0:1746143135.979309:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3302:x1830962861290368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 441us (720us total) trans 21474840076 rc 0/0 00000100:00100000:2.0:1746143135.979315:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12612 00000100:00100000:2.0:1746143135.979328:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12613 00000100:00100000:2.0:1746143135.979332:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3302:x1830962861290880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.979405:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3302:x1830962861290880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (776us total) trans 21474840077 rc 0/0 00000100:00100000:2.0:1746143135.979409:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12613 00000100:00100000:2.0:1746143135.979417:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12614 00000100:00100000:2.0:1746143135.979421:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3302:x1830962861290752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.979476:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3302:x1830962861290752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (817us total) trans 21474840078 rc 0/0 00000100:00100000:2.0:1746143135.979481:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12614 00000100:00100000:2.0:1746143135.979488:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12615 00000100:00100000:2.0:1746143135.979491:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3302:x1830962861291264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.979548:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3302:x1830962861291264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (870us total) trans 21474840079 rc 0/0 00000100:00100000:2.0:1746143135.979552:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12615 00000100:00100000:2.0:1746143135.979559:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12616 00000100:00100000:2.0:1746143135.979562:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3299:x1830962861290496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143135.979623:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143135.979625:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979627:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979629:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979631:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746143135.979650:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3299:x1830962861290496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (947us total) trans 21474840080 rc 0/0 00000100:00100000:2.0:1746143135.979654:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12616 00000100:00100000:2.0:1746143135.979663:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12617 00000100:00100000:2.0:1746143135.979666:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3299:x1830962861291008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.979738:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3299:x1830962861291008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1016us total) trans 21474840081 rc 0/0 00000100:00100000:2.0:1746143135.979743:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12617 00000100:00100000:2.0:1746143135.979753:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12618 00000100:00100000:2.0:1746143135.979757:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3299:x1830962861290624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143135.979824:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:2.0:1746143135.979827:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979829:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979831:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143135.979832:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:2.0:1746143135.979849:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3299:x1830962861290624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1106us total) trans 21474840082 rc 0/0 00000100:00100000:2.0:1746143135.979854:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12618 00000100:00100000:2.0:1746143135.979862:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12619 00000100:00100000:2.0:1746143135.979866:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3299:x1830962861291136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143135.980114:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143135.980116:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143135.980118:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143135.980119:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143135.980121:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143135.980138:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3299:x1830962861291136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 271us (1375us total) trans 21474840083 rc 0/0 00000100:00100000:2.0:1746143135.980143:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12619 00000004:00080000:2.0:1746143135.980283:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dea00/2, rc 0, transno 21474840082 00000100:00100000:2.0:1746143135.980290:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861290624:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143135.980297:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cca680/2, rc 0, transno 21474840083 00000100:00100000:2.0:1746143135.980300:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861291136:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143135.980304:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919df480/2, rc 0, transno 21474840080 00000100:00100000:2.0:1746143135.980307:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861290496:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143135.980311:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ccbb80/2, rc 0, transno 21474840081 00000100:00100000:2.0:1746143135.980314:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861291008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.980343:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861291392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.980363:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143135.980379:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dc380/2, rc 0, transno 21474840078 00000100:00100000:2.0:1746143135.980382:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861290752:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143135.980387:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc8700/2, rc 0, transno 21474840079 00000100:00100000:2.0:1746143135.980390:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861291264:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143135.980395:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dd880/2, rc 0, transno 21474840076 00000100:00100000:2.0:1746143135.980398:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861290368:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143135.980402:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919dd180/2, rc 0, transno 21474840077 00000100:00100000:2.0:1746143135.980405:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861290880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.980416:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861291392 00000100:00100000:2.0:1746143135.980420:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861291392 00000100:00100000:2.0:1746143135.980434:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12620 00000100:00100000:2.0:1746143135.980439:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3302:x1830962861291392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143135.980518:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3302:x1830962861291392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (154us total) trans 21474840084 rc 0/0 00000100:00100000:2.0:1746143135.980524:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12620 00000004:00080000:2.0:1746143135.980542:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e80dc00/2, rc 0, transno 21474840084 00000100:00100000:2.0:1746143135.980545:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861291392:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143135.980747:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.980756:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:1.0:1746143135.980793:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143135.980798:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143135.980814:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143135.980845:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7b800/0x25aee876ca70dada lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 202 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.980863:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 201 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.980870:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143135.980873:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746143135.980876:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba7ae00, rc 0) 00000100:00100000:1.0:1746143135.980904:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31069:x1830962858741248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 39744us (39913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.980911:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8207 00000100:00100000:1.0:1746143135.980932:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861291776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.980955:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.980968:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861292288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.980980:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.980990:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143135.980994:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861291904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.981007:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.981016:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861292416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.981029:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143135.981064:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861291776 00000100:00100000:1.0:1746143135.981067:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861291776 00000100:00100000:1.0:1746143135.981083:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861292288 00000100:00100000:1.0:1746143135.981084:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861292288 00000100:00100000:1.0:1746143135.981092:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861291904 00000100:00100000:1.0:1746143135.981094:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861291904 00000100:00100000:1.0:1746143135.981100:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861292416 00000100:00100000:1.0:1746143135.981102:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861292416 00000100:00100000:1.0:1746143135.981111:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12621 00000100:00100000:1.0:1746143135.981115:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3301:x1830962861291776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143135.981238:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143135.981241:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.981244:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.981246:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143135.981247:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143135.981269:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3301:x1830962861291776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (314us total) trans 17179872813 rc 0/0 00000100:00100000:1.0:1746143135.981275:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12621 00000100:00100000:1.0:1746143135.981285:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12622 00000100:00100000:1.0:1746143135.981290:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3301:x1830962861292288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.981361:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3301:x1830962861292288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (380us total) trans 17179872814 rc 0/0 00000100:00100000:1.0:1746143135.981367:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12622 00000100:00100000:1.0:1746143135.981374:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12623 00000100:00100000:1.0:1746143135.981378:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3301:x1830962861291904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.981460:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3301:x1830962861291904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (452us total) trans 17179872815 rc 0/0 00000100:00100000:1.0:1746143135.981665:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12623 00000100:00100000:1.0:1746143135.981675:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12624 00000100:00100000:1.0:1746143135.981680:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3301:x1830962861292416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.981756:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3301:x1830962861292416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (726us total) trans 17179872816 rc 0/0 00000100:00100000:1.0:1746143135.981760:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12624 00000004:00080000:1.0:1746143135.981906:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b801f80/2, rc 0, transno 17179872815 00000100:00100000:1.0:1746143135.981910:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861291904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.981915:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b598e00/2, rc 0, transno 17179872816 00000100:00100000:1.0:1746143135.981918:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861292416:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.981923:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b800700/2, rc 0, transno 17179872813 00000100:00100000:1.0:1746143135.981925:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861291776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143135.981930:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b59ad80/2, rc 0, transno 17179872814 00000100:00100000:1.0:1746143135.981933:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b59ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861292288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.982315:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861291648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.982345:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.982363:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861292160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.982377:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.982388:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143135.982393:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861291520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.982408:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.982417:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861292032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.982430:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143135.982449:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861291648 00000100:00100000:0.0:1746143135.982452:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861291648 00000100:00100000:0.0:1746143135.982472:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861292160 00000100:00100000:0.0:1746143135.982474:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861292160 00000100:00100000:0.0:1746143135.982480:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861291520 00000100:00100000:0.0:1746143135.982482:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861291520 00000100:00100000:0.0:1746143135.982487:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861292032 00000100:00100000:0.0:1746143135.982488:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861292032 00000100:00100000:0.0:1746143135.982496:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12625 00000100:00100000:0.0:1746143135.982500:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830962861291648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143135.982592:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143135.982594:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.982596:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.982598:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.982600:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143135.982620:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3300:x1830962861291648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (276us total) trans 17179872817 rc 0/0 00000100:00100000:0.0:1746143135.982626:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12625 00000100:00100000:0.0:1746143135.982635:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12626 00000100:00100000:0.0:1746143135.982639:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830962861292160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.982712:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3300:x1830962861292160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (333us total) trans 17179872818 rc 0/0 00000100:00100000:0.0:1746143135.982717:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12626 00000100:00100000:0.0:1746143135.982726:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12627 00000100:00100000:0.0:1746143135.982730:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830962861291520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143135.982795:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143135.982798:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.982800:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.982801:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:0.0:1746143135.982803:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746143135.982821:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3300:x1830962861291520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (412us total) trans 17179872819 rc 0/0 00000100:00100000:0.0:1746143135.982826:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12627 00000100:00100000:0.0:1746143135.982835:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12628 00000100:00100000:0.0:1746143135.982840:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830962861292032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143135.982913:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3300:x1830962861292032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (481us total) trans 17179872820 rc 0/0 00000100:00100000:0.0:1746143135.982918:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12628 00000004:00080000:0.0:1746143135.982950:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b801500/2, rc 0, transno 17179872819 00000100:00100000:0.0:1746143135.982953:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861291520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143135.982959:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b802d80/2, rc 0, transno 17179872820 00000100:00100000:0.0:1746143135.982960:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861292032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143135.982965:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b802300/2, rc 0, transno 17179872817 00000100:00100000:0.0:1746143135.982967:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861291648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143135.982972:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b803480/2, rc 0, transno 17179872818 00000100:00100000:0.0:1746143135.982975:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861292160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143135.988360:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.988472:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.988502:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858742144 00000100:00100000:1.0:1746143135.988509:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858742144 00000100:00100000:1.0:1746143135.988546:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8209 00000100:00100000:1.0:1746143135.988553:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31069:x1830962858742144:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143135.988573:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143135.988590:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507b5 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.988648:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 202 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.988661:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 202 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143135.988678:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143135.988681:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143135.988684:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357400, rc 0) 00000100:00100000:1.0:1746143135.988725:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31069:x1830962858742144:12345-192.168.201.28@tcp:101:cat.0 Request processed in 172us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143135.988730:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8209 00000100:00100000:3.0:1746143135.988863:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861290240:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143135.988891:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391000/0x25aee876ca70dabe lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 201 pid: 20619 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143135.988906:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 200 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.988919:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f390200, rc 0) 00000100:00100000:3.0:1746143135.988942:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31063:x1830962858740864:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 51170us (51410us total) trans 8589942419 rc 0/0 00000100:00100000:3.0:1746143135.988949:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8205 00000100:00100000:2.0:1746143135.989905:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858742016 00000100:00100000:2.0:1746143135.989910:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858742016 00000100:00100000:2.0:1746143135.989947:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3470 00000100:00100000:2.0:1746143135.989952:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c04cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:31068:x1830962858742016:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:2.0:1746143135.990025:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c04cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:31068:x1830962858742016:12345-192.168.201.28@tcp:49:cat.0 Request processed in 73us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.990044:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3470 00000100:00100000:1.0:1746143135.995791:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.996722:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.998248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.998532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.998553:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858742272 00000100:00100000:3.0:1746143135.998563:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858742272 00000100:00100000:3.0:1746143135.998603:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858742400 00000100:00100000:3.0:1746143135.998605:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858742400 00000100:00100000:3.0:1746143135.998617:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858742528 00000100:00100000:3.0:1746143135.998618:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858742528 00000100:00100000:2.0:1746143135.998767:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12629 00000100:00100000:2.0:1746143135.998778:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858742272:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.998803:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.998821:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507bc expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.998847:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.998849:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.998859:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 24 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.998875:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 24 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.998885:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7d7200, rc 0) 00000100:00100000:2.0:1746143135.998935:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858742272:12345-192.168.201.28@tcp:101:cat.0 Request processed in 159us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.998942:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12629 00000100:00100000:2.0:1746143135.998961:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12630 00000100:00100000:2.0:1746143135.998966:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858742400:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.998973:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.998983:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507c3 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.998996:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.998997:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.999001:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 34 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.999010:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 34 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.999016:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7d7400, rc 0) 00000100:00100000:2.0:1746143135.999047:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1971:x1830962858742400:12345-192.168.201.28@tcp:101:cat.0 Request processed in 80us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143135.999052:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12630 00000100:00100000:2.0:1746143135.999063:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12631 00000100:00100000:2.0:1746143135.999067:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1971:x1830962858742528:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143135.999073:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143135.999079:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507ca expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143135.999090:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.999091:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143135.999095:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 34 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.999104:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 34 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143135.999112:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7d6800, rc 0) 00000100:00100000:1.0:1746143135.999389:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143135.999405:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858742656 00000100:00100000:3.0:1746143135.999409:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858742656 00000100:00100000:3.0:1746143135.999430:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12632 00000100:00100000:3.0:1746143135.999434:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858742656:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143135.999441:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143135.999448:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507d1 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143135.999459:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.999461:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143135.999465:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 25 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.999682:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 25 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143135.999691:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b807200, rc 0) 00000100:00100000:3.0:1746143135.999711:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858742656:12345-192.168.201.28@tcp:101:cat.0 Request processed in 276us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143135.999716:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12632 00000100:00100000:1.0:1746143135.999829:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.999897:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.999936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143135.999954:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858742784 00000100:00100000:1.0:1746143135.999957:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858742784 00000100:00100000:1.0:1746143135.999971:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858742912 00000100:00100000:1.0:1746143135.999973:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858742912 00000100:00100000:1.0:1746143135.999980:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858743040 00000100:00100000:1.0:1746143135.999981:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858743040 00000100:00100000:1.0:1746143135.999991:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12633 00000100:00100000:1.0:1746143135.999996:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858742784:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.000004:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.000010:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507d8 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.000021:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.000022:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.000026:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.000057:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.000065:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357c00, rc 0) 00000100:00100000:1.0:1746143136.000084:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858742784:12345-192.168.201.28@tcp:101:cat.0 Request processed in 87us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.000090:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12633 00000100:00100000:1.0:1746143136.000100:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12634 00000100:00100000:1.0:1746143136.000112:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1971:x1830962858742912:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.000117:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.000124:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507df expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.000134:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.000136:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.000140:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 36 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.000149:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 36 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.000156:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357200, rc 0) 00000100:00100000:1.0:1746143136.000169:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1971:x1830962858742912:12345-192.168.201.28@tcp:101:cat.0 Request processed in 65us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.000185:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12634 00000100:00100000:1.0:1746143136.000195:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12635 00000100:00100000:1.0:1746143136.000203:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:31063:x1830962858743040:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143136.000208:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.000213:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507e6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.000229:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.000236:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.000241:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.000242:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.000244:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2621440->2686975] (req 2621440->2686975) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.000269:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.000280:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 27 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:1.0:1746143136.000292:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861292544:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.000341:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.000575:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 10 pid: 4758 timeout: 1017 lvb_type: 1 00000100:00100000:1.0:1746143136.000583:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861292672:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.000602:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.001125:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858743296 00000100:00100000:3.0:1746143136.001129:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858743296 00002000:00100000:3.0:1746143136.001155:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092aeea00 x1830962858743296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/0 e 0 to 0 dl 1746143146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.001170:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aeea00 with x1830962858743296 ext(0->1048575) 00002000:00010000:3.0:1746143136.001205:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aeea00 00000100:00100000:3.0:1746143136.001220:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6138 00000100:00100000:3.0:1746143136.001226:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858743296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.003021:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1971:x1830962858742528:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3943us (4766us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.003043:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12631 00000100:00080000:0.0:1746143136.003625:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143136.003630:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143136.004729:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.004766:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.004796:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858743424 00000100:00100000:0.0:1746143136.004802:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858743424 00010000:00010000:0.0:1746143136.004831:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 11 pid: 4758 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143136.004851:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858743552 00000100:00100000:0.0:1746143136.004852:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858743552 00010000:00010000:0.0:1746143136.004860:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 28 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143136.004872:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6695 00000100:00100000:0.0:1746143136.004877:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858743424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.004888:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.004909:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 11 pid: 4758 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143136.004919:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 11 pid: 4758 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143136.004941:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.004964:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858743424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.004969:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6695 00000100:00100000:0.0:1746143136.004979:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6696 00000100:00100000:0.0:1746143136.004983:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858743552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.004990:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.004995:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 28 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143136.005003:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 28 pid: 8449 timeout: 1017 lvb_type: 1 00010000:00010000:0.0:1746143136.005013:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.005015:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.005022:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.005046:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.005073:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.005083:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092996680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861292800:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143136.005121:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746143136.005316:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a357c00/0x25aee876ca70db19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d8 expref: 28 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:1.0:1746143136.005331:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861292544:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.005341:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e935a00/0x25aee876ca70d9f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650768 expref: 10 pid: 4758 timeout: 1017 lvb_type: 1 00000100:00100000:1.0:1746143136.005349:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861292672:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.005371:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.005380:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357600, rc 0) 00000100:00100000:1.0:1746143136.005400:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:31063:x1830962858743040:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5200us (5503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.005410:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12635 00000100:00100000:1.0:1746143136.006746:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092996680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861292800:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143136.006760:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143136.006782:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858743552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1797us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.006790:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6696 00000100:00100000:0.0:1746143136.009935:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.009984:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858743808 00000100:00100000:2.0:1746143136.009992:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858743808 00002000:00100000:2.0:1746143136.010054:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2621440->2625535) req@ffff880092997100 x1830962858743808/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.010066:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092997100 with x1830962858743808 ext(2621440->2625535) 00002000:00010000:2.0:1746143136.010071:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092997100 00000100:00100000:2.0:1746143136.010094:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6139 00000100:00100000:2.0:1746143136.010102:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858743808:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.010297:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858743808:12345-192.168.201.28@tcp:3:cat.0 Request processed in 194us (370us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143136.010303:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6139 00002000:00100000:2.0:1746143136.010309:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2621440->2625535) req@ffff880092997100 x1830962858743808/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.010316:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092997100 with x1830962858743808 ext(2621440->2625535) 00002000:00010000:2.0:1746143136.010319:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092997100 00000100:00100000:3.0:1746143136.019580:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858743296:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18117us (19407us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.019594:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6138 00002000:00100000:3.0:1746143136.019605:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092aeea00 x1830962858743296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:286/0 lens 488/440 e 0 to 0 dl 1746143146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.019612:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aeea00 with x1830962858743296 ext(0->1048575) 00002000:00010000:3.0:1746143136.019617:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aeea00 00000100:00100000:0.0:1746143136.026293:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.026328:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.026350:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.026364:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.026388:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858744320 00000100:00100000:2.0:1746143136.026388:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858744064 00000100:00100000:0.0:1746143136.026391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.026400:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858744320 00000100:00100000:2.0:1746143136.026400:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858744064 00002000:00100000:3.0:1746143136.026448:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092995180 x1830962858744320/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.026448:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2682880->2686975) req@ffff880092995c00 x1830962858744064/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.026457:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092995180 with x1830962858744320 ext(0->1048575) 00002000:00100000:2.0:1746143136.026458:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092995c00 with x1830962858744064 ext(2682880->2686975) 00002000:00010000:3.0:1746143136.026463:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092995180 00002000:00010000:2.0:1746143136.026463:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092995c00 00000100:00100000:0.0:1746143136.027861:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.027884:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858745216 00000100:00100000:1.0:1746143136.027906:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858744576 00000100:00100000:3.0:1746143136.027907:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858744832 00000100:00100000:2.0:1746143136.027907:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858745088 00000100:00100000:3.0:1746143136.027912:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858744832 00000100:00100000:2.0:1746143136.027912:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858745088 00000100:00100000:1.0:1746143136.027913:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858744576 00002000:00100000:2.0:1746143136.027930:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880092996680 x1830962858745088/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.027931:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880092994380 x1830962858744832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.027939:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092996680 with x1830962858745088 ext(1048576->2097151) 00002000:00100000:3.0:1746143136.027940:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092994380 with x1830962858744832 ext(1048576->2097151) 00002000:00010000:2.0:1746143136.027942:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092996680 00002000:00010000:3.0:1746143136.027944:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092994380 00002000:00100000:1.0:1746143136.027949:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880092994e00 x1830962858744576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143136.027958:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6140 00002000:00100000:1.0:1746143136.027959:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092994e00 with x1830962858744576 ext(1048576->2097151) 00000100:00100000:3.0:1746143136.027963:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6141 00002000:00010000:1.0:1746143136.027963:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092994e00 00000100:00100000:2.0:1746143136.027966:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858744320:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143136.027970:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858744064:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143136.027986:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6142 00000100:00100000:3.0:1746143136.027992:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6143 00000100:00100000:1.0:1746143136.027994:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858745088:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143136.027997:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1971:x1830962858744832:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.029225:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858745216 00000100:00100000:0.0:1746143136.029252:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12636 00000100:00100000:0.0:1746143136.029256:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31065:x1830962858745216:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143136.029264:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.029277:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507ed expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.029294:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 10 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.029300:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 37 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.029304:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.029305:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.029308:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2269184->2908159] (req 2269184->2908159) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 20 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.029330:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 37 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.029338:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 37 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143136.029346:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092996d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861292928:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.029384:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6144 00010000:00010000:0.0:1746143136.029388:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 10 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.029626:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 10 pid: 21048 timeout: 1017 lvb_type: 1 00000100:00100000:1.0:1746143136.029628:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858744576:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.029632:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861293056:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.029646:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.030152:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858744064:12345-192.168.201.28@tcp:3:cat.0 Request processed in 2178us (3863us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143136.030161:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6141 00002000:00100000:3.0:1746143136.030167:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2682880->2686975) req@ffff880092995c00 x1830962858744064/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.030186:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092995c00 with x1830962858744064 ext(2682880->2686975) 00002000:00010000:3.0:1746143136.030191:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092995c00 00000100:00100000:0.0:1746143136.038396:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.038437:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.038664:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858745344 00000100:00100000:1.0:1746143136.038673:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858745344 00000100:00100000:2.0:1746143136.038685:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092996d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861292928:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.038685:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.038705:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861293056:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.038706:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858745600 00010000:00010000:1.0:1746143136.038707:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 39 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:0.0:1746143136.038716:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858745600 00010000:00010000:2.0:1746143136.038739:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2269184->2908159] (req 2269184->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 21 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.038742:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858745472 00000100:00100000:1.0:1746143136.038744:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858745472 00010000:00010000:1.0:1746143136.038754:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 11 pid: 21048 timeout: 1017 lvb_type: 1 00010000:00010000:2.0:1746143136.038757:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12e200, rc 0) 00000100:00100000:1.0:1746143136.038774:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6697 00000100:00100000:1.0:1746143136.038781:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1968:x1830962858745344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143136.038792:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143136.038809:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 39 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143136.038826:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31065:x1830962858745216:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9567us (10965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.038834:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12636 00010000:00010000:1.0:1746143136.038844:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 39 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143136.038860:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12637 00010000:00010000:1.0:1746143136.038865:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70db20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507df expref: 39 pid: 8449 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143136.038868:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31068:x1830962858745600:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.038885:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143136.038887:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.038902:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507f4 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.038916:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1968:x1830962858745344:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (529us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143136.038919:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.038921:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143136.038922:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6697 00010000:00010000:2.0:1746143136.038928:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 21 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.038935:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6698 00000100:00100000:1.0:1746143136.038939:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858745472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.038940:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 21 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.038945:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.038946:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fb3600, rc 0) 00010000:00010000:1.0:1746143136.038952:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 11 pid: 21048 timeout: 1017 lvb_type: 1 00010000:00010000:1.0:1746143136.038960:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 11 pid: 21048 timeout: 1017 lvb_type: 1 00000100:00100000:2.0:1746143136.038962:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31068:x1830962858745600:12345-192.168.201.28@tcp:101:cat.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.038967:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12637 00010000:00010000:1.0:1746143136.038975:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7000/0x25aee876ca70da08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165076f expref: 11 pid: 21048 timeout: 1017 lvb_type: 1 00010000:00010000:1.0:1746143136.038982:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.038984:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.038990:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 20 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.038997:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 20 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.039020:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 20 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.039054:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861293184:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143136.039094:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.044022:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858745088:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16020us (17620us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143136.044065:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6142 00002000:00100000:1.0:1746143136.044076:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880092996680 x1830962858745088/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.044085:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092996680 with x1830962858745088 ext(1048576->2097151) 00002000:00010000:1.0:1746143136.044090:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092996680 00000100:00100000:3.0:1746143136.049688:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1971:x1830962858744832:12345-192.168.201.28@tcp:3:cat.0 Request processed in 21681us (23313us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.049699:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6143 00002000:00100000:3.0:1746143136.049710:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880092994380 x1830962858744832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.049719:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092994380 with x1830962858744832 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.049724:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092994380 00000100:00100000:1.0:1746143136.053300:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861293184:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143136.053316:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.053389:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.053507:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858745856 00000100:00100000:3.0:1746143136.053516:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858745856 00002000:00100000:3.0:1746143136.053558:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2269184->2273279) req@ffff880093b5aa00 x1830962858745856/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.053569:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5aa00 with x1830962858745856 ext(2269184->2273279) 00002000:00010000:3.0:1746143136.053575:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5aa00 00000100:00100000:3.0:1746143136.053600:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6145 00000100:00100000:3.0:1746143136.053607:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858745856:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143136.054013:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858745472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 15071us (15574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.054023:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6698 00000100:00100000:3.0:1746143136.054433:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858745856:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 824us (1049us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143136.054441:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6145 00002000:00100000:3.0:1746143136.054448:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2269184->2273279) req@ffff880093b5aa00 x1830962858745856/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.054455:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5aa00 with x1830962858745856 ext(2269184->2273279) 00002000:00010000:3.0:1746143136.054459:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5aa00 00000100:00100000:0.0:1746143136.057201:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.057809:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858746112 00000100:00100000:3.0:1746143136.057818:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858746112 00000100:00100000:3.0:1746143136.058075:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3471 00000100:00100000:3.0:1746143136.058083:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31063:x1830962858746112:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143136.058303:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858744320:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30331us (31968us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.058313:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6140 00002000:00100000:2.0:1746143136.058323:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092995180 x1830962858744320/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.058331:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092995180 with x1830962858744320 ext(0->1048575) 00002000:00010000:2.0:1746143136.058336:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092995180 00000100:00100000:3.0:1746143136.058341:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31063:x1830962858746112:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 259us (1148us total) trans 8589942420 rc 0/0 00000100:00100000:1.0:1746143136.058744:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.058758:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858746368 00000100:00100000:2.0:1746143136.058763:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858746368 00002000:00100000:2.0:1746143136.058789:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880135181880 x1830962858746368/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.058803:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135181880 with x1830962858746368 ext(1048576->2097151) 00002000:00010000:2.0:1746143136.058806:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135181880 00000100:00100000:2.0:1746143136.058821:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6146 00000100:00100000:2.0:1746143136.058827:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858746368:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143136.059241:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1970:x1830962858744576:12345-192.168.201.28@tcp:3:cat.0 Request processed in 29848us (32889us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143136.059249:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6144 00002000:00100000:0.0:1746143136.059257:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880092994e00 x1830962858744576/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143136.059266:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092994e00 with x1830962858744576 ext(1048576->2097151) 00002000:00010000:0.0:1746143136.060278:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092994e00 00000100:00100000:3.0:1746143136.060345:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3471 00000100:00100000:2.0:1746143136.070109:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858746368:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 11271us (11354us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.070121:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6146 00002000:00100000:2.0:1746143136.070134:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880135181880 x1830962858746368/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.070143:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135181880 with x1830962858746368 ext(1048576->2097151) 00002000:00010000:2.0:1746143136.070149:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135181880 00000100:00100000:1.0:1746143136.071236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.071260:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858746624 00000100:00100000:2.0:1746143136.071269:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858746624 00002000:00100000:2.0:1746143136.071307:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2904064->2908159) req@ffff880135182d80 x1830962858746624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.071315:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135182d80 with x1830962858746624 ext(2904064->2908159) 00002000:00010000:2.0:1746143136.071319:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135182d80 00000100:00100000:2.0:1746143136.071342:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6147 00000100:00100000:2.0:1746143136.071348:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858746624:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143136.071512:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858746624:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 163us (284us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143136.071518:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6147 00002000:00100000:2.0:1746143136.071524:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2904064->2908159) req@ffff880135182d80 x1830962858746624/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.071531:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135182d80 with x1830962858746624 ext(2904064->2908159) 00002000:00010000:2.0:1746143136.071533:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135182d80 00000100:00100000:0.0:1746143136.077701:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.078006:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.078080:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858747008 00000100:00100000:1.0:1746143136.078091:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858747008 00002000:00100000:1.0:1746143136.078134:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880092a7a680 x1830962858747008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 504/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.078144:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a7a680 with x1830962858747008 ext(2097152->3145727) 00002000:00010000:1.0:1746143136.078149:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a7a680 00000100:00100000:2.0:1746143136.078159:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858746752 00000100:00100000:2.0:1746143136.078166:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858746752 00000100:00100000:1.0:1746143136.078190:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6148 00000100:00100000:1.0:1746143136.078196:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858747008:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.078212:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12638 00000100:00100000:2.0:1746143136.078218:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31068:x1830962858746752:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143136.078234:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.078252:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16507fb expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.078278:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.078280:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.078289:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.078306:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.078317:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f390000, rc 0) 00000100:00100000:2.0:1746143136.078375:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:31068:x1830962858746752:12345-192.168.201.28@tcp:101:cat.0 Request processed in 156us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.078381:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12638 00000100:00100000:0.0:1746143136.080817:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.080879:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858747264 00000100:00100000:3.0:1746143136.080885:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858747264 00000100:00100000:3.0:1746143136.080921:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3472 00000100:00100000:3.0:1746143136.080929:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:31065:x1830962858747264:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143136.081165:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31065:x1830962858747264:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 235us (355us total) trans 8589942421 rc 0/0 00000100:00100000:3.0:1746143136.081182:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3472 00000100:00100000:0.0:1746143136.096103:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858747008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17897us (18086us total) trans 0 rc 983040/983040 00000100:00100000:0.0:1746143136.096116:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6148 00002000:00100000:0.0:1746143136.096129:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880092a7a680 x1830962858747008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 504/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143136.096138:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a7a680 with x1830962858747008 ext(2097152->3145727) 00002000:00010000:0.0:1746143136.096143:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a7a680 00000100:00100000:1.0:1746143136.097397:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.097979:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858747520 00000100:00100000:0.0:1746143136.097987:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858747520 00002000:00100000:0.0:1746143136.098202:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880135180a80 x1830962858747520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143136.098211:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180a80 with x1830962858747520 ext(1048576->2097151) 00002000:00010000:0.0:1746143136.098216:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135180a80 00000100:00100000:3.0:1746143136.098347:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6149 00000100:00100000:3.0:1746143136.098364:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858747520:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143136.105586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.105730:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858747648 00000100:00100000:2.0:1746143136.105742:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858747648 00000100:00100000:2.0:1746143136.105804:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12639 00000100:00100000:2.0:1746143136.105812:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:31069:x1830962858747648:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143136.105828:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.105842:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650802 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.105867:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.105874:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143136.105876:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143136.105879:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 35 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.105909:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.105920:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 23 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:2.0:1746143136.105932:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861293312:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.107916:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.108717:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858747520:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 10352us (11316us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.108730:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6149 00002000:00100000:3.0:1746143136.108743:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880135180a80 x1830962858747520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.108753:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180a80 with x1830962858747520 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.108759:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135180a80 00000100:00100000:3.0:1746143136.109527:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861293312:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143136.109570:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 35 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.109586:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f391000, rc 0) 00000100:00100000:3.0:1746143136.109873:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:31069:x1830962858747648:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4059us (4295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.109881:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12639 00000100:00100000:0.0:1746143136.110213:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.110345:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858747776 00000100:00100000:3.0:1746143136.110350:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858747776 00002000:00100000:3.0:1746143136.110380:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2269184->2908159) req@ffff880092a78000 x1830962858747776/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.110388:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78000 with x1830962858747776 ext(2269184->2908159) 00010000:00010000:3.0:1746143136.110395:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 22 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143136.110410:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 22 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143136.110416:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a78000 00000100:00100000:3.0:1746143136.110438:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2014 00000100:00100000:3.0:1746143136.110443:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858747776:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143136.117070:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.117136:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858747904 00000100:00100000:3.0:1746143136.117146:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858747904 00000100:00100000:3.0:1746143136.117211:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12640 00000100:00100000:3.0:1746143136.117219:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31068:x1830962858747904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143136.117236:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.117251:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650809 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.117274:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.117276:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.117477:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.117490:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.117499:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b806e00, rc 0) 00000100:00100000:3.0:1746143136.117549:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:31068:x1830962858747904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 331us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.117558:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12640 00000100:00100000:3.0:1746143136.122234:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858747776:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 11780us (12011us total) trans 17179872821 rc 0/0 00000100:00100000:3.0:1746143136.122246:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2014 00002000:00100000:3.0:1746143136.122257:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2269184->2908159) req@ffff880092a78000 x1830962858747776/t17179872821(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/448 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.122267:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78000 with x1830962858747776 ext(2269184->2908159) 00010000:00010000:3.0:1746143136.122276:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:3.0:1746143136.122291:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00002000:00010000:3.0:1746143136.122297:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a78000 00000100:00100000:0.0:1746143136.126588:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.127156:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858748032 00000100:00100000:1.0:1746143136.127165:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858748032 00010000:00010000:1.0:1746143136.127210:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00000100:00100000:1.0:1746143136.127245:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6699 00000100:00100000:1.0:1746143136.127253:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858748032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143136.127266:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143136.127286:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143136.127303:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143136.127322:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12e200/0x25aee876ca70db2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2908159) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ed expref: 24 pid: 8448 timeout: 1017 lvb_type: 0 00010000:00010000:1.0:1746143136.127346:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.127348:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.127354:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 34 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.127361:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 34 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.127394:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 34 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.127405:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861293440:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143136.127485:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.127554:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.127579:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858748288 00000100:00100000:3.0:1746143136.127584:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858748288 00002000:00100000:3.0:1746143136.127611:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880092a79880 x1830962858748288/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.127619:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79880 with x1830962858748288 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.127623:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a79880 00000100:00100000:3.0:1746143136.127729:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6150 00000100:00100000:3.0:1746143136.127736:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858748288:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143136.130673:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861293440:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.130694:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.130742:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858748032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3487us (4160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.130751:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6699 00000100:00100000:3.0:1746143136.138302:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858748288:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 10558us (10739us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.138317:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6150 00002000:00100000:3.0:1746143136.138328:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880092a79880 x1830962858748288/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.138337:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79880 with x1830962858748288 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.138341:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a79880 00000100:00100000:0.0:1746143136.139182:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.139213:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.139245:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.139305:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858748672 00000100:00100000:3.0:1746143136.139313:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858748672 00002000:00100000:3.0:1746143136.139345:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880092a79c00 x1830962858748672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.139352:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79c00 with x1830962858748672 ext(3145728->4194303) 00002000:00010000:3.0:1746143136.139356:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a79c00 00000100:00100000:3.0:1746143136.139369:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858748800 00000100:00100000:3.0:1746143136.139372:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858748800 00002000:00100000:3.0:1746143136.139383:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092a78a80 x1830962858748800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.139390:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78a80 with x1830962858748800 ext(2097152->3145727) 00002000:00010000:3.0:1746143136.139393:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a78a80 00000100:00100000:3.0:1746143136.139417:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858748928 00000100:00100000:3.0:1746143136.139419:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858748928 00002000:00100000:3.0:1746143136.139429:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a79f80 x1830962858748928/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.139436:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79f80 with x1830962858748928 ext(3145728->4194303) 00002000:00010000:3.0:1746143136.139439:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a79f80 00000100:00100000:2.0:1746143136.139457:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6151 00000100:00100000:2.0:1746143136.139468:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858748672:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143136.139777:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6152 00000100:00100000:3.0:1746143136.139785:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1968:x1830962858748800:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.141157:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6153 00000100:00100000:2.0:1746143136.141163:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858748928:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.152705:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858748672:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13229us (13525us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.152715:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6151 00002000:00100000:2.0:1746143136.152725:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880092a79c00 x1830962858748672/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.152733:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79c00 with x1830962858748672 ext(3145728->4194303) 00002000:00010000:2.0:1746143136.152738:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a79c00 00000100:00100000:0.0:1746143136.156727:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.156774:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.157132:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858749312 00000100:00100000:2.0:1746143136.157141:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858749312 00000100:00100000:2.0:1746143136.157188:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858749184 00000100:00100000:2.0:1746143136.157190:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858749184 00000100:00100000:2.0:1746143136.157220:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12641 00000100:00100000:2.0:1746143136.157227:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858749312:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143136.157242:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.157256:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650817 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.157276:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.157278:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.157285:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 24 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.157299:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 24 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.157309:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357800, rc 0) 00000100:00100000:1.0:1746143136.157314:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12642 00000100:00100000:1.0:1746143136.157321:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858749184:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.157328:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.157336:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650810 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.157346:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858749312:12345-192.168.201.28@tcp:101:cat.0 Request processed in 120us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.157351:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12641 00000100:00100000:1.0:1746143136.157376:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861293568:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143136.157425:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.158086:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858748800:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18295us (18865us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.158094:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6152 00002000:00100000:3.0:1746143136.158102:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880092a78a80 x1830962858748800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.158110:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a78a80 with x1830962858748800 ext(2097152->3145727) 00002000:00010000:3.0:1746143136.158114:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a78a80 00002000:00010000:1.0:1746143136.164300:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143134 -> 1746143135 00000100:00100000:1.0:1746143136.164323:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861293568:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143136.164349:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db58 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650810 expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.164363:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650810 expref: 23 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.164389:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aeb2800, rc 0) 00000100:00100000:1.0:1746143136.164430:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858749184:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7108us (7654us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143136.164437:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12642 00000100:00100000:2.0:1746143136.165532:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1968:x1830962858748928:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24367us (26285us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.165541:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6153 00002000:00100000:2.0:1746143136.165549:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a79f80 x1830962858748928/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.165557:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79f80 with x1830962858748928 ext(3145728->4194303) 00002000:00010000:2.0:1746143136.165562:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a79f80 00000100:00100000:0.0:1746143136.172509:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.172605:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.172690:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858749440 00000100:00100000:1.0:1746143136.172698:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858749440 00000100:00100000:1.0:1746143136.172747:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12643 00000100:00100000:1.0:1746143136.172755:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:31068:x1830962858749440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.172770:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.172784:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165081e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.172810:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.172823:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143136.172825:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143136.172828:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.172867:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.172879:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.172891:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861293696:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.172964:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143136.173083:0:14791:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858749568 00000100:00100000:2.0:1746143136.173087:0:14791:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858749568 00000100:00100000:2.0:1746143136.173111:0:14791:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 232 00000100:00100000:2.0:1746143136.173116:0:14791:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1970:x1830962858749568:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:2.0:1746143136.173156:0:14791:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1970:x1830962858749568:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 40us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.173161:0:14791:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 232 00000100:00100000:1.0:1746143136.176016:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861293696:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.176070:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.176085:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aeb2400, rc 0) 00000100:00100000:1.0:1746143136.176126:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31068:x1830962858749440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3370us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.176133:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12643 00000100:00100000:0.0:1746143136.178682:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.179242:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.179272:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858749696 00000100:00100000:1.0:1746143136.179273:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858749824 00000100:00100000:2.0:1746143136.179279:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858749696 00000100:00100000:1.0:1746143136.179279:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858749824 00002000:00100000:2.0:1746143136.179319:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2621440->2686975) req@ffff88009314dc00 x1830962858749696/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.179329:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314dc00 with x1830962858749696 ext(2621440->2686975) 00010000:00010000:2.0:1746143136.179337:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.179349:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:2.0:1746143136.179356:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314dc00 00000100:00100000:1.0:1746143136.179365:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12644 00000100:00100000:1.0:1746143136.179371:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858749824:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:2.0:1746143136.179376:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2015 00010000:00010000:1.0:1746143136.179380:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143136.179382:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858749696:12345-192.168.201.28@tcp:4:cat.0 00010000:00010000:1.0:1746143136.179595:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2600/0x25aee876ca70db66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650825 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.179632:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861293824:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143136.179877:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.183503:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861293824:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143136.183533:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2600/0x25aee876ca70db66 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650825 expref: 29 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.183547:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2600/0x25aee876ca70db66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650825 expref: 29 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.183562:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aeb2600, rc 0) 00000100:00100000:1.0:1746143136.183596:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858749824:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4224us (4353us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143136.183604:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12644 00000100:00100000:3.0:1746143136.185763:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858749696:12345-192.168.201.28@tcp:4:cat.0 Request processed in 6375us (7079us total) trans 21474840085 rc 0/0 00000100:00100000:3.0:1746143136.185773:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2015 00002000:00100000:3.0:1746143136.185782:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2621440->2686975) req@ffff88009314dc00 x1830962858749696/t21474840085(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/448 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.185790:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314dc00 with x1830962858749696 ext(2621440->2686975) 00010000:00010000:3.0:1746143136.185798:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.185804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143136.185811:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:3.0:1746143136.185817:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009314dc00 00000100:00100000:1.0:1746143136.185973:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858749952 00000100:00100000:1.0:1746143136.185979:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858749952 00000100:00100000:1.0:1746143136.186007:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12645 00000100:00100000:1.0:1746143136.186132:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:31069:x1830962858749952:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.186145:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.186158:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165082c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.186188:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143136.186192:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143136.186196:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.186205:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.186219:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aeb2800, rc 0) 00000100:00100000:1.0:1746143136.186254:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:31069:x1830962858749952:12345-192.168.201.28@tcp:101:cat.0 Request processed in 240us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.186259:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12645 00000100:00100000:0.0:1746143136.191429:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.191494:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858750080 00000100:00100000:2.0:1746143136.191501:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858750080 00010000:00010000:2.0:1746143136.191583:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 29 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.191616:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6700 00000100:00100000:2.0:1746143136.191622:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858750080:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.191633:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.191648:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 29 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.191657:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 29 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.191675:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a357600/0x25aee876ca70db27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2686975) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507e6 expref: 29 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.191701:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.191702:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.191707:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.191712:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.191717:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.191717:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.191719:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.191723:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.191744:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.191753:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861293952:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.191824:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.191831:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861294080:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143136.191848:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143136.193540:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861293952:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143136.193551:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861294080:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.193567:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.194219:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858750080:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1973us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.194229:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6700 00000100:00100000:0.0:1746143136.207275:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.207321:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.207372:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.207461:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858750336 00000100:00100000:3.0:1746143136.207470:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858750336 00002000:00100000:3.0:1746143136.207512:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880130764a80 x1830962858750336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.207527:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764a80 with x1830962858750336 ext(2097152->3145727) 00002000:00010000:3.0:1746143136.207532:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130764a80 00000100:00100000:3.0:1746143136.207547:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858750592 00000100:00100000:3.0:1746143136.207549:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858750592 00002000:00100000:3.0:1746143136.207559:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880091981c00 x1830962858750592/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.207565:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091981c00 with x1830962858750592 ext(4194304->5210111) 00002000:00010000:3.0:1746143136.207567:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091981c00 00000100:00100000:3.0:1746143136.207589:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858750848 00000100:00100000:3.0:1746143136.207592:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858750848 00002000:00100000:3.0:1746143136.207602:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880091981f80 x1830962858750848/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.207608:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091981f80 with x1830962858750848 ext(3145728->4194303) 00002000:00010000:3.0:1746143136.207611:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091981f80 00000100:00100000:3.0:1746143136.207628:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6154 00000100:00100000:3.0:1746143136.207634:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858750336:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143136.209156:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6155 00000100:00100000:1.0:1746143136.209179:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858750592:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.209390:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6156 00000100:00100000:2.0:1746143136.209398:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858750848:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.211635:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.211672:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.211716:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858751104 00000100:00100000:2.0:1746143136.211724:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858751104 00002000:00100000:2.0:1746143136.211753:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880091982680 x1830962858751104/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.211760:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982680 with x1830962858751104 ext(2097152->3145727) 00002000:00010000:2.0:1746143136.211764:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091982680 00000100:00100000:2.0:1746143136.211982:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858751360 00000100:00100000:2.0:1746143136.211984:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858751360 00002000:00100000:2.0:1746143136.211992:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880091980700 x1830962858751360/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.211997:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980700 with x1830962858751360 ext(3145728->4194303) 00002000:00010000:2.0:1746143136.211999:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091980700 00000100:00100000:0.0:1746143136.212004:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6157 00000100:00100000:0.0:1746143136.212013:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858751104:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.212023:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6158 00000100:00100000:2.0:1746143136.212027:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858751360:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143136.230236:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858750336:12345-192.168.201.28@tcp:3:cat.0 Request processed in 22593us (22961us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.230248:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6154 00002000:00100000:3.0:1746143136.230259:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880130764a80 x1830962858750336/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.230269:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764a80 with x1830962858750336 ext(2097152->3145727) 00002000:00010000:3.0:1746143136.230274:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130764a80 00000100:00100000:1.0:1746143136.246221:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858750592:12345-192.168.201.28@tcp:3:cat.0 Request processed in 37046us (38888us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143136.246232:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6155 00002000:00100000:1.0:1746143136.246244:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880091981c00 x1830962858750592/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.246253:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091981c00 with x1830962858750592 ext(4194304->5210111) 00002000:00010000:1.0:1746143136.246258:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091981c00 00000100:00100000:3.0:1746143136.246933:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858750848:12345-192.168.201.28@tcp:3:cat.0 Request processed in 37534us (39558us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.246941:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6156 00002000:00100000:3.0:1746143136.246946:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880091981f80 x1830962858750848/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.246953:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091981f80 with x1830962858750848 ext(3145728->4194303) 00002000:00010000:3.0:1746143136.246957:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091981f80 00000100:00100000:0.0:1746143136.253603:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.253734:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858751616 00000100:00100000:3.0:1746143136.253742:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858751616 00000100:00100000:3.0:1746143136.253783:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8210 00000100:00100000:3.0:1746143136.253790:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31074:x1830962858751616:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143136.253810:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.253826:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70db74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650833 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.253926:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.253938:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.253948:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.253958:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.253964:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.253973:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255193:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255204:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255211:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:3.0:1746143136.255220:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143136.255296:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255302:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255308:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255312:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b8f4800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143136.255315:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255320:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255330:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143136.255333:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143136.255336:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255344:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4800/0x25aee876ca70db7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255372:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255376:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255380:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255384:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b8f4600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143136.255386:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255390:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255396:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531e00) 00010000:00010000:3.0:1746143136.255398:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143136.255400:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255404:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8f4600/0x25aee876ca70db82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.255439:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245200/0x25aee876ca70db74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 11 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.255450:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 10 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.255461:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143136.255463:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143136.255465:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b97e000, rc 0) 00000100:00100000:3.0:1746143136.255526:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31074:x1830962858751616:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1737us (1929us total) trans 8589942422 rc 0/0 00000100:00100000:3.0:1746143136.255534:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8210 00000100:00100000:0.0:1746143136.256678:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858751360:12345-192.168.201.28@tcp:3:cat.0 Request processed in 44646us (45001us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143136.256686:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6158 00002000:00100000:0.0:1746143136.256694:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880091980700 x1830962858751360/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143136.256703:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980700 with x1830962858751360 ext(3145728->4194303) 00002000:00010000:0.0:1746143136.256708:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091980700 00000100:00100000:1.0:1746143136.257078:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858751104:12345-192.168.201.28@tcp:3:cat.0 Request processed in 45065us (45446us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143136.257084:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6157 00002000:00100000:1.0:1746143136.257090:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880091982680 x1830962858751104/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.257104:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982680 with x1830962858751104 ext(2097152->3145727) 00002000:00010000:1.0:1746143136.257106:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091982680 00000100:00100000:0.0:1746143136.267243:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.267395:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858751872 00000100:00100000:1.0:1746143136.267404:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858751872 00002000:00100000:1.0:1746143136.267445:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880091980000 x1830962858751872/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.267454:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980000 with x1830962858751872 ext(4194304->5210111) 00002000:00010000:1.0:1746143136.267459:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091980000 00000100:00100000:1.0:1746143136.267478:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6159 00000100:00100000:1.0:1746143136.267486:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858751872:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.268698:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.269259:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858752128 00000100:00100000:3.0:1746143136.269264:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858752128 00000100:00100000:3.0:1746143136.269307:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3473 00000100:00100000:3.0:1746143136.269313:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31069:x1830962858752128:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:3.0:1746143136.269545:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31069:x1830962858752128:12345-192.168.201.28@tcp:35:cat.0 Request processed in 227us (844us total) trans 8589942423 rc 0/0 00000100:00100000:3.0:1746143136.269553:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3473 00000100:00100000:1.0:1746143136.286334:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858751872:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18840us (19090us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143136.286344:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6159 00002000:00100000:1.0:1746143136.286355:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880091980000 x1830962858751872/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.286364:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980000 with x1830962858751872 ext(4194304->5210111) 00002000:00010000:1.0:1746143136.286369:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091980000 00000100:00100000:0.0:1746143136.300716:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.301134:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858752384 00000100:00100000:2.0:1746143136.301144:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858752384 00000100:00100000:2.0:1746143136.301210:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3474 00000100:00100000:2.0:1746143136.301219:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31068:x1830962858752384:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:2.0:1746143136.301706:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31068:x1830962858752384:12345-192.168.201.28@tcp:35:cat.0 Request processed in 486us (996us total) trans 8589942424 rc 0/0 00000100:00100000:2.0:1746143136.301713:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3474 00000100:00100000:0.0:1746143136.304269:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.304611:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858752640 00000100:00100000:3.0:1746143136.304619:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858752640 00000100:00100000:3.0:1746143136.304718:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8211 00000100:00100000:3.0:1746143136.304727:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31077:x1830962858752640:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143136.304746:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.304761:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e400/0x25aee876ca70db97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165083a expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.304842:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.304854:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.304867:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.304878:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.304883:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.304888:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308249:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308264:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308275:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:3.0:1746143136.308284:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143136.308355:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308360:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308365:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308370:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b97e600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143136.308373:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308379:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308388:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143136.308391:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143136.308394:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308399:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e600/0x25aee876ca70db9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308430:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308436:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308441:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308444:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b97e800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143136.308446:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308451:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308457:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531200) 00010000:00010000:3.0:1746143136.308458:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143136.308460:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308465:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e800/0x25aee876ca70dba5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.308506:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e400/0x25aee876ca70db97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 205 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.308524:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 204 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.308530:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143136.308531:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143136.308533:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b97ea00, rc 0) 00000100:00100000:3.0:1746143136.309827:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:31077:x1830962858752640:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5097us (5560us total) trans 8589942425 rc 0/0 00000100:00100000:3.0:1746143136.309836:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8211 00000100:00100000:0.0:1746143136.362366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.362471:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858752768 00000100:00100000:1.0:1746143136.362480:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858752768 00000100:00100000:1.0:1746143136.362520:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12646 00000100:00100000:1.0:1746143136.362528:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31074:x1830962858752768:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143136.362546:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.362564:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650841 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.362595:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.362603:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.362609:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.362611:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.362615:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2273280->2895871] (req 2273280->2895871) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.362643:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.362656:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.362667:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861294208:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.363014:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.363022:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 24 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.363059:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861294336:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.363084:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.366649:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861294208:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.366659:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861294336:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.366683:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2273280->2895871] (req 2273280->2895871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.366700:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b7c800, rc 0) 00000100:00100000:1.0:1746143136.366737:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31074:x1830962858752768:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4209us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.366746:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12646 00000100:00100000:0.0:1746143136.368409:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.368680:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858752896 00000100:00100000:2.0:1746143136.368687:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858752896 00010000:00010000:2.0:1746143136.368715:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.368737:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6701 00000100:00100000:2.0:1746143136.368744:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858752896:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.368755:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.368779:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.368788:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.368809:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2800/0x25aee876ca70db6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165082c expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.368834:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.368855:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858752896:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 113us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.368860:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6701 00000100:00100000:0.0:1746143136.375916:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.376006:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858753024 00000100:00100000:2.0:1746143136.376015:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858753024 00010000:00010000:2.0:1746143136.376074:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 24 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.376101:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6702 00000100:00100000:2.0:1746143136.376108:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858753024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.376121:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.376144:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 24 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.376155:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 24 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.376190:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb2400/0x25aee876ca70db5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165081e expref: 24 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.376216:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.376219:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.376226:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.376234:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.376267:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.376283:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861294464:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143136.376357:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.377793:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.377851:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858753280 00000100:00100000:1.0:1746143136.377857:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858753280 00002000:00100000:1.0:1746143136.377888:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2273280->2277375) req@ffff880091981180 x1830962858753280/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.377898:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091981180 with x1830962858753280 ext(2273280->2277375) 00002000:00010000:1.0:1746143136.377902:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091981180 00000100:00100000:1.0:1746143136.377915:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6160 00000100:00100000:1.0:1746143136.377920:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858753280:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143136.378083:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858753280:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 163us (294us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143136.378090:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6160 00002000:00100000:1.0:1746143136.378095:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2273280->2277375) req@ffff880091981180 x1830962858753280/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.378103:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091981180 with x1830962858753280 ext(2273280->2277375) 00002000:00010000:1.0:1746143136.378106:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091981180 00000100:00100000:2.0:1746143136.378244:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861294464:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.378257:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.378288:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858753024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2181us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.378295:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6702 00000100:00100000:0.0:1746143136.398496:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.398598:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858753536 00000100:00100000:2.0:1746143136.398609:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858753536 00002000:00100000:2.0:1746143136.398652:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2891776->2895871) req@ffff880091980e00 x1830962858753536/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.398662:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980e00 with x1830962858753536 ext(2891776->2895871) 00002000:00010000:2.0:1746143136.398668:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091980e00 00000100:00100000:2.0:1746143136.398698:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6161 00000100:00100000:2.0:1746143136.398706:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858753536:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143136.398890:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858753536:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 184us (405us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143136.398897:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6161 00002000:00100000:2.0:1746143136.398903:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2891776->2895871) req@ffff880091980e00 x1830962858753536/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.398910:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091980e00 with x1830962858753536 ext(2891776->2895871) 00002000:00010000:2.0:1746143136.398912:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091980e00 00000100:00100000:0.0:1746143136.404502:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.404595:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858753792 00000100:00100000:3.0:1746143136.404604:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858753792 00000100:00100000:3.0:1746143136.404655:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3475 00000100:00100000:3.0:1746143136.404662:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31074:x1830962858753792:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143136.404947:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31074:x1830962858753792:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 285us (455us total) trans 8589942426 rc 0/0 00000100:00100000:3.0:1746143136.404954:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3475 00000100:00100000:0.0:1746143136.409463:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.409546:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858753920 00000100:00100000:1.0:1746143136.409555:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858753920 00000100:00100000:1.0:1746143136.409593:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12647 00000100:00100000:1.0:1746143136.409600:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:31077:x1830962858753920:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143136.409619:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.409639:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650848 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.409673:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.409682:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.409690:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 36 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.409696:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.409698:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.409701:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1703936->2097151] (req 1703936->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.409729:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 36 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.409741:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 36 pid: 22204 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143136.409759:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861294592:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.410072:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.410081:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 23 pid: 8448 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.410089:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861294720:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.410118:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.410127:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 9 pid: 8448 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143136.410134:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861294848:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.410560:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.416677:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.416710:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.416736:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858754176 00000100:00100000:0.0:1746143136.416743:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858754176 00010000:00010000:0.0:1746143136.416958:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 37 pid: 22204 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143136.416996:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858754048 00000100:00100000:0.0:1746143136.416999:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858754048 00010000:00010000:0.0:1746143136.417010:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 24 pid: 8448 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.417059:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6703 00000100:00100000:0.0:1746143136.417068:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858754176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.417083:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.417107:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 37 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.417117:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 37 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.417151:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.417204:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858754176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.417211:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6703 00000100:00100000:0.0:1746143136.417270:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6704 00000100:00100000:0.0:1746143136.417276:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858754048:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.417282:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.417290:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 24 pid: 8448 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.417298:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 24 pid: 8448 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.417309:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.417323:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858754048:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 47us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.417328:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6704 00000100:00100000:0.0:1746143136.417434:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.417449:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858754304 00000100:00100000:0.0:1746143136.417452:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858754304 00010000:00010000:0.0:1746143136.417654:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 10 pid: 8448 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143136.417671:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6705 00000100:00100000:0.0:1746143136.417676:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858754304:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.417683:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.417690:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 10 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.417699:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 10 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.417717:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.417719:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.417726:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.417735:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.417763:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.417775:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb74e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861294976:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143136.417831:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143136.418026:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d7400/0x25aee876ca70db04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507c3 expref: 36 pid: 22204 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143136.418061:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861294592:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.418071:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135fb3600/0x25aee876ca70db35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507f4 expref: 23 pid: 8448 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.418083:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861294720:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.418092:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a586f800/0x25aee876ca70da01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650753 expref: 10 pid: 8448 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143136.418099:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861294848:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.418120:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 35 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.418129:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b7ca00, rc 0) 00000100:00100000:1.0:1746143136.418150:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:31077:x1830962858753920:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8551us (8699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.418157:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12647 00000100:00100000:2.0:1746143136.423451:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb74e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861294976:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.423684:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.423729:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858754304:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6052us (6294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.423740:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6705 00000100:00100000:0.0:1746143136.425369:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.425938:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858754560 00000100:00100000:1.0:1746143136.425946:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858754560 00002000:00100000:1.0:1746143136.425995:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1703936->1708031) req@ffff88008eb77800 x1830962858754560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.426124:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77800 with x1830962858754560 ext(1703936->1708031) 00002000:00010000:1.0:1746143136.426129:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb77800 00000100:00100000:1.0:1746143136.426545:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6162 00000100:00100000:1.0:1746143136.426553:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858754560:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143136.427088:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1970:x1830962858754560:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 534us (1724us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143136.427095:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6162 00002000:00100000:1.0:1746143136.427101:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1703936->1708031) req@ffff88008eb77800 x1830962858754560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.427109:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77800 with x1830962858754560 ext(1703936->1708031) 00002000:00010000:1.0:1746143136.427111:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb77800 00000100:00100000:0.0:1746143136.435297:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.435608:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858754688 00000100:00100000:1.0:1746143136.435616:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858754688 00000100:00100000:1.0:1746143136.435658:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12648 00000100:00100000:1.0:1746143136.435665:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:31077:x1830962858754688:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143136.435684:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.435702:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165084f expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.435734:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.435742:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.435750:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 36 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.435756:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.435758:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.435761:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->1335295] (req 1048576->1335295) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.435792:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 36 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.435805:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 36 pid: 22204 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143136.435816:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861295104:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.436279:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.436288:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 22 pid: 26949 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.436297:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861295232:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.437262:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 8 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.437273:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 8 pid: 21048 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143136.437282:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861295360:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.437712:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.439108:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861295104:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.439116:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861295232:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.440408:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861295360:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.440437:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->1335295] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.440453:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b7d400, rc 0) 00000100:00100000:1.0:1746143136.441774:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:31077:x1830962858754688:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6106us (6486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.441782:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12648 00000100:00100000:1.0:1746143136.442274:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.442726:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.442755:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.442775:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858755200 00000100:00100000:0.0:1746143136.442775:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.442782:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858755200 00010000:00010000:2.0:1746143136.442812:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 9 pid: 21048 timeout: 1018 lvb_type: 1 00000100:00100000:3.0:1746143136.444047:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858755072 00000100:00100000:3.0:1746143136.444054:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858755072 00000100:00100000:3.0:1746143136.444087:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8212 00000100:00100000:3.0:1746143136.444095:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31082:x1830962858755072:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143136.444119:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.444137:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f200/0x25aee876ca70dbcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650856 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.444273:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.444291:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.444301:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000100:00100000:2.0:1746143136.444306:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858754816 00000004:00200000:3.0:1746143136.444311:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:2.0:1746143136.444311:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858754816 00000100:00100000:3.0:1746143136.444325:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858755328 00010000:00010000:2.0:1746143136.444326:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 36 pid: 22204 timeout: 1018 lvb_type: 1 00000100:00100000:3.0:1746143136.444328:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858755328 00000100:00100000:2.0:1746143136.444341:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6706 00000100:00100000:2.0:1746143136.444347:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858755200:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.444356:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143136.444357:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6707 00000100:00100000:0.0:1746143136.444365:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858754816:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.444371:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.444376:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 9 pid: 21048 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.444379:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 36 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.444386:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 9 pid: 21048 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.444399:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 36 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.444417:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0x25aee876ca70d9ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165075a expref: 9 pid: 21048 timeout: 1018 lvb_type: 1 00010000:00010000:3.0:1746143136.444435:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 23 pid: 26949 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.445013:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6708 00000100:00100000:3.0:1746143136.445020:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858755328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.445046:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.445282:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6800/0x25aee876ca70db0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ca expref: 36 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.445289:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143136.445295:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.445332:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858755200:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 984us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.445339:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6706 00000100:00100000:1.0:1746143136.445407:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858754816:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1043us (2649us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.445414:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6707 00010000:00010000:1.0:1746143136.445547:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f200/0x25aee876ca70dbcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.445574:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 14 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.445579:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.445581:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143136.445583:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b97f400, rc 0) 00000100:00100000:1.0:1746143136.445606:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31082:x1830962858755072:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1513us (3333us total) trans 8589942427 rc 0/0 00000100:00100000:1.0:1746143136.445610:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8212 00010000:00010000:3.0:1746143136.445808:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 23 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.445817:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 23 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.445827:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70db3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507fb expref: 23 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.445837:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.445840:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.445846:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.445852:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.445876:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143136.445884:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861295488:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143136.445938:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b24503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.450699:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.450770:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.450793:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858755456 00000100:00100000:0.0:1746143136.450799:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858755456 00000100:00100000:3.0:1746143136.451078:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861295488:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143136.451099:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.451136:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858755328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6117us (8360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.451203:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858755584 00000100:00100000:0.0:1746143136.451206:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858755584 00000100:00100000:0.0:1746143136.451223:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12649 00000100:00100000:0.0:1746143136.451233:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858755456:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.451249:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143136.451253:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12650 00000100:00100000:2.0:1746143136.451261:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858755584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.451264:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800939dba00/0x25aee876ca70dbe4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165085d expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.451268:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.451275:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a357000/0x25aee876ca70dbeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650864 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.451311:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861295616:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143136.451346:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861295744:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143136.451355:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143136.451369:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.452400:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6708 00000100:00100000:0.0:1746143136.454689:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.455450:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858755840 00000100:00100000:1.0:1746143136.455458:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858755840 00002000:00100000:1.0:1746143136.455499:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1331200->1335295) req@ffff88008eb77480 x1830962858755840/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.455515:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77480 with x1830962858755840 ext(1331200->1335295) 00002000:00010000:1.0:1746143136.455520:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb77480 00000100:00100000:1.0:1746143136.455555:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6163 00000100:00100000:1.0:1746143136.455561:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858755840:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143136.455748:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858755840:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 186us (1067us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143136.455756:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6163 00002000:00100000:1.0:1746143136.455967:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1331200->1335295) req@ffff88008eb77480 x1830962858755840/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.455974:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77480 with x1830962858755840 ext(1331200->1335295) 00002000:00010000:1.0:1746143136.455977:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb77480 00002000:00010000:2.0:1746143136.456639:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143134 -> 1746143135 00002000:00010000:2.0:1746143136.456643:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143134 -> 1746143135 00002000:00010000:2.0:1746143136.456646:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143134 -> 1746143135 00000100:00100000:2.0:1746143136.456659:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861295744:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143136.456689:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a357000/0x25aee876ca70dbeb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650864 expref: 25 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.456703:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a357000/0x25aee876ca70dbeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650864 expref: 25 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.456728:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357000, rc 0) 00000100:00100000:2.0:1746143136.456757:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858755584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5496us (5986us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143136.456765:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12650 00002000:00010000:2.0:1746143136.457071:0:8448:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143134 -> 1746143135 00002000:00010000:2.0:1746143136.457074:0:8448:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143134 -> 1746143135 00002000:00010000:2.0:1746143136.457076:0:8448:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143134 -> 1746143135 00000100:00100000:2.0:1746143136.457086:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861295616:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143136.457105:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800939dba00/0x25aee876ca70dbe4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165085d expref: 23 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.457115:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800939dba00/0x25aee876ca70dbe4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165085d expref: 23 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.457122:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939dba00, rc 0) 00000100:00100000:2.0:1746143136.457153:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962858755456:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5924us (6463us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143136.457159:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12649 00000100:00100000:0.0:1746143136.461900:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.462881:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.462939:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858756224 00000100:00100000:3.0:1746143136.462950:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858756224 00000100:00100000:3.0:1746143136.462998:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12651 00000100:00100000:3.0:1746143136.463006:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:31082:x1830962858756224:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143136.463027:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.463298:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165086b expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.463330:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.463344:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143136.463346:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143136.463350:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.463369:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858756096 00000100:00100000:2.0:1746143136.463568:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858756096 00010000:00010000:3.0:1746143136.463590:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 34 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.463603:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 34 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.463615:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861295872:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.464366:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3476 00000100:00100000:2.0:1746143136.464373:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c04dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:31077:x1830962858756096:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143136.464560:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c04dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:31077:x1830962858756096:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 186us (2669us total) trans 8589942428 rc 0/0 00000100:00100000:2.0:1746143136.464567:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3476 00000100:00100000:3.0:1746143136.465051:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b24503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.466310:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861295872:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143136.466339:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 23 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.466358:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b97fc00, rc 0) 00000100:00100000:3.0:1746143136.466399:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31082:x1830962858756224:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3393us (3518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.466408:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12651 00000100:00100000:0.0:1746143136.467648:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.467698:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858756352 00000100:00100000:1.0:1746143136.467705:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858756352 00002000:00100000:1.0:1746143136.467746:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1703936->2097151) req@ffff88008eb74000 x1830962858756352/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.467756:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74000 with x1830962858756352 ext(1703936->2097151) 00010000:00010000:1.0:1746143136.467763:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 35 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.467777:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 35 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:1.0:1746143136.467783:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008eb74000 00000100:00100000:1.0:1746143136.468023:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2016 00000100:00100000:1.0:1746143136.468062:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+35:1969:x1830962858756352:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:1.0:1746143136.478806:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1969:x1830962858756352:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 10763us (11440us total) trans 17179872822 rc 0/0 00000100:00100000:1.0:1746143136.478819:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2016 00002000:00100000:1.0:1746143136.478831:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1703936->2097151) req@ffff88008eb74000 x1830962858756352/t17179872822(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/448 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.478840:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74000 with x1830962858756352 ext(1703936->2097151) 00010000:00010000:1.0:1746143136.478850:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 37 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.478866:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 37 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:1.0:1746143136.478873:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008eb74000 00000100:00100000:0.0:1746143136.481175:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.481401:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858756480 00000100:00100000:3.0:1746143136.481410:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858756480 00010000:00010000:3.0:1746143136.481444:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 37 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.481495:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6709 00000100:00100000:3.0:1746143136.481502:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1971:x1830962858756480:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.481516:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143136.481537:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 37 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.481548:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 37 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.481572:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b7ca00/0x25aee876ca70dbc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650848 expref: 37 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.481601:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.481604:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.481612:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.481620:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.481654:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143136.481667:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861296000:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143136.481738:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b24503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.488783:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861296000:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143136.488806:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.488851:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1971:x1830962858756480:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7348us (7692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.488862:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6709 00000100:00100000:0.0:1746143136.489176:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.489297:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858756736 00000100:00100000:2.0:1746143136.489304:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858756736 00002000:00100000:2.0:1746143136.489343:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb74e00 x1830962858756736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.489353:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74e00 with x1830962858756736 ext(1048576->2097151) 00002000:00010000:2.0:1746143136.489358:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb74e00 00000100:00100000:2.0:1746143136.489385:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6164 00000100:00100000:2.0:1746143136.489392:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858756736:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.501902:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.501997:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858756992 00000100:00100000:1.0:1746143136.502006:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858756992 00000100:00100000:1.0:1746143136.502590:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8213 00000100:00100000:1.0:1746143136.502600:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:31086:x1830962858756992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.502624:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.502644:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7dc00/0x25aee876ca70dbf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650872 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.502744:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143136.502756:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143136.502767:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:1.0:1746143136.502778:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143136.502899:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7dc00/0x25aee876ca70dbf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 208 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.503794:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 207 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.503803:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.503806:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143136.503809:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b7d600, rc 0) 00000100:00100000:1.0:1746143136.503868:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31086:x1830962858756992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1269us (1974us total) trans 8589942429 rc 0/0 00000100:00100000:1.0:1746143136.503874:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8213 00000100:00100000:2.0:1746143136.504357:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858756736:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14964us (15192us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.504366:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6164 00002000:00100000:2.0:1746143136.504374:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb74e00 x1830962858756736/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.504381:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74e00 with x1830962858756736 ext(1048576->2097151) 00002000:00010000:2.0:1746143136.504386:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb74e00 00000100:00100000:0.0:1746143136.506712:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.506762:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.507007:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858757120 00000100:00100000:2.0:1746143136.507015:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858757120 00000100:00100000:1.0:1746143136.507051:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858757248 00000100:00100000:1.0:1746143136.507055:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858757248 00000100:00100000:2.0:1746143136.507074:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12652 00000100:00100000:2.0:1746143136.507080:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+36:1969:x1830962858757120:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143136.507097:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.507115:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650879 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.507136:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.507139:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.507147:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 37 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.507161:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 37 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.507181:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357600, rc 0) 00000100:00100000:1.0:1746143136.507183:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12653 00000100:00100000:1.0:1746143136.507189:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858757248:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.507198:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.507207:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b7cc00/0x25aee876ca70dc15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650880 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.507213:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1969:x1830962858757120:12345-192.168.201.28@tcp:101:cat.0 Request processed in 133us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.507218:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12652 00000100:00100000:1.0:1746143136.507248:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861296128:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143136.507308:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801369096c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143136.511123:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143134 -> 1746143135 00002000:00010000:1.0:1746143136.511131:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143134 -> 1746143135 00000100:00100000:1.0:1746143136.511154:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861296128:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143136.511195:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b7cc00/0x25aee876ca70dc15 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650880 expref: 28 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.511210:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b7cc00/0x25aee876ca70dc15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650880 expref: 28 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.511320:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b7cc00, rc 0) 00000100:00100000:1.0:1746143136.511361:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858757248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4172us (4599us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143136.511368:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12653 00000100:00100000:0.0:1746143136.517948:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.518004:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858757376 00000100:00100000:1.0:1746143136.518015:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858757376 00000100:00100000:1.0:1746143136.518075:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12654 00000100:00100000:1.0:1746143136.518085:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31082:x1830962858757376:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.518104:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.518122:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650887 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.518154:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.518162:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143136.518177:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143136.518181:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.518215:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 36 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.518227:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 36 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.518238:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861296256:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.518346:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801369096c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.519187:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861296256:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.519206:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.519217:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b7d000, rc 0) 00000100:00100000:1.0:1746143136.519250:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31082:x1830962858757376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1168us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.519257:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12654 00000100:00100000:0.0:1746143136.519891:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.520819:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858757504 00000100:00100000:2.0:1746143136.520825:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858757504 00002000:00100000:2.0:1746143136.520857:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1335295) req@ffff880091982d80 x1830962858757504/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.520865:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982d80 with x1830962858757504 ext(1048576->1335295) 00010000:00010000:2.0:1746143136.520870:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 37 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.520879:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 37 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:2.0:1746143136.520884:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091982d80 00000100:00100000:2.0:1746143136.520905:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2017 00000100:00100000:2.0:1746143136.520910:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1968:x1830962858757504:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143136.525239:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.525318:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858757760 00000100:00100000:3.0:1746143136.525326:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858757760 00002000:00100000:3.0:1746143136.525658:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008e80d880 x1830962858757760/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.525668:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d880 with x1830962858757760 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.525673:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80d880 00000100:00100000:3.0:1746143136.525693:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6165 00000100:00100000:3.0:1746143136.525699:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1971:x1830962858757760:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143136.532153:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+41:1968:x1830962858757504:12345-192.168.201.28@tcp:4:cat.0 Request processed in 11233us (12253us total) trans 17179872823 rc 0/0 00000100:00100000:3.0:1746143136.532277:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2017 00002000:00100000:3.0:1746143136.532287:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1335295) req@ffff880091982d80 x1830962858757504/t17179872823(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/448 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.532294:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982d80 with x1830962858757504 ext(1048576->1335295) 00010000:00010000:3.0:1746143136.532303:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 41 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.532315:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 41 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:3.0:1746143136.532323:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091982d80 00010000:00010000:1.0:1746143136.537462:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143136.539714:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1971:x1830962858757760:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14001us (14470us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.539727:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6165 00002000:00100000:3.0:1746143136.539740:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008e80d880 x1830962858757760/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.539749:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d880 with x1830962858757760 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.539755:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80d880 00000100:00100000:0.0:1746143136.541446:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.541723:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858757888 00000100:00100000:3.0:1746143136.541731:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858757888 00010000:00010000:3.0:1746143136.541765:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.541806:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6710 00000100:00100000:3.0:1746143136.541814:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1969:x1830962858757888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.541827:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143136.542072:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.542084:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.542107:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b7d400/0x25aee876ca70dbc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165084f expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.542138:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.542140:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.542148:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.542156:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.542207:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143136.542220:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861296384:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143136.542296:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b24503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.547148:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861296384:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143136.547180:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.547808:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1969:x1830962858757888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5991us (6364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.547820:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6710 00000100:00100000:0.0:1746143136.550652:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.550719:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858758016 00000100:00100000:1.0:1746143136.550728:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858758016 00000100:00100000:1.0:1746143136.550782:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12655 00000100:00100000:1.0:1746143136.550789:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:31086:x1830962858758016:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.550811:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.550830:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165088e expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.551091:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.551093:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.551101:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 39 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.551117:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 39 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.551127:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8f4600, rc 0) 00000100:00100000:1.0:1746143136.551192:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:31086:x1830962858758016:12345-192.168.201.28@tcp:101:cat.0 Request processed in 403us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.551199:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12655 00000100:00100000:0.0:1746143136.553634:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.553704:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858758272 00000100:00100000:3.0:1746143136.553712:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858758272 00002000:00100000:3.0:1746143136.553755:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880091983480 x1830962858758272/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.553765:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091983480 with x1830962858758272 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.553770:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091983480 00000100:00100000:3.0:1746143136.553800:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6166 00000100:00100000:3.0:1746143136.553807:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858758272:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.560988:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.561082:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858758528 00000100:00100000:1.0:1746143136.561093:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858758528 00002000:00100000:1.0:1746143136.561139:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a5e38700 x1830962858758528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.561149:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e38700 with x1830962858758528 ext(1048576->2097151) 00002000:00010000:1.0:1746143136.561156:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e38700 00000100:00100000:1.0:1746143136.561554:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6167 00000100:00100000:1.0:1746143136.561563:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1968:x1830962858758528:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143136.563266:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858758272:12345-192.168.201.28@tcp:3:cat.0 Request processed in 9452us (9633us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.563278:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6166 00002000:00100000:3.0:1746143136.563287:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880091983480 x1830962858758272/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.563296:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091983480 with x1830962858758272 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.563301:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091983480 00000100:00100000:2.0:1746143136.576548:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1968:x1830962858758528:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14972us (15557us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.576561:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6167 00002000:00100000:2.0:1746143136.576574:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a5e38700 x1830962858758528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.576590:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e38700 with x1830962858758528 ext(1048576->2097151) 00002000:00010000:2.0:1746143136.576596:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e38700 00000100:00100000:2.0:1746143136.582682:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.582707:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.582732:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858758784 00000100:00100000:2.0:1746143136.582740:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858758784 00000100:00100000:0.0:1746143136.582748:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858759040 00000100:00100000:0.0:1746143136.582754:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858759040 00002000:00100000:2.0:1746143136.582785:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3768319) req@ffff88008e80f800 x1830962858758784/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 504/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143136.582785:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3768320->4194303) req@ffff88008e80f100 x1830962858759040/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.582794:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f800 with x1830962858758784 ext(2097152->3768319) 00002000:00100000:0.0:1746143136.582795:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f100 with x1830962858759040 ext(3768320->4194303) 00002000:00010000:2.0:1746143136.582801:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80f800 00002000:00010000:0.0:1746143136.582801:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80f100 00000100:00100000:0.0:1746143136.582830:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6168 00000100:00100000:0.0:1746143136.582838:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858759040:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.582843:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6169 00000100:00100000:2.0:1746143136.582849:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858758784:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.596516:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.596549:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858759168 00000100:00100000:0.0:1746143136.596557:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858759168 00000100:00100000:0.0:1746143136.596607:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12656 00000100:00100000:0.0:1746143136.596616:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:31086:x1830962858759168:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.596635:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.596653:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650895 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.596686:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.596700:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143136.596702:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143136.596706:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.596734:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.596747:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.596760:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861296512:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.599069:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.603824:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861296512:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.604073:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.604100:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aeb3800, rc 0) 00000100:00100000:1.0:1746143136.604172:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:31086:x1830962858759168:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7546us (7655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.604181:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12656 00000100:00100000:0.0:1746143136.605372:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.605491:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858759296 00000100:00100000:1.0:1746143136.605502:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858759296 00002000:00100000:1.0:1746143136.605544:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2273280->2895871) req@ffff8800a5e39c00 x1830962858759296/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.605554:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39c00 with x1830962858759296 ext(2273280->2895871) 00010000:00010000:1.0:1746143136.605561:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.605575:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:1.0:1746143136.605581:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e39c00 00000100:00100000:1.0:1746143136.605715:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2018 00000100:00100000:1.0:1746143136.605723:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1971:x1830962858759296:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143136.608385:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858758784:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25527us (25704us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.608397:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6169 00002000:00100000:2.0:1746143136.608407:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3768319) req@ffff88008e80f800 x1830962858758784/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 504/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.608416:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f800 with x1830962858758784 ext(2097152->3768319) 00010000:00010000:2.0:1746143136.608427:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.608442:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:2.0:1746143136.608455:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e80f800 00000100:00100000:1.0:1746143136.609073:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858759040:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26230us (26358us total) trans 0 rc 425984/425984 00000100:00100000:1.0:1746143136.609082:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6168 00002000:00100000:1.0:1746143136.609090:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3768320->4194303) req@ffff88008e80f100 x1830962858759040/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 425984/425984 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.609104:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80f100 with x1830962858759040 ext(3768320->4194303) 00010000:00010000:1.0:1746143136.609112:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.609123:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:1.0:1746143136.609129:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e80f100 00000100:00100000:0.0:1746143136.614580:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.615406:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858759424 00000100:00100000:1.0:1746143136.615418:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858759424 00000100:00100000:1.0:1746143136.615477:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12657 00000100:00100000:1.0:1746143136.615484:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:31082:x1830962858759424:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.615499:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.615515:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165089c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.615535:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143136.615537:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143136.615541:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.615550:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.615559:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b7ce00, rc 0) 00000100:00100000:1.0:1746143136.615615:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:31082:x1830962858759424:12345-192.168.201.28@tcp:101:cat.0 Request processed in 132us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.615621:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12657 00000100:00100000:1.0:1746143136.619291:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.619371:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858759680 00000100:00100000:0.0:1746143136.619382:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858759680 00000100:00100000:0.0:1746143136.619640:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8214 00000100:00100000:0.0:1746143136.619650:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31088:x1830962858759680:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143136.619675:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.619694:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3000/0x25aee876ca70dc38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508a3 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.619795:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.619809:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 208 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.619818:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 13 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.619824:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 208 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.619830:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.620080:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 208 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.620093:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 208 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.620105:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861296640:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.620206:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 13 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.620214:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 13 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.620221:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861296768:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.620248:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 208 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.620255:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 208 pid: 17079 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.620263:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861296896:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.620280:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.622325:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.623180:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861296640:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.623193:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861296768:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.623201:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861296896:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.623226:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.623381:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.623534:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.623585:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858759808 00000100:00100000:3.0:1746143136.623591:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858759808 00010000:00010000:3.0:1746143136.623622:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 14 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.623646:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858760064 00000100:00100000:3.0:1746143136.623648:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858760064 00010000:00010000:3.0:1746143136.623657:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 209 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.623681:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6711 00000100:00100000:3.0:1746143136.623688:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858759808:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.623700:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143136.623705:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 14 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.623713:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6712 00010000:00010000:3.0:1746143136.623714:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 14 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.623725:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:1968:x1830962858760064:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.623739:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97e000/0x25aee876ca70db89 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650833 expref: 14 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.623741:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.623750:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 209 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.623759:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143136.623763:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000100:00100000:1.0:1746143136.623837:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858759936 00000100:00100000:1.0:1746143136.623839:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858759936 00010000:00010000:1.0:1746143136.623853:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 210 pid: 17079 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.623868:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6713 00000100:00100000:1.0:1746143136.623872:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:1969:x1830962858759936:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143136.623878:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143136.623881:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 210 pid: 17079 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.624188:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.624196:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143136.624202:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 210 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.624222:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97ea00/0x25aee876ca70dbac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165083a expref: 210 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.624251:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.624256:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.624263:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.624268:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.624273:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858759808:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 584us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.624280:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6711 00000100:00100000:2.0:1746143136.624307:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:1968:x1830962858760064:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 586us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.624314:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6712 00010000:00010000:1.0:1746143136.624747:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 208 pid: 17079 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.624762:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7ae00/0x25aee876ca70dae1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507a7 expref: 208 pid: 17079 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.624782:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.624786:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143136.624794:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00000100:00100000:2.0:1746143136.624800:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858759296:12345-192.168.201.28@tcp:4:cat.0 Request processed in 19076us (19431us total) trans 21474840086 rc 0/0 00010000:00010000:1.0:1746143136.624801:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00000100:00100000:2.0:1746143136.624810:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2018 00002000:00100000:2.0:1746143136.624819:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2273280->2895871) req@ffff8800a5e39c00 x1830962858759296/t21474840086(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/448 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.624826:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39c00 with x1830962858759296 ext(2273280->2895871) 00010000:00010000:1.0:1746143136.624826:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143136.624834:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.624844:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.624847:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1969:x1830962858759936:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 974us (1313us total) trans 0 rc 0/0 00002000:00010000:2.0:1746143136.624850:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e39c00 00000100:00100000:1.0:1746143136.624853:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6713 00010000:00010000:0.0:1746143136.625015:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.625021:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:0.0:1746143136.625059:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143136.625199:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3000/0x25aee876ca70dc38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 208 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.625220:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 207 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.625227:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143136.625229:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143136.625232:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aeb2e00, rc 0) 00000100:00100000:0.0:1746143136.625257:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31088:x1830962858759680:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5610us (5973us total) trans 8589942430 rc 0/0 00000100:00100000:0.0:1746143136.625263:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8214 00000100:00100000:1.0:1746143136.629462:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.629544:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858760192 00000100:00100000:2.0:1746143136.629553:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858760192 00010000:00010000:2.0:1746143136.629587:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.629613:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6714 00000100:00100000:2.0:1746143136.629620:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858760192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.629634:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.629657:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.629668:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.629696:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dbba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2273280->2895871) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650841 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.630086:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.630088:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.630095:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.630103:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.630112:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.630113:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.630116:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.630123:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.630152:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.630174:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861297024:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.630266:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.630280:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861297152:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143136.630303:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143136.635083:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861297024:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143136.635098:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861297152:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.635125:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.635232:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858760192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5610us (5779us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.635244:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6714 00000100:00100000:0.0:1746143136.637184:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.637256:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858760448 00000100:00100000:2.0:1746143136.637265:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858760448 00002000:00100000:2.0:1746143136.637306:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5e39f80 x1830962858760448/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.637316:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39f80 with x1830962858760448 ext(3145728->4194303) 00002000:00010000:2.0:1746143136.637322:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e39f80 00000100:00100000:2.0:1746143136.637617:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6170 00000100:00100000:2.0:1746143136.637770:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858760448:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.642622:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.643015:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.643117:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858760704 00000100:00100000:3.0:1746143136.643127:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858760704 00002000:00100000:3.0:1746143136.643186:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5e3aa00 x1830962858760704/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.643197:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3aa00 with x1830962858760704 ext(2097152->3145727) 00002000:00010000:3.0:1746143136.643202:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3aa00 00000100:00100000:3.0:1746143136.643227:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858760832 00000100:00100000:3.0:1746143136.643230:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858760832 00002000:00100000:3.0:1746143136.643244:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880135180e00 x1830962858760832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.643252:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180e00 with x1830962858760832 ext(3145728->4194303) 00002000:00010000:3.0:1746143136.643255:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135180e00 00000100:00100000:3.0:1746143136.643279:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6171 00000100:00100000:3.0:1746143136.643287:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858760704:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.643600:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6172 00000100:00100000:2.0:1746143136.643608:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858760832:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.654740:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.655817:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858761216 00000100:00100000:2.0:1746143136.655827:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858761216 00000100:00100000:2.0:1746143136.655889:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8215 00000100:00100000:2.0:1746143136.655898:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31090:x1830962858761216:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143136.655924:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.655943:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dc4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508aa expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.656102:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656115:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656125:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656138:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656143:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656148:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656271:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656278:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656284:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:2.0:1746143136.656321:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143136.656410:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656422:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656428:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656434:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132f7a800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143136.656438:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656651:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656662:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143136.656665:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143136.656669:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656674:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70dc54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656693:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656699:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656703:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656707:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132f7aa00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143136.656709:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656718:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656723:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800931f2e00) 00010000:00010000:2.0:1746143136.656725:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143136.656728:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656733:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dc5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.656769:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dc4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 16 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.656779:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.656785:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.656787:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143136.656789:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7b000, rc 0) 00000100:00100000:2.0:1746143136.659303:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:31090:x1830962858761216:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3391us (4561us total) trans 8589942431 rc 0/0 00000100:00100000:2.0:1746143136.659316:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8215 00000100:00100000:3.0:1746143136.665925:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858760448:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28287us (28735us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.665938:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6170 00002000:00100000:3.0:1746143136.665951:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a5e39f80 x1830962858760448/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.665961:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e39f80 with x1830962858760448 ext(3145728->4194303) 00002000:00010000:3.0:1746143136.665968:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e39f80 00000100:00100000:2.0:1746143136.666987:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858760704:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23698us (24373us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.666995:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6171 00002000:00100000:2.0:1746143136.667001:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5e3aa00 x1830962858760704/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.667015:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3aa00 with x1830962858760704 ext(2097152->3145727) 00002000:00010000:2.0:1746143136.667019:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3aa00 00000100:00100000:2.0:1746143136.669467:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858760832:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25851us (26444us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.669479:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6172 00002000:00100000:2.0:1746143136.669488:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880135180e00 x1830962858760832/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.669497:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135180e00 with x1830962858760832 ext(3145728->4194303) 00002000:00010000:2.0:1746143136.669503:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135180e00 00000100:00100000:0.0:1746143136.679002:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.679774:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.680115:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858761344 00000100:00100000:1.0:1746143136.680126:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858761344 00000100:00100000:2.0:1746143136.680135:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858761600 00000100:00100000:2.0:1746143136.680141:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858761600 00002000:00100000:2.0:1746143136.680188:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a5e3a680 x1830962858761600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.680199:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3a680 with x1830962858761600 ext(4194304->5210111) 00002000:00010000:2.0:1746143136.680205:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e3a680 00000100:00100000:1.0:1746143136.680213:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12658 00000100:00100000:1.0:1746143136.680224:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:31090:x1830962858761344:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:2.0:1746143136.680231:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6173 00000100:00100000:2.0:1746143136.680238:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858761600:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:1.0:1746143136.680242:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.680263:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508b1 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.680295:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.680303:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.680310:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.680313:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.680317:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.680350:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.680364:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.680378:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861297280:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.680497:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.680507:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.680517:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861297408:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.680547:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801369096c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.692840:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.692903:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858761856 00000100:00100000:3.0:1746143136.692913:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858761856 00000100:00100000:1.0:1746143136.692913:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861297280:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.692931:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861297408:192.168.201.28@tcp:104: 00002000:00100000:3.0:1746143136.692954:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a5e3bb80 x1830962858761856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.692963:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3bb80 with x1830962858761856 ext(4194304->5210111) 00010000:00010000:1.0:1746143136.692964:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.692971:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.692981:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.692982:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b7c800, rc 0) 00002000:00010000:3.0:1746143136.692987:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e3bb80 00000100:00100000:3.0:1746143136.693012:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2019 00000100:00100000:3.0:1746143136.693018:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858761856:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143136.693184:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:31090:x1830962858761344:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 12960us (14191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.693193:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12658 00000100:00100000:2.0:1746143136.693210:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858761600:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12971us (13437us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143136.693217:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6173 00002000:00100000:2.0:1746143136.693223:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a5e3a680 x1830962858761600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.693229:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3a680 with x1830962858761600 ext(4194304->5210111) 00010000:00010000:2.0:1746143136.693234:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.693242:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:2.0:1746143136.693248:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e3a680 00000100:00100000:1.0:1746143136.702009:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.702203:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858761984 00000100:00100000:2.0:1746143136.702212:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858761984 00000100:00100000:2.0:1746143136.702321:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12659 00000100:00100000:2.0:1746143136.702330:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858761984:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143136.702350:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.702370:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dc77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508b8 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.702395:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.702407:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dc77 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b8 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.702419:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dc77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b8 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.702540:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7b400, rc 0) 00000100:00100000:2.0:1746143136.702695:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858761984:12345-192.168.201.28@tcp:101:cat.0 Request processed in 366us (804us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143136.702701:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12659 00000100:00100000:0.0:1746143136.708983:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.709418:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.709729:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858762240 00000100:00100000:3.0:1746143136.709738:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858762240 00000100:00100000:3.0:1746143136.709780:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12660 00000100:00100000:3.0:1746143136.709788:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:31082:x1830962858762240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143136.709807:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.709823:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508bf expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.709846:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.709849:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.709856:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.709871:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.709882:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090437c00, rc 0) 00000100:00100000:3.0:1746143136.711819:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:31082:x1830962858762240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2023us (2392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.711830:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12660 00000100:00100000:2.0:1746143136.712763:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858762112 00000100:00100000:2.0:1746143136.712771:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858762112 00010000:00010000:2.0:1746143136.712803:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.712839:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6715 00000100:00100000:2.0:1746143136.712845:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858762112:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.712857:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.712875:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.712885:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.712907:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b7ce00/0x25aee876ca70dc31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165089c expref: 27 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.712929:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.712959:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858762112:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 115us (3986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.712965:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6715 00000100:00100000:0.0:1746143136.713270:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858761856:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20250us (20436us total) trans 0 rc 1015808/1015808 00000100:00100000:0.0:1746143136.713279:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2019 00002000:00100000:0.0:1746143136.713288:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a5e3bb80 x1830962858761856/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143136.713298:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e3bb80 with x1830962858761856 ext(4194304->5210111) 00010000:00010000:0.0:1746143136.713304:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.713315:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:0.0:1746143136.713321:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5e3bb80 00000100:00100000:0.0:1746143136.721756:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.722019:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858762368 00000100:00100000:3.0:1746143136.722072:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858762368 00000100:00100000:3.0:1746143136.722118:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12661 00000100:00100000:3.0:1746143136.722126:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:31088:x1830962858762368:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143136.722144:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.722173:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508c6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.722206:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 40 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.722221:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 23 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143136.722229:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.722231:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.722234:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2908160->3145727] (req 2908160->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 40 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.722266:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 23 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143136.722278:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 23 pid: 26949 timeout: 1018 lvb_type: 1 00000100:00100000:3.0:1746143136.722291:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861297536:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.723643:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.723703:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858762496 00000100:00100000:0.0:1746143136.723707:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858762496 00000100:00100000:0.0:1746143136.723768:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12662 00000100:00100000:0.0:1746143136.723774:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858762496:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.723870:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.723884:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7000/0x25aee876ca70dc8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508cd expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.723900:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.723911:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7000/0x25aee876ca70dc8c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508cd expref: 27 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.723921:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7000/0x25aee876ca70dc8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508cd expref: 27 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.723948:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7a7000, rc 0) 00000100:00100000:1.0:1746143136.723984:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858762496:12345-192.168.201.28@tcp:101:cat.0 Request processed in 209us (345us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143136.723990:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12662 00010000:00010000:2.0:1746143136.724787:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 40 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.724804:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 40 pid: 26949 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.724815:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861297664:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.725058:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.727903:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.728826:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.729096:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858762624 00000100:00100000:1.0:1746143136.729104:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858762624 00000100:00100000:1.0:1746143136.729156:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12663 00000100:00100000:1.0:1746143136.729174:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858762624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.729193:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.729210:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dc93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508d4 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.729231:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.729242:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dc93 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508d4 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.729254:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dc93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508d4 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.729269:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7a7600, rc 0) 00000100:00100000:1.0:1746143136.729309:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858762624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 146us (1414us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143136.729315:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12663 00000100:00100000:2.0:1746143136.730244:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858762752 00000100:00100000:2.0:1746143136.730251:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858762752 00010000:00010000:2.0:1746143136.730272:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.730302:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6716 00000100:00100000:2.0:1746143136.730306:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858762752:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.730316:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.730344:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.730357:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.730374:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aeb3800/0x25aee876ca70dc2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650895 expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.730397:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.730399:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.730588:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.730597:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.730627:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.730638:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861297792:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143136.730685:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.731124:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.731662:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858763008 00000100:00100000:1.0:1746143136.731666:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858763008 00002000:00100000:1.0:1746143136.731696:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88009a249c00 x1830962858763008/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.731706:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a249c00 with x1830962858763008 ext(5206016->5210111) 00002000:00010000:1.0:1746143136.731710:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a249c00 00000100:00100000:1.0:1746143136.731724:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6174 00000100:00100000:1.0:1746143136.731730:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858763008:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.732606:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861297536:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.732622:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861297664:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.732648:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2908160->3145727] (req 2908160->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 40 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.732868:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858763008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 1136us (1744us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746143136.733225:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090437e00, rc 0) 00000100:00100000:2.0:1746143136.733276:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:31088:x1830962858762368:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11149us (11531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.733282:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12661 00000100:00100000:1.0:1746143136.733526:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6174 00002000:00100000:1.0:1746143136.733534:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88009a249c00 x1830962858763008/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.733542:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a249c00 with x1830962858763008 ext(5206016->5210111) 00002000:00010000:1.0:1746143136.733546:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a249c00 00000100:00100000:0.0:1746143136.737784:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.738018:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.738967:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861297792:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.738991:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.738992:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858763136 00000100:00100000:3.0:1746143136.738999:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858763136 00010000:00010000:3.0:1746143136.739043:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 40 pid: 26949 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.739046:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858762752:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 8738us (10220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.739055:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6716 00000100:00100000:2.0:1746143136.739075:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6717 00000100:00100000:2.0:1746143136.739080:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+40:1970:x1830962858763136:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.739093:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.739115:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 40 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.739130:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 40 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.739180:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f391000/0x25aee876ca70db43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650802 expref: 40 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.739197:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.739221:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1970:x1830962858763136:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 141us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.739226:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6717 00000100:00100000:2.0:1746143136.739283:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858763264 00000100:00100000:2.0:1746143136.739286:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858763264 00000100:00100000:2.0:1746143136.739308:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12664 00000100:00100000:2.0:1746143136.739319:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:31086:x1830962858763264:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143136.739331:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.739348:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508db expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.739367:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.739369:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.739377:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.739396:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.739594:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7bc00, rc 0) 00000100:00100000:2.0:1746143136.739611:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:31086:x1830962858763264:12345-192.168.201.28@tcp:101:cat.0 Request processed in 297us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.739623:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12664 00000100:00100000:0.0:1746143136.740452:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.740513:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.740571:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858763648 00000100:00100000:2.0:1746143136.740574:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858763648 00010000:00010000:2.0:1746143136.740591:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 24 pid: 26949 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143136.740607:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6718 00000100:00100000:2.0:1746143136.740612:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858763648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.740620:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.740631:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 24 pid: 26949 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.740639:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 24 pid: 26949 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.740653:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a357800/0x25aee876ca70db51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650817 expref: 24 pid: 26949 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.740672:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.740674:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.740679:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 38 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.740697:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 38 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.740731:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 38 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.740947:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861297920:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143136.740974:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858763520 00000100:00100000:1.0:1746143136.740978:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858763520 00002000:00100000:1.0:1746143136.741005:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2662400->2666495) req@ffff88009a248380 x1830962858763520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.741013:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248380 with x1830962858763520 ext(2662400->2666495) 00002000:00010000:1.0:1746143136.741017:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a248380 00000100:00100000:2.0:1746143136.741027:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.741045:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6175 00000100:00100000:1.0:1746143136.741050:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858763520:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143136.742101:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858763520:12345-192.168.201.28@tcp:3:cat.0 Request processed in 1047us (1650us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143136.742108:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6175 00002000:00100000:1.0:1746143136.742115:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2662400->2666495) req@ffff88009a248380 x1830962858763520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.742122:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248380 with x1830962858763520 ext(2662400->2666495) 00002000:00010000:1.0:1746143136.742124:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a248380 00000100:00100000:0.0:1746143136.742433:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.742497:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858763776 00000100:00100000:2.0:1746143136.742501:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858763776 00000100:00100000:2.0:1746143136.742537:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8216 00000100:00100000:2.0:1746143136.742543:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:31091:x1830962858763776:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143136.742561:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.742575:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b200/0x25aee876ca70dca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508e2 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.742628:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.742640:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.742651:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.742663:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.742672:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.742677:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.742986:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.742996:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 206 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.743002:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.743024:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 206 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.743058:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 206 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.743067:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861298048:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.743817:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.746768:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.746823:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.746876:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861297920:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143136.746897:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143136.746929:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858764160 00000100:00100000:1.0:1746143136.746936:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858764160 00000100:00100000:3.0:1746143136.746947:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858763904 00000100:00100000:3.0:1746143136.746951:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858763904 00002000:00100000:1.0:1746143136.746975:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2674688->2678783) req@ffff88009a24a680 x1830962858764160/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.746983:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24a680 with x1830962858764160 ext(2674688->2678783) 00000100:00100000:3.0:1746143136.746988:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12665 00002000:00010000:1.0:1746143136.746988:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a24a680 00000100:00100000:3.0:1746143136.746994:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858763904:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:1.0:1746143136.747002:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6176 00000100:00100000:1.0:1746143136.747006:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858764160:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:3.0:1746143136.747007:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.747022:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508e9 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.747063:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcbd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e9 expref: 29 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143136.747073:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e9 expref: 29 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143136.747085:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090437200, rc 0) 00000100:00100000:2.0:1746143136.747215:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858763648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6590us (6689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.747226:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6718 00000100:00100000:0.0:1746143136.747252:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.747333:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.747350:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861298048:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.747366:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000100:00100000:2.0:1746143136.747380:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858764544 00000100:00100000:2.0:1746143136.747383:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858764544 00010000:00010000:2.0:1746143136.747398:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 207 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.747412:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6719 00000100:00100000:2.0:1746143136.747416:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1970:x1830962858764544:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.747424:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.747428:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 207 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.747437:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 207 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.747452:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2e00/0x25aee876ca70dc3f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508a3 expref: 207 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.747463:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.747467:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747475:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747481:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747497:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.747512:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:1970:x1830962858764544:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 96us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.747517:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6719 00010000:00010000:2.0:1746143136.747528:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747533:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:2.0:1746143136.747572:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143136.747576:0:20619:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143136.747592:0:20619:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747600:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747608:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747614:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747619:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747624:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132f7b400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143136.747628:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747633:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747641:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143136.747644:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143136.747647:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747651:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b400/0x25aee876ca70dca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00000100:00100000:1.0:1746143136.747655:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858764160:12345-192.168.201.28@tcp:3:cat.0 Request processed in 647us (898us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746143136.747658:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747662:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00000100:00100000:1.0:1746143136.747665:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6176 00010000:00010000:2.0:1746143136.747666:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747670:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132f7ae00 already unused, calling callback (ffffffffa1347690) 00002000:00100000:1.0:1746143136.747671:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2674688->2678783) req@ffff88009a24a680 x1830962858764160/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143136.747672:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747676:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00002000:00100000:1.0:1746143136.747678:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a24a680 with x1830962858764160 ext(2674688->2678783) 00010000:00010000:2.0:1746143136.747680:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800931f2e00) 00010000:00010000:2.0:1746143136.747681:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:1.0:1746143136.747681:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a24a680 00010000:00010000:2.0:1746143136.747683:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.747686:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70dcaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00000100:00100000:1.0:1746143136.747692:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858764416 00000100:00100000:1.0:1746143136.747695:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858764416 00002000:00100000:1.0:1746143136.747707:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2908160->2912255) req@ffff88009a248a80 x1830962858764416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143136.747711:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b200/0x25aee876ca70dca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 8 pid: 20619 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143136.747714:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248a80 with x1830962858764416 ext(2908160->2912255) 00002000:00010000:1.0:1746143136.747717:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a248a80 00010000:00010000:2.0:1746143136.747720:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 7 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.747725:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.747727:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143136.747728:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7aa00, rc 0) 00000100:00100000:1.0:1746143136.747728:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6177 00000100:00100000:1.0:1746143136.747733:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1969:x1830962858764416:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.747743:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31091:x1830962858763776:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 5201us (5312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.747749:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8216 00000100:00100000:1.0:1746143136.747814:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1969:x1830962858764416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 79us (561us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143136.747819:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6177 00002000:00100000:1.0:1746143136.747823:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2908160->2912255) req@ffff88009a248a80 x1830962858764416/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.747830:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248a80 with x1830962858764416 ext(2908160->2912255) 00002000:00010000:1.0:1746143136.747832:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a248a80 00000100:00100000:3.0:1746143136.747926:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858763904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 932us (1102us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143136.747931:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12665 00000100:00100000:0.0:1746143136.750523:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.750605:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858764800 00000100:00100000:1.0:1746143136.750613:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858764800 00002000:00100000:1.0:1746143136.750652:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88009a249f80 x1830962858764800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.750668:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a249f80 with x1830962858764800 ext(5206016->5210111) 00002000:00010000:1.0:1746143136.750673:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a249f80 00000100:00100000:1.0:1746143136.750700:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6178 00000100:00100000:1.0:1746143136.750707:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858764800:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143136.750875:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858764800:12345-192.168.201.28@tcp:3:cat.0 Request processed in 168us (360us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143136.750881:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6178 00002000:00100000:1.0:1746143136.750886:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88009a249f80 x1830962858764800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.750894:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a249f80 with x1830962858764800 ext(5206016->5210111) 00002000:00010000:1.0:1746143136.750896:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a249f80 00000100:00100000:0.0:1746143136.751176:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.752334:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858765056 00000100:00100000:1.0:1746143136.752340:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858765056 00000100:00100000:0.0:1746143136.752361:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.752587:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3477 00000100:00100000:1.0:1746143136.752604:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:31090:x1830962858765056:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143136.752627:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858765184 00000100:00100000:3.0:1746143136.752632:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858765184 00000100:00100000:3.0:1746143136.752659:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12666 00000100:00100000:3.0:1746143136.752665:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:31088:x1830962858765184:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143136.752675:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.752693:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508f0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.752721:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.752729:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143136.752731:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143136.752734:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->3534847] (req 3145728->3534847) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 29 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.752773:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.752785:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.752796:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31090:x1830962858765056:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 201us (1618us total) trans 8589942432 rc 0/0 00000100:00100000:3.0:1746143136.752797:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861298176:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.752802:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3477 00000100:00100000:3.0:1746143136.752862:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.758915:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861298176:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143136.758949:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->3534847] (req 3145728->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 29 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.758970:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090437200, rc 0) 00000100:00100000:3.0:1746143136.759293:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:31088:x1830962858765184:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6624us (6929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.759302:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12666 00000100:00100000:0.0:1746143136.759596:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.760268:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.760287:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.760439:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.760478:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858765440 00000100:00100000:1.0:1746143136.760479:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.760485:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858765440 00000100:00100000:1.0:1746143136.760496:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858765568 00000100:00100000:1.0:1746143136.760500:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858765568 00000100:00100000:0.0:1746143136.760519:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12667 00000100:00100000:1.0:1746143136.760520:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858765696 00000100:00100000:1.0:1746143136.760522:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858765696 00000100:00100000:0.0:1746143136.760527:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858765440:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143136.760535:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858765824 00000100:00100000:1.0:1746143136.760536:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858765824 00010000:00010000:0.0:1746143136.760543:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143136.760548:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12668 00000100:00100000:1.0:1746143136.760553:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858765568:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143136.760560:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.760560:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508f7 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.760568:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16508fe expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.760580:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.760580:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.760582:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.760583:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.760590:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 12 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.760591:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.760603:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.760603:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 12 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.760618:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357200, rc 0) 00010000:00010000:1.0:1746143136.760626:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7a7800, rc 0) 00000100:00100000:0.0:1746143136.760645:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858765440:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 119us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.760651:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12667 00000100:00100000:0.0:1746143136.760664:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12669 00000100:00100000:0.0:1746143136.760670:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858765696:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143136.760678:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.760687:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a357e00/0x25aee876ca70dcd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650905 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.760707:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a357e00/0x25aee876ca70dcd9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650905 expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.760715:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a357e00/0x25aee876ca70dcd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650905 expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.760729:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357e00, rc 0) 00000100:00100000:0.0:1746143136.760745:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858765696:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 76us (306us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143136.760750:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12669 00000100:00100000:0.0:1746143136.760968:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12670 00000100:00100000:0.0:1746143136.760973:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858765824:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143136.760980:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.760986:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a357c00/0x25aee876ca70dce0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165090c expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.761022:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a249180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861298304:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143136.761088:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143136.761143:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858765312 00000100:00100000:2.0:1746143136.761148:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858765312 00010000:00010000:2.0:1746143136.761177:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.761197:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6720 00000100:00100000:2.0:1746143136.761202:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858765312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.761212:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.761234:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.761245:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.761259:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090437c00/0x25aee876ca70dc7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2678784->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508bf expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.761279:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.761280:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.761285:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.761293:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.761312:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.761322:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861298432:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143136.761344:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.761422:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858765568:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 866us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.761429:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12668 00000100:00100000:3.0:1746143136.764536:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861298432:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143136.764562:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.764601:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858765312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3397us (5005us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.764610:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6720 00002000:00010000:1.0:1746143136.764704:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143134 -> 1746143135 00002000:00010000:1.0:1746143136.764708:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143134 -> 1746143135 00002000:00010000:1.0:1746143136.764710:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143134 -> 1746143135 00000100:00100000:1.0:1746143136.764728:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a249180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861298304:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143136.764755:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a357c00/0x25aee876ca70dce0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165090c expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.764770:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a357c00/0x25aee876ca70dce0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165090c expref: 11 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.764783:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a357c00, rc 0) 00000100:00100000:1.0:1746143136.764806:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858765824:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 3833us (4327us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143136.764813:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12670 00000100:00100000:2.0:1746143136.769621:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.769703:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.769767:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858766080 00000100:00100000:1.0:1746143136.769776:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858766080 00002000:00100000:1.0:1746143136.769823:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3530752->3534847) req@ffff88008e80c380 x1830962858766080/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.769833:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c380 with x1830962858766080 ext(3530752->3534847) 00002000:00010000:1.0:1746143136.769840:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80c380 00000100:00100000:1.0:1746143136.769858:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6179 00000100:00100000:1.0:1746143136.769864:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858766080:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143136.770057:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858766080:12345-192.168.201.28@tcp:3:cat.0 Request processed in 191us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143136.770064:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6179 00002000:00100000:1.0:1746143136.770070:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3530752->3534847) req@ffff88008e80c380 x1830962858766080/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.770077:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c380 with x1830962858766080 ext(3530752->3534847) 00002000:00010000:1.0:1746143136.770080:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e80c380 00000100:00100000:3.0:1746143136.770147:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858766336 00000100:00100000:3.0:1746143136.770151:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858766336 00000100:00100000:3.0:1746143136.770189:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8217 00000100:00100000:3.0:1746143136.770194:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31091:x1830962858766336:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143136.770206:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.770223:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090437400/0x25aee876ca70dce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650913 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.770311:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.770332:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 8 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.770339:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.770601:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 8 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.770613:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.770623:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861298560:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.770672:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.773777:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861298560:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.773793:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143136.773799:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000100:00100000:2.0:1746143136.773879:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858766464 00000100:00100000:2.0:1746143136.773885:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858766464 00010000:00010000:2.0:1746143136.773915:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 9 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.773978:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6721 00000100:00100000:2.0:1746143136.773986:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858766464:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.773998:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.774004:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 9 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.774020:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 9 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.774065:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7aa00/0x25aee876ca70dcb6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508e2 expref: 9 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.774153:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.774169:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.774179:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.774186:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.774210:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.774244:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858766464:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 258us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.774250:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6721 00000100:00100000:0.0:1746143136.774257:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143136.774298:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.774305:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:3.0:1746143136.774328:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143136.774699:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090437400/0x25aee876ca70dce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650913 expref: 9 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.774763:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858766720 00000100:00100000:1.0:1746143136.774768:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858766720 00000100:00100000:1.0:1746143136.774792:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3478 00000100:00100000:1.0:1746143136.774796:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:31088:x1830962858766720:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143136.774898:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31088:x1830962858766720:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 101us (640us total) trans 8589942434 rc 0/0 00000100:00100000:1.0:1746143136.774903:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3478 00010000:00010000:3.0:1746143136.775176:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650913 expref: 8 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.775184:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143136.775186:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143136.775188:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090437a00, rc 0) 00000100:00100000:3.0:1746143136.775423:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31091:x1830962858766336:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 5226us (5717us total) trans 8589942433 rc 0/0 00000100:00100000:3.0:1746143136.775430:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8217 00000100:00100000:2.0:1746143136.779192:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143136.779490:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858766976 00000100:00100000:3.0:1746143136.779498:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858766976 00000100:00100000:3.0:1746143136.779549:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8218 00000100:00100000:3.0:1746143136.779557:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31091:x1830962858766976:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143136.779586:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.779589:0:20619:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143136.779615:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090437a00/0x25aee876ca70dcee lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650913 expref: 8 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.779630:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143136.779634:0:20619:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143136.779645:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090437800/0x25aee876ca70dcfc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165091a expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.779741:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.779753:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143136.779762:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:3.0:1746143136.779774:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143136.779886:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090437800/0x25aee876ca70dcfc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 10 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.779897:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 9 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.779904:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143136.779907:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143136.779908:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090437600, rc 0) 00000100:00100000:3.0:1746143136.779951:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31091:x1830962858766976:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 395us (770us total) trans 8589942435 rc 0/0 00000100:00100000:3.0:1746143136.779957:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8218 00000100:00100000:0.0:1746143136.783268:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.783335:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858767104 00000100:00100000:2.0:1746143136.783348:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858767104 00000100:00100000:2.0:1746143136.783401:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8219 00000100:00100000:2.0:1746143136.783408:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31091:x1830962858767104:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143136.783429:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.783447:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ba00/0x25aee876ca70dd11 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650921 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.783510:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ba00/0x25aee876ca70dd11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650921 expref: 10 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.783523:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ba00/0x25aee876ca70dd11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650921 expref: 10 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.783541:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.783544:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143136.783546:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7ba00, rc 0) 00000100:00100000:2.0:1746143136.783587:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:31091:x1830962858767104:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 180us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.783593:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8219 00000100:00100000:0.0:1746143136.786258:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.786289:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.786305:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.786331:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.786341:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.786375:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.786558:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858767232 00000100:00100000:2.0:1746143136.786565:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858767232 00000100:00100000:2.0:1746143136.786612:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858767360 00000100:00100000:2.0:1746143136.786615:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858767360 00000100:00100000:2.0:1746143136.786626:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858767488 00000100:00100000:2.0:1746143136.786628:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858767488 00000100:00100000:2.0:1746143136.786645:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858767616 00000100:00100000:2.0:1746143136.786647:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858767616 00000100:00100000:2.0:1746143136.786664:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12671 00000100:00100000:2.0:1746143136.786671:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1968:x1830962858767232:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143136.786724:0:22204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.786750:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 11 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.786763:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 28 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.786770:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.786781:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.786783:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.786786:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.786806:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858767744 00000100:00100000:0.0:1746143136.786819:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858767744 00010000:00010000:2.0:1746143136.786823:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.786842:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 24 pid: 26949 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.786854:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861298688:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.786865:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858767872 00000100:00100000:0.0:1746143136.786868:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858767872 00000100:00100000:0.0:1746143136.786887:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12672 00000100:00100000:0.0:1746143136.786895:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858767360:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143136.786936:0:4756:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.786953:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.786954:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 28 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.786962:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 12 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.786964:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 28 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.786975:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 38 pid: 8448 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143136.786979:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861298816:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.786981:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.786982:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.786985:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.787011:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 38 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.787016:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 12 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.787022:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 38 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.787054:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 12 pid: 4756 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143136.787061:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861298944:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.787064:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861299072:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.787103:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145f180 going to sleep for 11 seconds 00010000:00010000:0.0:1746143136.787122:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 12 pid: 8169 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143136.787127:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12673 00010000:00010000:0.0:1746143136.787131:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 12 pid: 8169 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143136.787133:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858767488:12345-192.168.201.28@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143136.787133:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12674 00000100:00100000:0.0:1746143136.787138:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861299200:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.787140:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858767616:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143136.787156:0:8169:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.787173:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 22 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.787178:0:8448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.787185:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 22 pid: 8448 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.787188:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.787193:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861299328:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.787195:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.787208:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 38 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.787211:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143136.787213:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.787215:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.787217:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.787224:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.787231:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.787233:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12675 00010000:00010000:2.0:1746143136.787238:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 38 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.787238:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 28 pid: 21048 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143136.787239:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858767744:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143136.787243:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.787245:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.787247:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 38 pid: 8169 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.787247:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.787256:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861299456:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.787258:0:754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.787260:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 28 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.787268:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.787271:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 28 pid: 21048 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.787276:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143136.787280:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861299584:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.787282:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.787283:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.787289:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.787289:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746143136.787290:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746143136.787292:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.787296:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861299712:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.787301:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.787306:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.787308:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 24 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.787313:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.787315:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.787316:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861299840:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.787321:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 22 pid: 8169 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.787324:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861299968:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.787329:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861300096:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143136.787332:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.787339:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 12 pid: 4758 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143136.787344:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.787346:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861300224:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.787348:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.787356:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.787357:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136909180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.787363:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861300352:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.787384:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.787391:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 24 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.787398:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861300480:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.787410:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143136.787426:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12676 00000100:00100000:3.0:1746143136.787440:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858767872:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143136.787458:0:21048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.787469:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 38 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.787475:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143136.787476:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143136.787479:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.787495:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 38 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.787508:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 38 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.787515:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861300608:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.787533:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143136.789386:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861298688:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.789400:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861298816:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.797394:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861298944:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.797449:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861299072:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.797474:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861299200:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143136.797479:0:22204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.797505:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861299328:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.797524:0:4756:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.797691:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.797709:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858768000 00000100:00100000:2.0:1746143136.797715:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858768000 00010000:00010000:2.0:1746143136.797741:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 39 pid: 8448 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143136.797762:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6722 00000100:00100000:2.0:1746143136.798017:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1970:x1830962858768000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.798045:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.798065:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 39 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.798074:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 39 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.798091:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a357600/0x25aee876ca70dc0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650879 expref: 39 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.798117:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.798236:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861300608:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.798245:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.798246:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861299968:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143136.798247:0:21048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.798255:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861300352:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.798261:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:754:1830962861300480:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.798271:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861299456:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.798276:0:754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143136.798279:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861299712:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.798285:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861300096:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143136.798296:0:8448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.798299:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861299584:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.798305:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861299840:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143136.798309:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.798311:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861300224:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.798332:0:8169:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.798346:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858768256 00000100:00100000:0.0:1746143136.798349:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858768256 00000100:00100000:1.0:1746143136.798354:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143136.798360:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 13 pid: 8169 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143136.798379:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858768128 00000100:00100000:0.0:1746143136.798381:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858768128 00010000:00010000:0.0:1746143136.798390:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 13 pid: 4756 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143136.798404:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6723 00000100:00100000:0.0:1746143136.798409:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858768256:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143136.798411:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6724 00010000:00010000:0.0:1746143136.798416:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143136.798417:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1970:x1830962858768128:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.798424:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.798425:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 13 pid: 8169 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.798432:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 13 pid: 8169 timeout: 1018 lvb_type: 1 00010000:00010000:3.0:1746143136.798436:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 13 pid: 4756 timeout: 1018 lvb_type: 1 00010000:00010000:3.0:1746143136.798443:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 13 pid: 4756 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.798444:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a357200/0x25aee876ca70dccb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f7 expref: 13 pid: 8169 timeout: 1018 lvb_type: 1 00010000:00010000:3.0:1746143136.798454:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009532c400/0x25aee876ca70d9e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165074c expref: 13 pid: 4756 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.798455:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143136.798464:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.798492:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1970:x1830962858768128:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 75us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.798497:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6724 00000100:00100000:0.0:1746143136.798729:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1970:x1830962858768256:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 318us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.798735:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6723 00000100:00100000:2.0:1746143136.799144:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1970:x1830962858768000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1375us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.799151:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6722 00000100:00100000:1.0:1746143136.799169:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.799200:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858768384 00000100:00100000:2.0:1746143136.799203:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858768384 00000100:00100000:1.0:1746143136.799205:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143136.799215:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 23 pid: 8448 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.799241:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858769280 00000100:00100000:2.0:1746143136.799244:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858769280 00010000:00010000:2.0:1746143136.799254:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 25 pid: 26949 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.799266:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6725 00000100:00100000:2.0:1746143136.799271:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858768384:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.799276:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.799284:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 23 pid: 8448 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.799291:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 23 pid: 8448 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.799301:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b97fc00/0x25aee876ca70dbf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165086b expref: 23 pid: 8448 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.799314:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.799316:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.799319:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.799325:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.799342:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143136.799354:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.799360:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858768384:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.799365:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6725 00000100:00100000:2.0:1746143136.799374:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858768640 00000100:00100000:2.0:1746143136.799377:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858768640 00010000:00010000:2.0:1746143136.799386:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 29 pid: 21048 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143136.799395:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6726 00000100:00100000:2.0:1746143136.799398:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858769280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.799404:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.799606:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 25 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.799613:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 25 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.799628:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b806e00/0x25aee876ca70db4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650809 expref: 25 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.799637:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.799652:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858769280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 253us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.799657:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6726 00000100:00100000:2.0:1746143136.799667:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6727 00000100:00100000:2.0:1746143136.799671:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858768640:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.799677:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.799683:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 29 pid: 21048 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.799691:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 29 pid: 21048 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.799700:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b807200/0x25aee876ca70db12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507d1 expref: 29 pid: 21048 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.799708:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143136.799709:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.799725:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858768640:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 53us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.799730:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6727 00000100:00100000:2.0:1746143136.799738:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858768896 00000100:00100000:2.0:1746143136.799740:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858768896 00010000:00010000:2.0:1746143136.799749:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143136.799758:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6728 00000100:00100000:2.0:1746143136.799763:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858768896:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.799768:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.799775:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.799782:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.799980:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7a7800/0x25aee876ca70dcd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508fe expref: 12 pid: 8448 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143136.799988:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143136.800018:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.800056:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.800079:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.800095:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.800108:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.800116:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858769408 00000100:00100000:1.0:1746143136.800119:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.800119:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858769408 00010000:00010000:0.0:1746143136.800131:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 12 pid: 4758 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143136.800138:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.800142:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858769024 00000100:00100000:0.0:1746143136.800144:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858769024 00010000:00010000:0.0:1746143136.800151:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 38 pid: 8169 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.800155:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858768768 00000100:00100000:0.0:1746143136.800169:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858769792 00000100:00100000:1.0:1746143136.800170:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858768768 00000100:00100000:0.0:1746143136.800171:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858769792 00010000:00010000:0.0:1746143136.800180:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 28 pid: 22204 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143136.800188:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858768512 00000100:00100000:0.0:1746143136.800190:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858768512 00010000:00010000:0.0:1746143136.800198:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 25 pid: 26949 timeout: 1018 lvb_type: 0 00002000:00100000:1.0:1746143136.800206:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2662400->2678783) req@ffff8800906a6a00 x1830962858768768/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 16872/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143136.800210:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858769152 00000100:00100000:0.0:1746143136.800212:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858769152 00002000:00100000:1.0:1746143136.800215:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6a00 with x1830962858768768 ext(2662400->2678783) 00010000:00010000:0.0:1746143136.800221:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 29 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.800222:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.800230:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6729 00010000:00010000:1.0:1746143136.800233:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.800235:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858769408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00002000:00010000:1.0:1746143136.800238:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a6a00 00010000:00010000:0.0:1746143136.800240:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.800253:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 12 pid: 4758 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143136.800257:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858769664 00000100:00100000:1.0:1746143136.800260:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858769664 00010000:00010000:0.0:1746143136.800261:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 12 pid: 4758 timeout: 1018 lvb_type: 1 00002000:00100000:1.0:1746143136.800270:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2908160->3145727) req@ffff88012b802680 x1830962858769664/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746143136.800271:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e935800/0x25aee876ca70d9fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650761 expref: 12 pid: 4758 timeout: 1018 lvb_type: 1 00002000:00100000:1.0:1746143136.800277:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802680 with x1830962858769664 ext(2908160->3145727) 00010000:00010000:0.0:1746143136.800279:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.800280:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.800281:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.800283:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.800288:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.800289:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:1.0:1746143136.800295:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b802680 00010000:00010000:0.0:1746143136.800302:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143136.800303:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2020 00000100:00100000:1.0:1746143136.800308:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858768768:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143136.800324:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858769408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 89us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.800330:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6729 00000100:00100000:0.0:1746143136.800340:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6730 00000100:00100000:0.0:1746143136.800345:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1968:x1830962858769024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.800350:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.800358:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 39 pid: 8169 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.800365:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 39 pid: 8169 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.800375:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8f4600/0x25aee876ca70dc23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165088e expref: 39 pid: 8169 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.800381:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.800396:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1968:x1830962858769024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 51us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.800400:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6730 00000100:00100000:0.0:1746143136.800409:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6731 00000100:00100000:0.0:1746143136.800414:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858769792:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.800419:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.800426:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 29 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.800432:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 29 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.800441:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e7d7200/0x25aee876ca70dafd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507bc expref: 29 pid: 22204 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143136.800448:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.800461:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858769792:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.800465:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6731 00000100:00100000:0.0:1746143136.800473:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6732 00000100:00100000:0.0:1746143136.800477:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858768512:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.800483:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.800490:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 25 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.800497:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 25 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.800505:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b806600/0x25aee876ca70dab7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650792 expref: 25 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.800512:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.800514:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.800516:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.800521:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143136.800581:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6733 00000100:00100000:3.0:1746143136.800586:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858769152:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.800592:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143136.800611:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858769536 00000100:00100000:3.0:1746143136.800614:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858769536 00002000:00100000:3.0:1746143136.800637:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3534847) req@ffff88008e190380 x1830962858769536/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.800648:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190380 with x1830962858769536 ext(3145728->3534847) 00010000:00010000:3.0:1746143136.800653:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.800660:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00002000:00010000:3.0:1746143136.800665:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e190380 00010000:00010000:3.0:1746143136.800682:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.800682:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858768768:12345-192.168.201.28@tcp:4:cat.0 Request processed in 373us (2443us total) trans 21474840087 rc 0/0 00000100:00100000:1.0:1746143136.800688:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2020 00010000:00010000:3.0:1746143136.800690:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00100000:1.0:1746143136.800694:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (2662400->2678783) req@ffff8800906a6a00 x1830962858768768/t21474840087(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 16872/448 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143136.800699:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132f7bc00/0x25aee876ca70dc9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [5206016->18446744073709551615] (req 5206016->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508db expref: 28 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00100000:1.0:1746143136.800701:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a6a00 with x1830962858768768 ext(2662400->2678783) 00010000:00010000:1.0:1746143136.800705:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.800709:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143136.800713:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 26 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:1.0:1746143136.800718:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800906a6a00 00000100:00100000:3.0:1746143136.800727:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858769152:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 141us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.800732:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6733 00000100:00100000:1.0:1746143136.800732:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2021 00000100:00100000:1.0:1746143136.800737:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+37:1970:x1830962858769664:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143136.800751:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2022 00000100:00100000:3.0:1746143136.800756:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858769536:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143136.801096:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858768896:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 240us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.801104:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6728 00010000:00010000:2.0:1746143136.801143:0:4756:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.801564:0:4756:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.801582:0:4756:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.801592:0:4756:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.801597:0:4756:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.801602:0:4756:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091b7da00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143136.801605:0:4756:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.801607:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143136.801610:0:4756:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.801618:0:4756:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.801623:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b7da00/0x25aee876ca70dd1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.801628:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858768512:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1149us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.801634:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6732 00010000:00010000:0.0:1746143136.801654:0:8169:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.801657:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858767360:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 14763us (15366us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143136.801660:0:8169:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.801664:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12672 00010000:00010000:0.0:1746143136.801673:0:8169:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.801679:0:8169:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.801684:0:8169:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.801689:0:8169:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7a7600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143136.801691:0:8169:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.801697:0:8169:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.801709:0:8169:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.801715:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7a7600/0x25aee876ca70dd26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.801719:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.801747:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858767616:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 14608us (15414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.801753:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12674 00000100:00100000:0.0:1746143136.801769:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858769920 00000100:00100000:0.0:1746143136.801772:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858769920 00010000:00010000:0.0:1746143136.801964:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 22 pid: 8169 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.802153:0:22204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.802177:0:22204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.802189:0:22204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.802195:0:22204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.802201:0:22204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.802205:0:22204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132f7a400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143136.802208:0:22204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.802214:0:22204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.802222:0:22204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.802228:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132f7a400/0x25aee876ca70dd18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143136.802256:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858767232:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 15586us (16006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.802263:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12671 00000100:00100000:0.0:1746143136.804148:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6734 00000100:00100000:0.0:1746143136.804169:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858769920:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.804181:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.804194:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 22 pid: 8169 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.804203:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 22 pid: 8169 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.804216:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b7d000/0x25aee876ca70dc1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650887 expref: 22 pid: 8169 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.804230:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.804231:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.804234:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.804240:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.804267:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143136.804761:0:8448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.804769:0:8448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.804783:0:8448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.804789:0:8448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.804795:0:8448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.804801:0:8448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090152000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143136.804804:0:8448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.804809:0:8448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.804818:0:8448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.804823:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090152000/0x25aee876ca70dd2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143136.806388:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858767488:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 19250us (20076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.806396:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12673 00000100:00100000:0.0:1746143136.806710:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858769920:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2552us (4987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.806717:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6734 00000100:00100000:1.0:1746143136.807403:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.808313:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858770048 00000100:00100000:0.0:1746143136.808321:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858770048 00010000:00010000:0.0:1746143136.808350:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.808381:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6735 00000100:00100000:0.0:1746143136.808388:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1971:x1830962858770048:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.808398:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.808412:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.808421:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.808444:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b7c800/0x25aee876ca70dc70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [2662400->2678783] (req 2662400->2678783) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508b1 expref: 25 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.808623:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.808656:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1971:x1830962858770048:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 269us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.808662:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6735 00000100:00100000:2.0:1746143136.817607:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858769536:12345-192.168.201.28@tcp:4:cat.0 Request processed in 16842us (17519us total) trans 21474840088 rc 0/0 00000100:00100000:2.0:1746143136.817617:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2022 00002000:00100000:2.0:1746143136.817629:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3534847) req@ffff88008e190380 x1830962858769536/t21474840088(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/448 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.817638:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190380 with x1830962858769536 ext(3145728->3534847) 00010000:00010000:2.0:1746143136.817647:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.817658:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00002000:00010000:2.0:1746143136.817664:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e190380 00000100:00100000:0.0:1746143136.817698:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1970:x1830962858769664:12345-192.168.201.28@tcp:4:cat.0 Request processed in 16959us (17640us total) trans 17179872824 rc 0/0 00000100:00100000:0.0:1746143136.817706:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2021 00002000:00100000:0.0:1746143136.817711:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2908160->3145727) req@ffff88012b802680 x1830962858769664/t17179872824(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:287/0 lens 488/448 e 0 to 0 dl 1746143147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143136.817719:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802680 with x1830962858769664 ext(2908160->3145727) 00010000:00010000:0.0:1746143136.817725:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.817735:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00002000:00010000:0.0:1746143136.817740:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b802680 00000100:00100000:0.0:1746143136.819684:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.819752:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.819803:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858770176 00000100:00100000:1.0:1746143136.819810:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858770176 00010000:00010000:1.0:1746143136.819837:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.819859:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858770304 00000100:00100000:1.0:1746143136.819862:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858770304 00010000:00010000:1.0:1746143136.819872:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.819885:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6736 00000100:00100000:1.0:1746143136.819891:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1971:x1830962858770176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143136.819901:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143136.819916:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.819924:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.819942:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090437200/0x25aee876ca70dcc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->5206015] (req 3145728->3534847) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508f0 expref: 28 pid: 26949 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.819956:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.819957:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.819961:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.819968:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.819990:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.820008:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6737 00000100:00100000:2.0:1746143136.820014:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+39:1971:x1830962858770304:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143136.820015:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858770176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.820020:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6736 00010000:00010000:2.0:1746143136.820021:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.820045:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.820053:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.820064:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090437e00/0x25aee876ca70dc85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508c6 expref: 39 pid: 8449 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.820079:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.820080:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.820083:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.820093:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.820104:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143136.820134:0:21048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.820142:0:21048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.820150:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+38:1971:x1830962858770304:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.820155:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6737 00010000:00010000:3.0:1746143136.820157:0:21048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.820172:0:21048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.820179:0:21048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.820185:0:21048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090437000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143136.820188:0:21048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.820195:0:21048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.820205:0:21048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.820209:0:754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.820211:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090437000/0x25aee876ca70dd3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143136.820247:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858767872:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 32814us (33871us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.820254:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12676 00010000:00010000:0.0:1746143136.820305:0:754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.820318:0:754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.820323:0:754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.820329:0:754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.820333:0:754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091b7d200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143136.820335:0:754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.820340:0:754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.820348:0:754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.820353:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b7d200/0x25aee876ca70dd34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.820387:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858767744:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 33149us (34044us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.820393:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12675 00000100:00100000:0.0:1746143136.822787:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.822831:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858770560 00000100:00100000:2.0:1746143136.822836:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858770560 00000100:00100000:2.0:1746143136.822866:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8220 00000100:00100000:2.0:1746143136.822870:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:31091:x1830962858770560:12345-192.168.201.28@tcp:36:mirror_io.0 00010000:00010000:2.0:1746143136.822901:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.822913:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ba00/0x25aee876ca70dd11 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650921 expref: 10 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.822923:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.822925:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143136.822942:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143136.822949:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 206 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.822953:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 15 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.822956:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 206 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.822960:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.822964:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 206 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.822967:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.822970:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143136.822987:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.822993:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 15 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.823002:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861300736:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.823332:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 206 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.823506:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 206 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.823586:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861300864:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.824048:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.824055:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 15 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.824060:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861300992:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.824090:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 206 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.824097:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 206 pid: 17079 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.824104:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861301120:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.824130:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 15 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.824137:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 15 pid: 1037 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.824143:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861301248:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.824176:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 206 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.824182:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 206 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.824189:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861301376:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.824208:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b145f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.825546:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.825635:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861300736:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.825845:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858770688 00000100:00100000:3.0:1746143136.825851:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858770688 00010000:00010000:3.0:1746143136.825874:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 16 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:3.0:1746143136.826138:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6738 00000100:00100000:3.0:1746143136.826146:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858770688:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.826155:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143136.826170:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 16 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.826178:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 16 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.826194:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b000/0x25aee876ca70dc62 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16508aa expref: 16 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.826207:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143136.826212:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143136.826223:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.826258:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858770688:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 112us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.826264:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6738 00000100:00100000:2.0:1746143136.828053:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861300864:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.828064:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861300992:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143136.828121:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.828144:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.828179:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858771072 00000100:00100000:2.0:1746143136.828184:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858771072 00000100:00100000:2.0:1746143136.828210:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858771200 00000100:00100000:2.0:1746143136.828212:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858771200 00000100:00100000:2.0:1746143136.828225:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3479 00000100:00100000:2.0:1746143136.828231:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:15437:x1830962858771072:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143136.828378:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:15437:x1830962858771072:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 145us (366us total) trans 8589942436 rc 0/0 00000100:00100000:2.0:1746143136.828384:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3479 00000100:00100000:2.0:1746143136.828395:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3480 00000100:00100000:2.0:1746143136.828399:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:30386:x1830962858771200:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143136.828457:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:30386:x1830962858771200:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 56us (312us total) trans 8589942437 rc 0/0 00000100:00100000:2.0:1746143136.828461:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3480 00000100:00100000:3.0:1746143136.828732:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861301120:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.828740:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861301248:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143136.828747:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861301376:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143136.828774:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143136.828940:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.828959:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858771328 00000100:00100000:2.0:1746143136.828962:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858771328 00010000:00010000:2.0:1746143136.828974:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 208 pid: 17079 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.829001:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6739 00000100:00100000:2.0:1746143136.829006:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:1968:x1830962858771328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.829015:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.829019:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 208 pid: 17079 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.829028:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 208 pid: 17079 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.829060:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a357400/0x25aee876ca70daf6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507b5 expref: 208 pid: 17079 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.829071:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.829074:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143136.829081:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.829105:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1968:x1830962858771328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 98us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.829110:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6739 00000100:00100000:1.0:1746143136.830077:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.830177:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.830379:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858771456 00000100:00100000:2.0:1746143136.830383:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858771456 00010000:00010000:2.0:1746143136.830397:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 16 pid: 1037 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.830417:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858771584 00000100:00100000:2.0:1746143136.830419:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858771584 00010000:00010000:2.0:1746143136.830426:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 207 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.830436:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6740 00000100:00100000:2.0:1746143136.830441:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858771456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.830448:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.830451:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 16 pid: 1037 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.830459:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 16 pid: 1037 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.830470:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba7aa00/0x25aee876ca70daef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16507ae expref: 16 pid: 1037 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.830476:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.830479:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143136.830483:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.830499:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858771456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 59us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.830502:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6740 00000100:00100000:2.0:1746143136.830510:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6741 00000100:00100000:2.0:1746143136.830512:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1968:x1830962858771584:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143136.830516:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143136.830519:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 207 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.830526:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 207 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.830538:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f390200/0x25aee876ca70dac5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650799 expref: 207 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:2.0:1746143136.830545:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.830547:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143136.830552:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143136.830564:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:1968:x1830962858771584:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 50us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.830569:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6741 00000100:00100000:0.0:1746143136.831111:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.831143:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.831371:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858771840 00000100:00100000:1.0:1746143136.831375:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858771840 00010000:00010000:1.0:1746143136.831396:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 206 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.831410:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858771712 00000100:00100000:1.0:1746143136.831412:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858771712 00010000:00010000:1.0:1746143136.831586:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 15 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.832249:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6742 00000100:00100000:1.0:1746143136.832257:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:1969:x1830962858771840:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143136.832265:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143136.832269:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 206 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.832283:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 206 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.832298:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091b7d600/0x25aee876ca70dc00 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650872 expref: 206 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.832320:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.832323:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143136.832330:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.832570:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6743 00000100:00100000:3.0:1746143136.832584:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858771712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143136.832592:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143136.832596:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 15 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.832604:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 15 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.832615:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b97f400/0x25aee876ca70dbd6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650856 expref: 15 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:3.0:1746143136.832624:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143136.832627:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143136.832636:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143136.832641:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143136.832657:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143136.832689:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858771712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 112us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.832694:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6743 00010000:00010000:3.0:1746143136.832716:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143136.832721:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:1.0:1746143136.832803:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:1969:x1830962858771840:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 547us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.832809:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6742 00000040:00080000:3.0:1746143136.835364:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2424, 88 off206032 00000004:00080000:3.0:1746143136.835378:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918675341871ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.835697:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2437, 88 off206912 00000004:00080000:3.0:1746143136.835704:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918675672166ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143136.836365:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2438, 88 off207000 00000004:00080000:3.0:1746143136.836369:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918676337627ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143136.836377:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2425, 88 off206120 00000004:00080000:3.0:1746143136.836380:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918676348274ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.836391:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2426, 88 off206208 00000004:00080000:3.0:1746143136.836393:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918676361656ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.836401:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2439, 88 off207088 00000004:00080000:3.0:1746143136.836403:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918676371922ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143136.836409:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2440, 88 off207176 00000004:00080000:3.0:1746143136.836411:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918676379859ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143136.836416:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2441, 88 off207264 00000004:00080000:3.0:1746143136.836418:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918676386661ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143136.836423:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2427, 88 off206296 00000004:00080000:3.0:1746143136.836424:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918676392989ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.836432:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2442, 88 off207352 00000004:00080000:3.0:1746143136.836433:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918676402082ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143136.836438:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2428, 88 off206384 00000004:00080000:3.0:1746143136.836440:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918676408689ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.836447:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2443, 88 off207440 00000004:00080000:3.0:1746143136.836449:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918676417472ns, next at 860119223596ns, rc = 0 00000040:00080000:3.0:1746143136.836454:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2429, 88 off206472 00000004:00080000:3.0:1746143136.836455:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918676423952ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.836462:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2430, 88 off206560 00000004:00080000:3.0:1746143136.836464:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918676432902ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.836471:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2431, 88 off206648 00000004:00080000:3.0:1746143136.836473:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918676441729ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.836480:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2432, 88 off206736 00000004:00080000:3.0:1746143136.836482:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918676450685ns, next at 860071159912ns, rc = 0 00000040:00080000:3.0:1746143136.836489:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2444, 88 off207528 00000004:00080000:3.0:1746143136.836491:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918676459557ns, next at 860119223596ns, rc = 0 00000100:00100000:0.0:1746143136.875626:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.875649:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858772096 00000100:00100000:0.0:1746143136.875655:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858772096 00000100:00100000:0.0:1746143136.875684:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8221 00000100:00100000:0.0:1746143136.875690:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31098:x1830962858772096:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.875706:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.875718:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3e00/0x25aee876ca70dd49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650928 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.875785:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.875794:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.875800:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.875810:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.876000:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.876006:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.907984:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.908007:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858772352 00000100:00100000:0.0:1746143136.908014:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858772352 00000100:00100000:0.0:1746143136.908056:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8222 00000100:00100000:0.0:1746143136.908062:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:31100:x1830962858772352:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143136.908080:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.908094:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132009200/0x25aee876ca70dd5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165092f expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.908691:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.908703:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.908712:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.908721:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.908726:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.908731:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000001:00080000:0.0:1746143136.908877:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942430 is committed 00000001:00080000:0.0:1746143136.908886:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942434 is committed 00000004:00010000:2.0:1746143136.908890:0:14794:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012baa2300 reply state ffff880094e5a800 transno 8589942438 ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000001:00080000:0.0:1746143136.908891:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942432 is committed 00000100:00100000:2.0:1746143136.908897:0:14794:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746143136.908899:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942437 is committed 00000001:00080000:0.0:1746143136.908903:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942436 is committed 00000001:00080000:0.0:1746143136.908912:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942438 is committed 00000004:00080000:0.0:1746143136.908915:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1861 committed 00000004:00080000:0.0:1746143136.908922:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1854 committed 00000004:00080000:0.0:1746143136.908926:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1853 committed 00000004:00080000:0.0:1746143136.908928:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1852 committed 00000004:00080000:0.0:1746143136.908929:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1851 committed 00000004:00080000:0.0:1746143136.908930:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1860 committed 00000004:00080000:0.0:1746143136.908931:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1850 committed 00000004:00080000:0.0:1746143136.908933:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1859 committed 00000004:00080000:0.0:1746143136.908934:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1849 committed 00000004:00080000:0.0:1746143136.908935:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1858 committed 00000004:00080000:0.0:1746143136.908936:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1857 committed 00000004:00080000:0.0:1746143136.908938:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1856 committed 00000004:00080000:0.0:1746143136.908939:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1848 committed 00000004:00080000:0.0:1746143136.908940:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1847 committed 00000004:00080000:0.0:1746143136.908942:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1855 committed 00000004:00080000:0.0:1746143136.908943:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1854 committed 00000004:00080000:0.0:1746143136.908944:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1846 committed 00010000:00080000:2.0:1746143136.908955:0:14794:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143136.908964:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31091:x1830962858770560:12345-192.168.201.28@tcp:36:mirror_io.0 Request processed in 86092us (86187us total) trans 8589942438 rc 0/0 00000100:00100000:2.0:1746143136.908970:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8220 00010000:00010000:2.0:1746143136.908993:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909000:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909006:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:2.0:1746143136.909014:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143136.909120:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.909120:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861301632:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143136.909126:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909131:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909135:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090153400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143136.909138:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909144:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909152:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00000100:00100000:0.0:1746143136.909154:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143136.909155:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143136.909170:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909175:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090153400/0x25aee876ca70dd73 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909185:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909189:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909193:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909197:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aeb2800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143136.909198:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.909200:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861302144:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143136.909207:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909213:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00000100:00100000:0.0:1746143136.909214:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143136.909215:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143136.909217:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909221:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb2800/0x25aee876ca70dd50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.909224:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861302656:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143136.909229:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909233:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.909235:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143136.909238:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909242:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aeb3600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143136.909244:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.909245:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861303168:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143136.909248:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.909253:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f413900) 00010000:00010000:2.0:1746143136.909255:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143136.909257:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.909257:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143136.909261:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3600/0x25aee876ca70dd57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00000100:00100000:0.0:1746143136.909269:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746143136.909272:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861301504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.909285:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143136.909289:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3e00/0x25aee876ca70dd49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650928 expref: 8 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143136.909294:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861302016:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143136.909296:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aeb3e00/0x25aee876ca70dd49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650928 expref: 8 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.909303:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aeb3e00, rc 0) 00000100:00100000:0.0:1746143136.909306:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143136.909317:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861302528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143136.909321:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:31098:x1830962858772096:12345-192.168.201.28@tcp:101:cat.0 Request processed in 33632us (33702us total) trans 8589942439 rc 301/301 00000100:00100000:2.0:1746143136.909327:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8221 00000100:00100000:0.0:1746143136.909329:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143136.909338:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861303040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143136.909349:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143136.909364:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861301760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.909377:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143136.909387:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861302272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.909398:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143136.909407:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861302784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143136.909419:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143136.909428:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861303296:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143136.909431:0:3285:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143136.909437:0:3285:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143136.909438:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143136.909442:0:3285:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143136.909446:0:3285:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090153600 already unused, calling callback (ffffffffa1347690) 00000100:00100000:0.0:1746143136.909447:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00010000:00010000:2.0:1746143136.909448:0:3285:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143136.909450:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861301888:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143136.909453:0:3285:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143136.909460:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00000100:00100000:0.0:1746143136.909461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143136.909462:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143136.909464:0:3285:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143136.909637:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861302400:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143136.909640:0:3285:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090153600/0x25aee876ca70dd42 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143136.909650:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143136.909657:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861302912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143136.909659:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861301632 00000100:00100000:2.0:1746143136.909663:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861301632 00000100:00100000:0.0:1746143136.909669:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143136.909675:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861303424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143136.909677:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861302144 00000100:00100000:2.0:1746143136.909679:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861302144 00000100:00100000:2.0:1746143136.909685:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861302656 00000100:00100000:2.0:1746143136.909686:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861302656 00000100:00100000:0.0:1746143136.909686:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143136.909693:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861303168 00000100:00100000:2.0:1746143136.909694:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861303168 00000100:00100000:2.0:1746143136.909699:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861301504 00000100:00100000:2.0:1746143136.909700:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861301504 00000100:00100000:2.0:1746143136.909705:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861302016 00000100:00100000:2.0:1746143136.909707:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861302016 00000100:00100000:2.0:1746143136.909712:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861302528 00000100:00100000:2.0:1746143136.909713:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861302528 00000100:00100000:2.0:1746143136.909719:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861303040 00000100:00100000:2.0:1746143136.909720:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861303040 00000100:00100000:2.0:1746143136.909725:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861301760 00000100:00100000:2.0:1746143136.909726:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861301760 00000100:00100000:2.0:1746143136.909730:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861302272 00000100:00100000:2.0:1746143136.909732:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861302272 00000100:00100000:2.0:1746143136.909737:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861302784 00000100:00100000:2.0:1746143136.909738:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861302784 00000100:00100000:2.0:1746143136.909744:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861303296 00000100:00100000:2.0:1746143136.909746:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861303296 00000100:00100000:2.0:1746143136.909750:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861301888 00000100:00100000:2.0:1746143136.909751:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861301888 00000100:00100000:2.0:1746143136.909756:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861302400 00000100:00100000:2.0:1746143136.909757:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861302400 00000100:00100000:2.0:1746143136.909762:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861302912 00000100:00100000:2.0:1746143136.909789:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861302912 00000100:00100000:2.0:1746143136.909796:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861303424 00000100:00100000:2.0:1746143136.909798:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861303424 00000100:00100000:2.0:1746143136.910288:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12677 00000100:00100000:2.0:1746143136.910296:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3300:x1830962861301632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.911126:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12678 00000100:00100000:0.0:1746143136.911133:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3300:x1830962861302144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143136.911232:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3300:x1830962861301632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 936us (2076us total) trans 17179872825 rc 0/0 00000100:00100000:2.0:1746143136.911237:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12677 00000004:00080000:3.0:1746143136.911243:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135183480/2, rc 0, transno 17179872825 00000100:00100000:3.0:1746143136.911248:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861301632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143136.911249:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12679 00000100:00100000:2.0:1746143136.911253:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3300:x1830962861302656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143136.911364:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3300:x1830962861302656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (2126us total) trans 21474840089 rc 0/0 00000100:00100000:2.0:1746143136.911369:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12679 00000100:00100000:2.0:1746143136.911378:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12680 00000100:00100000:2.0:1746143136.911382:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3300:x1830962861303168:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143136.911386:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b7100/2, rc 0, transno 21474840089 00000100:00100000:3.0:1746143136.911394:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861302656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143136.911431:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746143136.911438:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861303552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143136.911455:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3300:x1830962861303168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (2197us total) trans 21474840090 rc 0/0 00000100:00100000:3.0:1746143136.911458:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143136.911460:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12680 00000100:00100000:2.0:1746143136.911468:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861303552 00000100:00100000:2.0:1746143136.911471:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861303552 00000004:00080000:3.0:1746143136.911490:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b4e00/2, rc 0, transno 21474840090 00000100:00100000:3.0:1746143136.911493:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861303168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143136.911555:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12681 00000100:00100000:2.0:1746143136.911560:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3300:x1830962861301504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.911685:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3300:x1830962861302144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 552us (2469us total) trans 17179872827 rc 0/0 00000100:00100000:0.0:1746143136.911690:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12678 00000004:00080000:2.0:1746143136.911696:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b4a80/2, rc 0, transno 17179872827 00000100:00100000:2.0:1746143136.911699:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861302144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.911700:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12682 00000100:00100000:0.0:1746143136.911704:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3300:x1830962861302016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.911775:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3300:x1830962861302016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (2466us total) trans 17179872828 rc 0/0 00000100:00100000:0.0:1746143136.911780:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12682 00000004:00080000:2.0:1746143136.911785:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b7b80/2, rc 0, transno 17179872828 00000100:00100000:2.0:1746143136.911788:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861302016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.911788:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12683 00000100:00100000:0.0:1746143136.911792:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3300:x1830962861302528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143136.912137:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3300:x1830962861301504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 577us (2850us total) trans 17179872826 rc 0/0 00000100:00100000:3.0:1746143136.912144:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12681 00000004:00080000:2.0:1746143136.912303:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012baa2680/2, rc 0, transno 17179872826 00000100:00100000:2.0:1746143136.912307:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861301504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.913175:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3300:x1830962861302528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1380us (3842us total) trans 21474840091 rc 0/0 00000100:00100000:0.0:1746143136.913181:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12683 00000100:00100000:0.0:1746143136.913192:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12684 00000100:00100000:0.0:1746143136.913197:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3300:x1830962861303040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143136.913289:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3300:x1830962861303040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (3939us total) trans 21474840092 rc 0/0 00000100:00100000:0.0:1746143136.913294:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12684 00000100:00100000:0.0:1746143136.913303:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12685 00000100:00100000:0.0:1746143136.913308:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962861301760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.913396:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861301760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (4016us total) trans 17179872829 rc 0/0 00000100:00100000:0.0:1746143136.913400:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12685 00000100:00100000:0.0:1746143136.913409:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12686 00000100:00100000:0.0:1746143136.913413:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962861302272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.913488:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861302272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (4088us total) trans 17179872830 rc 0/0 00000100:00100000:0.0:1746143136.913493:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12686 00000100:00100000:0.0:1746143136.913501:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12687 00000100:00100000:0.0:1746143136.913505:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3301:x1830962861302784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143136.913585:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3301:x1830962861302784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (4165us total) trans 21474840093 rc 0/0 00000100:00100000:0.0:1746143136.913590:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12687 00000100:00100000:0.0:1746143136.913598:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12688 00000100:00100000:0.0:1746143136.913602:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3301:x1830962861303296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143136.913658:0:754:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143136.913661:0:754:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143136.913662:0:754:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143136.913664:0:754:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143136.913666:0:754:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143136.913682:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3301:x1830962861303296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (4243us total) trans 21474840094 rc 0/0 00000100:00100000:0.0:1746143136.913686:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12688 00000100:00100000:0.0:1746143136.913694:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12689 00000100:00100000:0.0:1746143136.913699:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962861301888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.913777:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861301888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (4313us total) trans 17179872831 rc 0/0 00000100:00100000:0.0:1746143136.913781:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12689 00000100:00100000:0.0:1746143136.913790:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12690 00000100:00100000:0.0:1746143136.913794:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3301:x1830962861302400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143136.914311:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12691 00000100:00100000:3.0:1746143136.914317:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3301:x1830962861302912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143136.914406:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3301:x1830962861302912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (4736us total) trans 21474840095 rc 0/0 00000100:00100000:3.0:1746143136.914410:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12691 00000100:00100000:3.0:1746143136.914418:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12692 00000100:00100000:3.0:1746143136.914421:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3301:x1830962861303424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143136.914655:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3301:x1830962861303424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (4788us total) trans 21474840096 rc 0/0 00000100:00100000:3.0:1746143136.914660:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12692 00000100:00100000:3.0:1746143136.914667:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12693 00000100:00100000:3.0:1746143136.914670:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3300:x1830962861303552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143136.914722:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3300:x1830962861303552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (3264us total) trans 21474840097 rc 0/0 00000100:00100000:3.0:1746143136.914725:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12693 00000100:00100000:0.0:1746143136.915414:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.915439:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.915456:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858772480 00000100:00100000:0.0:1746143136.915462:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858772480 00000100:00100000:0.0:1746143136.915484:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858772608 00000100:00100000:0.0:1746143136.915486:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858772608 00000100:00100000:0.0:1746143136.915499:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8223 00000100:00100000:0.0:1746143136.915503:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31091:x1830962858772480:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143136.915514:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.915527:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650936 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.915565:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.915576:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.915589:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143136.915592:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143136.915594:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009499f800, rc 0) 00000100:00100000:0.0:1746143136.915623:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31091:x1830962858772480:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 119us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.915627:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8223 00000100:00100000:0.0:1746143136.915638:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8224 00000100:00100000:0.0:1746143136.915642:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:31098:x1830962858772608:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.915649:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.915654:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009499fa00/0x25aee876ca70dd88 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165093d expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.915692:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143136.915700:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143136.915707:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143136.915727:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143136.915731:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143136.915743:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143136.915761:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499fa00/0x25aee876ca70dd88 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.915771:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.915777:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143136.916246:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143136.916249:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009499f400, rc 0) 00000100:00100000:0.0:1746143136.916266:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31098:x1830962858772608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 623us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.916271:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8224 00000004:00080000:0.0:1746143136.916573:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135180380/2, rc 0, transno 17179872831 00000100:00100000:0.0:1746143136.916579:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861301888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143136.916589:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b5500/2, rc 0, transno 21474840095 00000100:00100000:0.0:1746143136.916592:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861302912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143136.916598:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b7800/2, rc 0, transno 21474840096 00000100:00100000:0.0:1746143136.916601:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861303424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143136.916608:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135181500/2, rc 0, transno 17179872829 00000100:00100000:0.0:1746143136.916610:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861301760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143136.916616:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b7480/2, rc 0, transno 17179872830 00000100:00100000:0.0:1746143136.916618:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861302272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143136.916625:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b5f80/2, rc 0, transno 21474840093 00000100:00100000:0.0:1746143136.916627:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861302784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143136.916633:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b5c00/2, rc 0, transno 21474840094 00000100:00100000:0.0:1746143136.916636:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861303296:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143136.916655:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.916662:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 7 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.916672:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.916696:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 7 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.916706:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 7 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.916718:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861303680:192.168.201.28@tcp:104: 00000004:00080000:0.0:1746143136.916998:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eaaea00/2, rc 0, transno 21474840097 00000100:00100000:0.0:1746143136.917001:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861303552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143136.917009:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b4000/2, rc 0, transno 21474840091 00000100:00100000:0.0:1746143136.917011:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861302528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143136.917018:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b4700/2, rc 0, transno 21474840092 00000100:00100000:0.0:1746143136.917020:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861303040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143136.917049:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f81e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143136.917091:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861302400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3296us (7439us total) trans 17179872832 rc 0/0 00000100:00100000:0.0:1746143136.917096:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12690 00000004:00080000:0.0:1746143136.917113:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317b5180/2, rc 0, transno 17179872832 00000100:00100000:0.0:1746143136.917116:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861302400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143136.919242:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861303680:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143136.919260:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143136.920494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.920517:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858772736 00000100:00100000:0.0:1746143136.920522:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858772736 00010000:00010000:0.0:1746143136.920548:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.920568:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6744 00000100:00100000:0.0:1746143136.920575:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1971:x1830962858772736:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.920586:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.920591:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.920601:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.920620:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090437600/0x25aee876ca70dd03 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165091a expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.920631:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143136.920635:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.920643:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.920649:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.920664:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.920695:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1971:x1830962858772736:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 120us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.920701:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6744 00000100:00100000:0.0:1746143136.920847:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.920863:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.920875:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.920902:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.920914:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.920925:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.920942:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.920956:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858773632 00000100:00100000:0.0:1746143136.920960:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858773632 00000100:00100000:0.0:1746143136.920976:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8225 00000100:00100000:0.0:1746143136.920981:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31091:x1830962858773632:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143136.920992:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.921001:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dca00/0x25aee876ca70dd9d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165096e expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.921071:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.921079:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.921086:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:0.0:1746143136.921105:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:0.0:1746143136.921109:0:20619:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143136.921121:0:20619:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143136.921139:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dca00/0x25aee876ca70dd9d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 9 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.921148:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 8 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.921153:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143136.921155:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143136.921168:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b5dce00, rc 0) 00000100:00100000:0.0:1746143136.921191:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31091:x1830962858773632:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 209us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.921196:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8225 00000100:00100000:0.0:1746143136.921213:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858772864 00000100:00100000:0.0:1746143136.921216:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858772864 00000100:00100000:0.0:1746143136.921231:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858773120 00000100:00100000:0.0:1746143136.921233:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858773120 00000100:00100000:0.0:1746143136.921242:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858773376 00000100:00100000:0.0:1746143136.921244:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858773376 00000100:00100000:0.0:1746143136.921252:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858772992 00000100:00100000:0.0:1746143136.921254:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858772992 00000100:00100000:0.0:1746143136.921262:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858773248 00000100:00100000:0.0:1746143136.921263:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858773248 00000100:00100000:0.0:1746143136.921272:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858773504 00000100:00100000:0.0:1746143136.921273:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858773504 00000100:00100000:0.0:1746143136.921295:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12694 00000100:00100000:0.0:1746143136.921301:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858772864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.921309:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.921319:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650944 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143136.921340:0:754:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x6814079e, atime: 0x6814079e, ctime: 0x6814079e, blocks: 0x7cf 00010000:00010000:0.0:1746143136.921350:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921352:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921358:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 27 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.921368:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 27 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.921375:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d928400, rc 0) 00000100:00100000:0.0:1746143136.921394:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858772864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 93us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.921400:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12694 00000100:00100000:0.0:1746143136.921410:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12695 00000100:00100000:0.0:1746143136.921415:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858773120:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.921422:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.921430:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650952 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143136.921443:0:754:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x6814079f, atime: 0x6814079e, ctime: 0x6814079f, blocks: 0x81f 00010000:00010000:0.0:1746143136.921450:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921452:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921456:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.921464:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 24 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.921504:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d929e00, rc 0) 00000100:00100000:0.0:1746143136.921520:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858773120:12345-192.168.201.28@tcp:101:cat.0 Request processed in 105us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.921526:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12695 00000100:00100000:0.0:1746143136.921536:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12696 00000100:00100000:0.0:1746143136.921541:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858773376:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.921547:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143136.921550:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12697 00010000:00010000:0.0:1746143136.921554:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650960 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143136.921556:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858772992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143136.921562:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746143136.921565:0:754:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x6814079f, atime: 0x6814079f, ctime: 0x6814079f, blocks: 0x180b 00010000:00010000:2.0:1746143136.921568:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165094b expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.921571:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921572:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921576:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 27 pid: 754 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746143136.921579:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x6814079f, atime: 0x6814079e, ctime: 0x6814079f, blocks: 0x821 00010000:00010000:0.0:1746143136.921583:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 27 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.921584:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.921585:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.921589:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.921590:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d928a00, rc 0) 00010000:00010000:2.0:1746143136.921598:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.921604:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475400, rc 0) 00000100:00100000:0.0:1746143136.921605:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858773376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 64us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.921609:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12696 00000100:00100000:2.0:1746143136.921617:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858772992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 61us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.921617:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12698 00000100:00100000:0.0:1746143136.921621:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858773248:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:2.0:1746143136.921622:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12697 00010000:00010000:0.0:1746143136.921627:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143136.921631:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12699 00000100:00100000:2.0:1746143136.921634:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1968:x1830962858773504:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.921634:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650959 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.921639:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746143136.921642:0:754:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x6814079e, atime: 0x6814079e, ctime: 0x6814079e, blocks: 0x81d 00010000:00010000:2.0:1746143136.921644:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650967 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.921648:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921649:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921652:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 27 pid: 754 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746143136.921653:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x6814079f, atime: 0x6814079e, ctime: 0x6814079f, blocks: 0x1029 00010000:00010000:2.0:1746143136.921658:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.921659:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143136.921660:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 27 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.921662:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143136.921667:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d929400, rc 0) 00010000:00010000:2.0:1746143136.921670:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.921675:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475600, rc 0) 00000100:00100000:0.0:1746143136.921678:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858773248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 57us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.921682:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12698 00000100:00100000:2.0:1746143136.921685:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858773504:12345-192.168.201.28@tcp:101:cat.0 Request processed in 51us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.921700:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12699 00010000:00010000:0.0:1746143136.921730:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921736:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:0.0:1746143136.921747:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143136.921816:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921822:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921830:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921846:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009499e600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143136.921849:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921855:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921863:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143136.921865:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143136.921868:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921873:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499e600/0x25aee876ca70dd96 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921886:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921890:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921895:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921898:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132008400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143136.921900:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921904:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921913:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143136.921915:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143136.921917:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921921:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132008400/0x25aee876ca70dd65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921928:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921933:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921937:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921940:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132009c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143136.921942:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921946:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921950:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f413900) 00010000:00010000:0.0:1746143136.921952:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143136.921954:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.921957:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132009c00/0x25aee876ca70dd6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143136.922266:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132009200/0x25aee876ca70dd5e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165092f expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.922274:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132009200/0x25aee876ca70dd5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165092f expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.922281:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132009200, rc 0) 00000100:00100000:0.0:1746143136.922300:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:31100:x1830962858772352:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 14239us (14321us total) trans 8589942440 rc 301/301 00000100:00100000:0.0:1746143136.922306:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8222 00000100:00100000:1.0:1746143136.931413:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.931442:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.931460:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858773888 00000100:00100000:1.0:1746143136.931469:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.931471:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858773888 00000100:00100000:2.0:1746143136.931482:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858774144 00000100:00100000:2.0:1746143136.931487:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858774144 00000100:00100000:1.0:1746143136.931488:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.931503:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.931524:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858774400 00000100:00100000:2.0:1746143136.931526:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858774400 00000100:00100000:2.0:1746143136.931534:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858773760 00000100:00100000:2.0:1746143136.931535:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858773760 00000100:00100000:2.0:1746143136.931541:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858774016 00000100:00100000:2.0:1746143136.931542:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858774016 00000100:00100000:2.0:1746143136.931554:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12700 00000100:00100000:2.0:1746143136.931560:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858773888:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143136.931562:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12701 00000100:00100000:3.0:1746143136.931571:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858774144:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143136.931572:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.931582:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.931584:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165097c expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.931592:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165098a expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.931602:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.931604:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.931604:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143136.931605:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143136.931606:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.931609:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 11 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143136.931611:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.931618:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 11 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143136.931623:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.931625:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094df0200, rc 0) 00010000:00010000:3.0:1746143136.931630:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7b400, rc 0) 00000100:00100000:2.0:1746143136.931864:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858773888:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 303us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143136.931866:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858774144:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 295us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.931869:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12700 00000100:00100000:3.0:1746143136.931872:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12701 00000100:00100000:2.0:1746143136.931880:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858774272 00000100:00100000:2.0:1746143136.931882:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858774272 00000100:00100000:3.0:1746143136.931888:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12702 00000100:00100000:3.0:1746143136.931951:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858774400:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143136.931957:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143136.931963:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650998 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143136.931971:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.931972:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143136.931975:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 11 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143136.931985:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 11 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143136.931990:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7aa00, rc 0) 00000100:00100000:3.0:1746143136.932002:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858774400:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 110us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.932080:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12703 00000100:00100000:1.0:1746143136.932087:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858773760:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143136.932094:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.932101:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650975 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.932112:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.932113:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.932118:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 11 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.932127:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 11 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143136.932135:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b115400, rc 0) 00000100:00100000:1.0:1746143136.932152:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858773760:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 66us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.932175:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12703 00000100:00100000:1.0:1746143136.932186:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12704 00000100:00100000:1.0:1746143136.932191:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858774016:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143136.932194:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12705 00010000:00010000:1.0:1746143136.932197:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143136.932201:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858774272:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143136.932203:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650983 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.932213:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.932213:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.932214:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.932218:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.932220:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650991 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.932225:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.932231:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143136.932231:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b115200, rc 0) 00010000:00010000:2.0:1746143136.932232:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143136.932237:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143136.932246:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858774016:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 55us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.932251:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12704 00010000:00010000:2.0:1746143136.932291:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143136.932303:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c10c00, rc 0) 00000100:00100000:2.0:1746143136.932321:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858774272:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 121us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143136.932326:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12705 00000100:00100000:3.0:1746143136.932697:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12702 00000100:00100000:0.0:1746143136.942693:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.942717:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858774656 00000100:00100000:0.0:1746143136.942719:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.942726:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858774656 00000100:00100000:0.0:1746143136.942732:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.942752:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:1.0:1746143136.942762:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88008eb21180 x1830962858774656/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143136.942766:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858774912 00000100:00100000:0.0:1746143136.942768:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858774912 00002000:00100000:1.0:1746143136.942771:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21180 with x1830962858774656 ext(0->1048575) 00002000:00010000:1.0:1746143136.942775:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21180 00000100:00100000:1.0:1746143136.943028:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858775296 00000100:00100000:1.0:1746143136.943046:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858775296 00002000:00100000:1.0:1746143136.943060:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008eb20700 x1830962858775296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.943067:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20700 with x1830962858775296 ext(1048576->2097151) 00002000:00010000:1.0:1746143136.943069:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb20700 00000100:00100000:1.0:1746143136.943079:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858775424 00000100:00100000:1.0:1746143136.943081:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858775424 00002000:00100000:1.0:1746143136.943090:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008eb20a80 x1830962858775424/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.943096:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20a80 with x1830962858775424 ext(1048576->2097151) 00002000:00010000:1.0:1746143136.943098:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb20a80 00000100:00100000:1.0:1746143136.943108:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6180 00000100:00100000:1.0:1746143136.943114:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858774656:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143136.944513:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6181 00000100:00100000:1.0:1746143136.944520:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858775296:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143136.945394:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6182 00000100:00100000:2.0:1746143136.945403:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858775424:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:0.0:1746143136.945565:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb20e00 x1830962858774912/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/0 e 0 to 0 dl 1746143147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143136.945574:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20e00 with x1830962858774912 ext(1048576->2097151) 00002000:00010000:0.0:1746143136.945579:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb20e00 00000100:00100000:0.0:1746143136.945593:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6183 00000100:00100000:0.0:1746143136.945598:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858774912:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143136.947442:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.949375:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858775552 00000100:00100000:0.0:1746143136.949384:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858775552 00000100:00100000:0.0:1746143136.949617:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8226 00000100:00100000:0.0:1746143136.949625:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:31100:x1830962858775552:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143136.949643:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.949659:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f800/0x25aee876ca70de06 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165099f expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.949705:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f800/0x25aee876ca70de06 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165099f expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.949716:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f800/0x25aee876ca70de06 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165099f expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143136.949732:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143136.949734:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143136.949737:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529f800, rc 0) 00000100:00100000:0.0:1746143136.949772:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31100:x1830962858775552:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 148us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.949778:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8226 00000100:00100000:1.0:1746143136.957534:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1968:x1830962858774656:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14410us (14837us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143136.957545:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6180 00002000:00100000:1.0:1746143136.957556:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88008eb21180 x1830962858774656/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.957571:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21180 with x1830962858774656 ext(0->1048575) 00002000:00010000:1.0:1746143136.957576:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21180 00000100:00100000:3.0:1746143136.961848:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858775424:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16438us (19087us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143136.961856:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6182 00002000:00100000:3.0:1746143136.961864:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008eb20a80 x1830962858775424/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143136.961871:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20a80 with x1830962858775424 ext(1048576->2097151) 00002000:00010000:3.0:1746143136.961875:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb20a80 00000001:00080000:2.0:1746143136.962766:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872824 is committed 00000001:00080000:2.0:1746143136.962778:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872820 is committed 00000001:00080000:2.0:1746143136.962826:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872790 is committed 00000001:00080000:2.0:1746143136.962883:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872821 is committed 00000001:00080000:2.0:1746143136.962888:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872804 is committed 00000100:00100000:2.0:1746143136.966330:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858774912:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20723us (23602us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143136.966342:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6183 00002000:00100000:2.0:1746143136.966353:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb20e00 x1830962858774912/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143136.966361:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20e00 with x1830962858774912 ext(1048576->2097151) 00002000:00010000:2.0:1746143136.966366:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb20e00 00000100:00100000:0.0:1746143136.966437:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.966535:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858775808 00000100:00100000:2.0:1746143136.966541:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858775808 00000100:00100000:2.0:1746143136.966581:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8227 00000100:00100000:2.0:1746143136.966587:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31100:x1830962858775808:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143136.966601:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.966605:0:14796:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143136.966628:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529f800/0x25aee876ca70de06 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165099f expref: 199 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.966640:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143136.966644:0:14796:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143136.966653:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093db4000/0x25aee876ca70de0d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509a6 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.966693:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143136.966703:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.966710:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.966715:0:14796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 7 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.966720:0:14796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143136.966744:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 7 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.966753:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 7 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.966763:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861303808:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.967221:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.967229:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 7 pid: 14794 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.967237:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861303936:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.967429:0:14796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.967437:0:14796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 7 pid: 14794 timeout: 1018 lvb_type: 0 00000100:00100000:2.0:1746143136.967445:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861304064:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.967469:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d4259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143136.968746:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858775296:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24222us (26008us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143136.968976:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6181 00002000:00100000:1.0:1746143136.968985:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008eb20700 x1830962858775296/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:287/0 lens 488/440 e 0 to 0 dl 1746143147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143136.968993:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb20700 with x1830962858775296 ext(1048576->2097151) 00002000:00010000:1.0:1746143136.968997:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb20700 00000100:00100000:0.0:1746143136.970877:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.970916:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861303808:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.970926:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861303936:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143136.970932:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861304064:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143136.970957:0:14796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000100:00100000:1.0:1746143136.971013:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858775936 00000100:00100000:1.0:1746143136.971019:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858775936 00010000:00010000:1.0:1746143136.971063:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.971083:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6745 00000100:00100000:1.0:1746143136.971091:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858775936:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143136.971101:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143136.971106:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.971115:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.971132:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dda4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165096e expref: 8 pid: 20619 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.971147:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.971151:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143136.971170:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143136.971175:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143136.971202:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858775936:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 112us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.971207:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6745 00000100:00100000:2.0:1746143136.975632:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.975670:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.975723:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858776064 00000100:00100000:0.0:1746143136.975730:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858776192 00000100:00100000:1.0:1746143136.975731:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858776064 00000100:00100000:0.0:1746143136.975734:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858776192 00010000:00010000:0.0:1746143136.975755:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 8 pid: 14794 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.975756:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 7 pid: 14794 timeout: 1018 lvb_type: 0 00000100:00100000:0.0:1746143136.975781:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6746 00000100:00100000:0.0:1746143136.975786:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858776192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143136.975788:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6747 00000100:00100000:1.0:1746143136.975794:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858776064:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143136.975794:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143136.975798:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 8 pid: 14794 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.975802:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143136.975806:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 7 pid: 14794 timeout: 1018 lvb_type: 0 00010000:00010000:0.0:1746143136.975806:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 8 pid: 14794 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.976266:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 7 pid: 14794 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.976279:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f800/0x25aee876ca70dd81 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650936 expref: 7 pid: 14794 timeout: 1018 lvb_type: 0 00010000:00010000:1.0:1746143136.976294:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.976298:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143136.976305:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143136.976311:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143136.976343:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143136.976377:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858776064:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 583us (751us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143136.976377:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f400/0x25aee876ca70dd8f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165093d expref: 8 pid: 14794 timeout: 1018 lvb_type: 0 00000100:00100000:1.0:1746143136.976384:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6747 00010000:00010000:0.0:1746143136.976387:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143136.976389:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143136.976405:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1968:x1830962858776192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 619us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143136.976411:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6746 00010000:00010000:2.0:1746143136.976527:0:14796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143136.976534:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000040:00080000:2.0:1746143136.977104:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2433, 88 off206824 00000004:00080000:2.0:1746143136.977110:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918817078346ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143136.977172:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2445, 88 off207616 00000004:00080000:2.0:1746143136.977176:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918817144607ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143136.977198:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2446, 88 off207704 00000004:00080000:2.0:1746143136.977201:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918817169935ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143136.977212:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2434, 88 off206912 00000004:00080000:2.0:1746143136.977215:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918817182895ns, next at 860071159912ns, rc = 0 00000100:00100000:1.0:1746143136.977274:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143136.977301:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858776320 00000100:00100000:0.0:1746143136.977305:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858776320 00000100:00100000:0.0:1746143136.977320:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8228 00000100:00100000:0.0:1746143136.977324:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:31098:x1830962858776320:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143136.977333:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143136.977341:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509ad expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1746143136.979137:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2435, 88 off207000 00000004:00080000:2.0:1746143136.979147:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918819115496ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143136.979187:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2447, 88 off207792 00000004:00080000:2.0:1746143136.979192:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918819160183ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143136.979214:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2448, 88 off207880 00000004:00080000:2.0:1746143136.979218:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918819186335ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143136.979223:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2449, 88 off207968 00000004:00080000:2.0:1746143136.979225:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918819193929ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143136.979231:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2436, 88 off207088 00000004:00080000:2.0:1746143136.979234:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918819202163ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143136.979250:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2450, 88 off208056 00000004:00080000:2.0:1746143136.979253:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918819221508ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143136.979260:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2437, 88 off207176 00000004:00080000:2.0:1746143136.979262:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918819230570ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143136.979273:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2451, 88 off208144 00000004:00080000:2.0:1746143136.979275:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918819243979ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143136.979280:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2438, 88 off207264 00000004:00080000:2.0:1746143136.979283:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918819251325ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143136.979296:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2439, 88 off207352 00000004:00080000:2.0:1746143136.979299:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918819268053ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143136.979308:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2440, 88 off207440 00000004:00080000:2.0:1746143136.979311:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918819279106ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143136.979318:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2441, 88 off207528 00000004:00080000:2.0:1746143136.979320:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918819289106ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143136.979328:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2452, 88 off208232 00000004:00080000:2.0:1746143136.979331:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918819299246ns, next at 860119223596ns, rc = 0 00010000:00010000:1.0:1746143136.980594:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143136.980607:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.980621:0:17079:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143136.980635:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.980646:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.980648:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143136.980651:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.980657:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529ee00, rc 0) 00000100:00100000:1.0:1746143136.980708:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31098:x1830962858776320:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3382us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143136.980714:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8228 00000100:00100000:1.0:1746143136.987301:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.987391:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858776576 00000100:00100000:1.0:1746143136.987399:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858776576 00000100:00100000:1.0:1746143136.987697:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8229 00000100:00100000:1.0:1746143136.987703:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31105:x1830962858776576:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143136.987719:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.987955:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7d600/0x25aee876ca70de22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509b4 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.988061:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988073:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988082:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988092:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988098:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988102:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988190:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988197:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988202:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:1.0:1746143136.988210:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143136.988290:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988295:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988300:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.988305:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b114e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143136.989319:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989327:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989337:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.989339:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143136.989343:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989347:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114e00/0x25aee876ca70de37 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989722:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989727:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989731:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989735:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b114c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143136.989737:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989741:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989746:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143136.989748:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143136.989750:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989754:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b114c00/0x25aee876ca70de29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989759:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989764:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989768:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989771:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b115000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143136.989774:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989779:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989784:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92000) 00010000:00010000:1.0:1746143136.989786:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143136.989788:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989792:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b115000/0x25aee876ca70de30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.989825:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7d600/0x25aee876ca70de22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509b4 expref: 203 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.990018:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7d600/0x25aee876ca70de22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509b4 expref: 203 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.990026:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b7d600, rc 0) 00000100:00100000:1.0:1746143136.990628:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31105:x1830962858776576:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2923us (3331us total) trans 8589942442 rc 301/301 00000100:00100000:1.0:1746143136.990635:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8229 00000100:00100000:0.0:1746143136.991425:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143136.991670:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858776832 00000100:00100000:1.0:1746143136.991675:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858776832 00000100:00100000:1.0:1746143136.991710:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8230 00000100:00100000:1.0:1746143136.991716:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31104:x1830962858776832:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143136.991728:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143136.991737:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5240800/0x25aee876ca70de45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509bb expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.991800:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991809:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991815:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991824:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991829:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991833:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991897:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991903:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991907:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:1.0:1746143136.991914:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143136.991959:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991964:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991973:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991977:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a586ea00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143136.991979:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991983:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991990:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143136.991992:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143136.991994:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.991998:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a586ea00/0x25aee876ca70de5a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992006:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992010:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992014:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992018:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5241200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143136.992019:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992023:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992049:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143136.992051:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143136.992053:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992057:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5241200/0x25aee876ca70de4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992063:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992066:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992070:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992074:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4b7da00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143136.992076:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992081:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992086:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92e00) 00010000:00010000:1.0:1746143136.992087:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143136.992090:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992094:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b7da00/0x25aee876ca70de53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143136.992116:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5240800/0x25aee876ca70de45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509bb expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.992124:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5240800/0x25aee876ca70de45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509bb expref: 10 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143136.992131:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5240800, rc 0) 00000100:00100000:1.0:1746143136.992167:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31104:x1830962858776832:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 439us (731us total) trans 8589942443 rc 301/301 00000100:00100000:1.0:1746143136.992173:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8230 00000100:00100000:0.0:1746143136.995896:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143136.995944:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858776960 00000100:00100000:2.0:1746143136.995952:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858776960 00000100:00100000:2.0:1746143136.995991:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8231 00000100:00100000:2.0:1746143136.995999:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31105:x1830962858776960:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143136.996017:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143136.996048:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b3a00/0x25aee876ca70de68 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509c2 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143136.996107:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.996117:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143136.996125:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143137.012378:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 204 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.012394:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143137.012397:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143137.012400:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143137.012411:0:14796:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143137.012416:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143137.012424:0:14796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.012431:0:14796:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.012437:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.012477:0:14796:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143137.012491:0:14796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861304192:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143137.012613:0:14796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450000 going to sleep for 11 seconds 00010000:00010000:2.0:1746143137.012680:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143137.012688:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000001:00080000:0.0:1746143137.012690:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942440 is committed 00000001:00080000:0.0:1746143137.012703:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942441 is committed 00000004:00080000:0.0:1746143137.012706:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1869 committed 00000004:00080000:0.0:1746143137.012714:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1863 committed 00000004:00080000:0.0:1746143137.012720:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1862 committed 00000004:00080000:0.0:1746143137.012723:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1861 committed 00000004:00200000:2.0:1746143137.012724:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00080000:0.0:1746143137.012724:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1860 committed 00000004:00080000:0.0:1746143137.012727:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1868 committed 00000004:00200000:2.0:1746143137.012728:0:20619:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00080000:0.0:1746143137.012728:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1859 committed 00000004:00080000:0.0:1746143137.012730:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1867 committed 00000004:00080000:0.0:1746143137.012732:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1858 committed 00000004:00080000:0.0:1746143137.012733:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1866 committed 00000004:00080000:0.0:1746143137.012735:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1865 committed 00000004:00080000:0.0:1746143137.012737:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1864 committed 00000004:00080000:0.0:1746143137.012738:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1857 committed 00000004:00010000:2.0:1746143137.012739:0:20619:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00080000:0.0:1746143137.012740:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1856 committed 00000004:00080000:0.0:1746143137.012741:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1863 committed 00000004:00080000:0.0:1746143137.012743:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1862 committed 00000004:00080000:0.0:1746143137.012744:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1855 committed 00000001:00080000:0.0:1746143137.012750:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942439 is committed 00010000:00010000:2.0:1746143137.012761:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b3a00/0x25aee876ca70de68 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 203 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.012774:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 202 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.012780:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143137.012782:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746143137.012784:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52b2c00, rc 0) 00000100:00100000:2.0:1746143137.012813:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31105:x1830962858776960:12345-192.168.201.28@tcp:101:cat.0 Request processed in 16814us (16922us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.012821:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8231 00000100:00100000:2.0:1746143137.013048:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746143137.013057:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861304320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143137.013089:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143137.013108:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861304704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.013118:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861304832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143137.013120:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143137.013129:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861305216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143137.013142:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143137.013154:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143137.013168:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861304320 00000100:00100000:2.0:1746143137.013174:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861304320 00000100:00100000:2.0:1746143137.013201:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861304704 00000100:00100000:2.0:1746143137.013203:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861304704 00000100:00100000:2.0:1746143137.013210:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861305216 00000100:00100000:2.0:1746143137.013212:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861305216 00000100:00100000:2.0:1746143137.013218:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861304832 00000100:00100000:2.0:1746143137.013220:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861304832 00000100:00100000:2.0:1746143137.013228:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12706 00000100:00100000:2.0:1746143137.013232:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3299:x1830962861304320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.013255:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861304448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.013282:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143137.013303:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861304960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.013328:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143137.013347:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143137.013354:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861304576:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143137.013359:0:21048:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143137.013361:0:21048:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143135 -> 1746143135 00002000:00010000:2.0:1746143137.013363:0:21048:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143137.013365:0:21048:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143135 -> 1746143135 00002000:00010000:2.0:1746143137.013367:0:21048:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143137.013375:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143137.013390:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3299:x1830962861304320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (301us total) trans 17179872833 rc 0/0 00000100:00100000:2.0:1746143137.013395:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12706 00000100:00100000:0.0:1746143137.013395:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861305088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143137.013407:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861304448 00000100:00100000:2.0:1746143137.013409:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861304448 00000100:00100000:0.0:1746143137.013416:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143137.013418:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861304960 00000100:00100000:2.0:1746143137.013420:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861304960 00000100:00100000:2.0:1746143137.013425:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861304576 00000100:00100000:2.0:1746143137.013426:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861304576 00000100:00100000:2.0:1746143137.013430:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861305088 00000100:00100000:2.0:1746143137.013431:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861305088 00000100:00100000:2.0:1746143137.013437:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12707 00000100:00100000:2.0:1746143137.013440:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3299:x1830962861304704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.013449:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12708 00000100:00100000:0.0:1746143137.013458:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3299:x1830962861305216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143137.013509:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861304704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (388us total) trans 17179872834 rc 0/0 00000100:00100000:2.0:1746143137.013514:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12707 00000100:00100000:2.0:1746143137.013522:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12709 00000100:00100000:2.0:1746143137.013526:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3300:x1830962861304832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143137.013589:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861304832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (436us total) trans 17179872836 rc 0/0 00000100:00100000:2.0:1746143137.013594:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12709 00000100:00100000:0.0:1746143137.013598:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861305216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (451us total) trans 17179872835 rc 0/0 00000100:00100000:2.0:1746143137.013601:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12710 00000100:00100000:2.0:1746143137.013605:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861304448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.013605:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12708 00000100:00100000:0.0:1746143137.013621:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12711 00000100:00100000:0.0:1746143137.013627:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3301:x1830962861304960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143137.013657:0:21048:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143137.013659:0:21048:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143135 -> 1746143135 00002000:00010000:2.0:1746143137.013661:0:21048:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143137.013663:0:21048:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143135 -> 1746143135 00002000:00010000:2.0:1746143137.013664:0:21048:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143137.013679:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861304448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (398us total) trans 17179872837 rc 0/0 00000100:00100000:2.0:1746143137.013683:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12710 00000100:00100000:2.0:1746143137.013691:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12712 00000100:00100000:2.0:1746143137.013694:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3301:x1830962861304576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.013970:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861304960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 342us (640us total) trans 17179872838 rc 0/0 00002000:00010000:2.0:1746143137.013971:0:21048:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143137.013973:0:21048:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143135 -> 1746143135 00002000:00010000:2.0:1746143137.013975:0:21048:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:2.0:1746143137.013976:0:21048:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143135 -> 1746143135 00000100:00100000:0.0:1746143137.013976:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12711 00002000:00010000:2.0:1746143137.013978:0:21048:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143137.013991:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12713 00000100:00100000:2.0:1746143137.013992:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861304576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 298us (618us total) trans 17179872839 rc 0/0 00000100:00100000:0.0:1746143137.013996:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861305088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143137.013997:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12712 00000100:00080000:2.0:1746143137.014013:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143137.014056:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872820 gen 2 00000004:00080000:2.0:1746143137.014059:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919ddc00, transno 17179872794 00000004:00080000:2.0:1746143137.014064:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919de300, transno 17179872795 00000004:00080000:2.0:1746143137.014066:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919df800, transno 17179872796 00000004:00080000:2.0:1746143137.014068:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dca80, transno 17179872797 00000004:00080000:2.0:1746143137.014070:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dd500, transno 17179872798 00000004:00080000:2.0:1746143137.014072:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919ded80, transno 17179872799 00000004:00080000:2.0:1746143137.014074:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dfb80, transno 17179872800 00000004:00080000:2.0:1746143137.014076:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dc700, transno 17179872801 00000004:00080000:2.0:1746143137.014077:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b5b100, transno 17179872805 00000004:00080000:2.0:1746143137.014079:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314fb80, transno 17179872806 00000004:00080000:2.0:1746143137.014081:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e680, transno 17179872807 00000004:00080000:2.0:1746143137.014083:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314c380, transno 17179872808 00000004:00080000:2.0:1746143137.014085:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e300, transno 17179872809 00000004:00080000:2.0:1746143137.014086:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314df80, transno 17179872810 00000004:00080000:2.0:1746143137.014088:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314f100, transno 17179872811 00000004:00080000:2.0:1746143137.014090:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314d180, transno 17179872812 00000004:00080000:2.0:1746143137.014092:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b800700, transno 17179872813 00000004:00080000:2.0:1746143137.014094:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b59ad80, transno 17179872814 00000004:00080000:2.0:1746143137.014096:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b801f80, transno 17179872815 00000004:00080000:2.0:1746143137.014097:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b598e00, transno 17179872816 00000004:00080000:2.0:1746143137.014099:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b802300, transno 17179872817 00000004:00080000:2.0:1746143137.014101:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b803480, transno 17179872818 00000004:00080000:2.0:1746143137.014102:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b801500, transno 17179872819 00000004:00080000:2.0:1746143137.014104:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b802d80, transno 17179872820 00000100:00100000:2.0:1746143137.014109:0:3299:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880135183480 x1830962861301632/t17179872825(17179872825) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143152 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746143137.014118:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d6a00/2, rc 0, transno 17179872834 00000100:00100000:2.0:1746143137.014121:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861304704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.014126:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861305088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (708us total) trans 17179872840 rc 0/0 00000004:00080000:2.0:1746143137.014129:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d7100/2, rc 0, transno 17179872835 00000100:00100000:2.0:1746143137.014132:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861305216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143137.014132:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12713 00000004:00080000:2.0:1746143137.014138:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d6d80/2, rc 0, transno 17179872833 00000100:00100000:2.0:1746143137.014140:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861304320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143137.014190:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d6300/2, rc 0, transno 17179872836 00000100:00100000:0.0:1746143137.014196:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861304832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143137.014218:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d4a80/2, rc 0, transno 17179872839 00000100:00100000:0.0:1746143137.014222:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861304576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143137.014231:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d4e00/2, rc 0, transno 17179872840 00000100:00100000:0.0:1746143137.014233:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861305088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143137.014240:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d5880/2, rc 0, transno 17179872837 00000100:00100000:0.0:1746143137.014242:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861304448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143137.014248:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3d7800/2, rc 0, transno 17179872838 00000100:00100000:0.0:1746143137.014251:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861304960:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143137.014327:0:14837:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 16 in progress, 0 in flight, 24 done 00000100:00100000:0.0:1746143137.015195:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861305600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143137.015228:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143137.015895:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861306112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143137.015923:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143137.015924:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861305728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143137.017642:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143137.017647:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143137.017652:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861305472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143137.017684:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861305600 00000100:00100000:3.0:1746143137.017692:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861305600 00000100:00100000:1.0:1746143137.018027:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861306112 00000100:00100000:2.0:1746143137.018058:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861306240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143137.018061:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861306112 00000100:00100000:2.0:1746143137.018083:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143137.018090:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861305728 00000100:00100000:1.0:1746143137.018094:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861305728 00000100:00100000:2.0:1746143137.018099:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143137.018105:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861305344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143137.018111:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861306240 00000100:00100000:1.0:1746143137.018114:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861306240 00000100:00100000:2.0:1746143137.018122:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143137.018259:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861305344 00000100:00100000:1.0:1746143137.018264:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861305344 00000100:00100000:2.0:1746143137.018269:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861305856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143137.018289:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143137.018294:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12714 00000100:00100000:1.0:1746143137.018302:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3302:x1830962861305600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143137.018309:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861305856 00000100:00100000:2.0:1746143137.018312:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861305856 00000100:00100000:2.0:1746143137.018331:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12715 00000100:00100000:2.0:1746143137.018336:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3302:x1830962861306112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143137.018506:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:1.0:1746143137.018510:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143135 -> 1746143135 00002000:00010000:1.0:1746143137.018513:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143135 -> 1746143135 00002000:00010000:1.0:1746143137.018514:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143135 -> 1746143135 00002000:00010000:1.0:1746143137.018516:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:1.0:1746143137.018557:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3302:x1830962861305600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (3327us total) trans 21474840098 rc 0/0 00000100:00100000:1.0:1746143137.018564:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12714 00000100:00100000:1.0:1746143137.018584:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12716 00000100:00100000:1.0:1746143137.018593:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3299:x1830962861305728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143137.018715:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3299:x1830962861305728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (1067us total) trans 21474840099 rc 0/0 00000100:00100000:1.0:1746143137.018721:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12716 00000100:00100000:1.0:1746143137.018735:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12717 00000100:00100000:1.0:1746143137.018741:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3299:x1830962861306240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143137.019068:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3299:x1830962861306240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 326us (981us total) trans 21474840100 rc 0/0 00000100:00100000:1.0:1746143137.019074:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12717 00002000:00010000:2.0:1746143137.019084:0:8169:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143137.019086:0:8169:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143137.019088:0:8169:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143137.019090:0:8169:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:1.0:1746143137.019090:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12718 00002000:00010000:2.0:1746143137.019091:0:8169:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143137.019095:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3299:x1830962861305344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143137.019114:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3302:x1830962861306112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 777us (3191us total) trans 21474840101 rc 0/0 00000100:00100000:2.0:1746143137.019122:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12715 00000100:00100000:2.0:1746143137.019133:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12719 00000100:00100000:2.0:1746143137.019138:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3299:x1830962861305856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143137.019221:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3299:x1830962861305856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (931us total) trans 21474840102 rc 0/0 00000100:00100000:2.0:1746143137.019225:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12719 00000100:00080000:2.0:1746143137.019254:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143137.019623:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143137.019651:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861305984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143137.019680:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143137.019735:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e680/2, rc 0, transno 21474840098 00000100:00100000:0.0:1746143137.019747:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861305600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143137.019759:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314f100/2, rc 0, transno 21474840101 00000100:00100000:0.0:1746143137.019763:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861306112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143137.019892:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861305472 00000100:00100000:3.0:1746143137.019897:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861305472 00000100:00100000:3.0:1746143137.019922:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861305984 00000100:00100000:3.0:1746143137.019925:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861305984 00000100:00100000:3.0:1746143137.019944:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12720 00000100:00100000:3.0:1746143137.019951:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3302:x1830962861305472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143137.020093:0:10061:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143137.020097:0:10061:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:3.0:1746143137.020099:0:10061:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:3.0:1746143137.020101:0:10061:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:3.0:1746143137.020103:0:10061:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746143137.020145:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3302:x1830962861305472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (522us total) trans 21474840103 rc 0/0 00000100:00100000:3.0:1746143137.020151:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12720 00000100:00100000:3.0:1746143137.020182:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12721 00000100:00100000:3.0:1746143137.020189:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3302:x1830962861305984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143137.020310:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3302:x1830962861305984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (628us total) trans 21474840104 rc 0/0 00000100:00100000:3.0:1746143137.020317:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12721 00000100:00100000:0.0:1746143137.020402:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861306368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143137.020444:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143137.020517:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314fb80/2, rc 0, transno 21474840103 00000100:00100000:0.0:1746143137.020523:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861305472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143137.020533:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314df80/2, rc 0, transno 21474840104 00000100:00100000:0.0:1746143137.020536:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861305984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143137.020621:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861306368 00000100:00100000:2.0:1746143137.020626:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861306368 00000100:00100000:2.0:1746143137.020653:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12722 00000100:00100000:2.0:1746143137.020660:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3300:x1830962861306368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143137.020787:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3300:x1830962861306368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (343us total) trans 21474840105 rc 0/0 00000100:00100000:2.0:1746143137.020794:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12722 00000004:00080000:0.0:1746143137.020888:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314ea00/2, rc 0, transno 21474840105 00000100:00100000:0.0:1746143137.020894:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861306368:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143137.021106:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143137.021111:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143137.021113:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143137.021114:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143137.021116:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1999 -> 1999 00000100:00100000:1.0:1746143137.021149:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3299:x1830962861305344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2053us (3025us total) trans 21474840106 rc 0/0 00000100:00100000:1.0:1746143137.021171:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12718 00000004:00080000:1.0:1746143137.021340:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eaad180/2, rc 0, transno 21474840106 00000100:00100000:1.0:1746143137.021346:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861305344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143137.021356:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e300/2, rc 0, transno 21474840102 00000100:00100000:1.0:1746143137.021359:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861305856:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143137.021367:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314c380/2, rc 0, transno 21474840099 00000100:00100000:1.0:1746143137.021371:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861305728:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143137.021378:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314d180/2, rc 0, transno 21474840100 00000100:00100000:1.0:1746143137.021381:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861306240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143137.023996:0:14796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaadc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14796:1830962861304192:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143137.024205:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093db4000/0x25aee876ca70de0d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 201 pid: 14796 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143137.024222:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.024246:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093db5400, rc 0) 00000100:00100000:3.0:1746143137.024579:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31100:x1830962858775808:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 57987us (58139us total) trans 8589942441 rc 0/0 00000100:00100000:3.0:1746143137.024588:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8227 00000100:00100000:0.0:1746143137.025081:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.025216:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858777088 00000100:00100000:3.0:1746143137.025223:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858777088 00000100:00100000:3.0:1746143137.025272:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3481 00000100:00100000:3.0:1746143137.025282:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31098:x1830962858777088:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:3.0:1746143137.025434:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31098:x1830962858777088:12345-192.168.201.28@tcp:49:cat.0 Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.025440:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3481 00000100:00080000:0.0:1746143137.026280:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143137.026409:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.026528:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.026551:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858777216 00000100:00100000:3.0:1746143137.026556:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858777216 00000100:00100000:3.0:1746143137.026594:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8232 00000100:00100000:3.0:1746143137.026600:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31105:x1830962858777216:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143137.026611:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1746143137.026615:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746143137.026624:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c475e00/0x25aee876ca70de76 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509c9 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.026661:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c475e00/0x25aee876ca70de76 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c9 expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.026670:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858777344 00010000:00010000:3.0:1746143137.026673:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c475e00/0x25aee876ca70de76 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c9 expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.026676:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858777344 00010000:00010000:3.0:1746143137.026687:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143137.026689:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143137.026692:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475e00, rc 0) 00000100:00100000:0.0:1746143137.026708:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12723 00000100:00100000:0.0:1746143137.026716:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:31100:x1830962858777344:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:3.0:1746143137.026718:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31105:x1830962858777216:12345-192.168.201.28@tcp:101:cat.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.026723:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8232 00010000:00010000:0.0:1746143137.026725:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.026735:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509d0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.026860:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.026869:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.026875:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.026877:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.026880:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [4132864->4194303] (req 4132864->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.026905:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.026914:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 7 pid: 4756 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143137.026925:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861306496:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143137.027190:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.027198:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 7 pid: 4756 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143137.027206:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861306624:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143137.027225:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.029089:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.029166:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858777600 00000100:00100000:1.0:1746143137.029172:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858777600 00002000:00100000:1.0:1746143137.029554:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880090f23100 x1830962858777600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.029564:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23100 with x1830962858777600 ext(1048576->2097151) 00002000:00010000:1.0:1746143137.029569:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f23100 00000100:00100000:1.0:1746143137.029600:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6184 00000100:00100000:1.0:1746143137.029607:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858777600:12345-192.168.201.28@tcp:3:cat.0 00000100:00080000:2.0:1746143137.030291:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143137.031067:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.031082:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.031093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.031109:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.031124:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.031136:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.031148:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.031188:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.031218:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858777856 00000100:00100000:0.0:1746143137.031222:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858777856 00000100:00100000:0.0:1746143137.031248:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858777728 00000100:00100000:0.0:1746143137.031250:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858777728 00010000:00010000:0.0:1746143137.031265:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 8 pid: 4756 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143137.031279:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6748 00000100:00100000:0.0:1746143137.031285:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858777728:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143137.031294:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.031310:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 8 pid: 4756 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143137.031320:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 8 pid: 4756 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143137.031340:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143137.031375:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858777728:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 89us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.031381:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6748 00000100:00100000:0.0:1746143137.031394:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858777984 00000100:00100000:0.0:1746143137.031396:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858777984 00010000:00010000:0.0:1746143137.031404:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 9 pid: 4756 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143137.031417:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6749 00000100:00100000:0.0:1746143137.031421:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858777984:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143137.031426:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.031434:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 9 pid: 4756 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143137.031442:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 9 pid: 4756 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143137.031622:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.031623:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.031629:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.031641:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.031675:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.031686:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861306752:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143137.031730:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4894900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.031748:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 616 00000100:00100000:0.0:1746143137.031753:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858777856:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143137.031760:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.031773:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c475e00/0x25aee876ca70de76 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c9 expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.031789:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143137.031793:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143137.031808:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1969:x1830962858777856:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 55us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.031813:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 616 00000100:00100000:0.0:1746143137.031901:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858778112 00000100:00100000:0.0:1746143137.031905:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858778112 00000100:00100000:0.0:1746143137.031926:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858778240 00000100:00100000:0.0:1746143137.031928:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858778240 00000100:00100000:0.0:1746143137.031938:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858778368 00000100:00100000:0.0:1746143137.031940:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858778368 00000100:00100000:0.0:1746143137.031949:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858778496 00000100:00100000:0.0:1746143137.031950:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858778496 00000100:00100000:0.0:1746143137.031958:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858778624 00000100:00100000:0.0:1746143137.031959:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858778624 00000100:00100000:0.0:1746143137.031970:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12724 00000100:00100000:0.0:1746143137.031975:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858778112:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.031985:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.031996:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509d7 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.032008:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032009:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032014:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 30 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032024:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 30 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032048:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b5dca00, rc 0) 00000100:00100000:0.0:1746143137.032067:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858778112:12345-192.168.201.28@tcp:101:cat.0 Request processed in 91us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.032072:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12724 00000100:00100000:0.0:1746143137.032082:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12725 00000100:00100000:0.0:1746143137.032086:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858778240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.032092:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.032098:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509de expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.032111:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032113:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032117:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032124:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032131:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b5dd000, rc 0) 00000100:00100000:0.0:1746143137.032143:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858778240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 57us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.032148:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12725 00000100:00100000:0.0:1746143137.032167:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12726 00000100:00100000:0.0:1746143137.032172:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858778368:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.032177:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.032182:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509e5 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.032192:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032193:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032197:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032205:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032217:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b5dc200, rc 0) 00000100:00100000:0.0:1746143137.032231:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858778368:12345-192.168.201.28@tcp:101:cat.0 Request processed in 58us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.032236:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12726 00000100:00100000:0.0:1746143137.032245:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12727 00000100:00100000:0.0:1746143137.032249:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858778496:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.032254:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.032259:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509ec expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.032268:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032269:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032272:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 30 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032281:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 30 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032287:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b5dd200, rc 0) 00000100:00100000:0.0:1746143137.032300:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858778496:12345-192.168.201.28@tcp:101:cat.0 Request processed in 51us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.032305:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12727 00000100:00100000:0.0:1746143137.032314:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12728 00000100:00100000:0.0:1746143137.032318:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858778624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.032326:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.032331:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509f3 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.032340:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032341:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.032345:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 30 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032353:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 30 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.032361:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b5dce00, rc 0) 00000100:00100000:0.0:1746143137.032576:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858778624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 257us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.032581:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12728 00000100:00080000:2.0:1746143137.032663:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746143137.032700:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f7aa00/0x25aee876ca70ddea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650998 expref: 7 pid: 4756 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143137.032713:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861306496:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143137.032722:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c475600/0x25aee876ca70ddce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650967 expref: 10 pid: 4756 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143137.032728:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861306624:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143137.032753:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.032760:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093db5e00, rc 0) 00000100:00100000:2.0:1746143137.033085:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:31100:x1830962858777344:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6369us (6565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.033091:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12723 00000100:00100000:1.0:1746143137.033213:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.033390:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858778752 00000100:00100000:2.0:1746143137.033394:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858778752 00000100:00100000:2.0:1746143137.033414:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12729 00000100:00100000:2.0:1746143137.033418:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858778752:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.033594:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.033601:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b807800/0x25aee876ca70dea7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c16509fa expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.033627:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861306880:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143137.033660:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.037394:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861306752:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143137.037413:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143137.037445:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858777984:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6022us (6349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.037455:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6749 00000100:00100000:1.0:1746143137.044206:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1968:x1830962858777600:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14588us (15108us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.044217:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6184 00002000:00100000:1.0:1746143137.044228:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880090f23100 x1830962858777600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.044242:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23100 with x1830962858777600 ext(1048576->2097151) 00002000:00010000:1.0:1746143137.044248:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f23100 00000100:00100000:0.0:1746143137.052815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.052999:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858779008 00000100:00100000:1.0:1746143137.053008:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858779008 00002000:00100000:1.0:1746143137.053075:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (4132864->4136959) req@ffff880094426a00 x1830962858779008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.053091:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094426a00 with x1830962858779008 ext(4132864->4136959) 00002000:00010000:1.0:1746143137.053096:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094426a00 00000100:00100000:1.0:1746143137.053128:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6185 00000100:00100000:1.0:1746143137.053136:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858779008:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143137.053301:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858779008:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 165us (493us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143137.053308:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6185 00002000:00100000:1.0:1746143137.053313:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (4132864->4136959) req@ffff880094426a00 x1830962858779008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.053319:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094426a00 with x1830962858779008 ext(4132864->4136959) 00002000:00010000:1.0:1746143137.053322:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094426a00 00002000:00010000:2.0:1746143137.053836:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143134 -> 1746143135 00000100:00100000:2.0:1746143137.053849:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861306880:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.054089:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b807800/0x25aee876ca70dea7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509fa expref: 20 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.054102:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b807800/0x25aee876ca70dea7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509fa expref: 20 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.054116:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b807800, rc 0) 00000100:00100000:2.0:1746143137.054141:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858778752:12345-192.168.201.28@tcp:101:cat.0 Request processed in 20721us (20930us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143137.054147:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12729 00000100:00100000:2.0:1746143137.054497:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.054551:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858779264 00000100:00100000:3.0:1746143137.054555:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858779264 00002000:00100000:3.0:1746143137.054576:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008e80d500 x1830962858779264/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.054584:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d500 with x1830962858779264 ext(1048576->2097151) 00002000:00010000:3.0:1746143137.054587:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80d500 00000100:00100000:3.0:1746143137.054610:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6186 00000100:00100000:3.0:1746143137.054615:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1970:x1830962858779264:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143137.061011:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.061972:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858779392 00000100:00100000:0.0:1746143137.061981:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858779392 00000100:00100000:0.0:1746143137.062019:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12730 00000100:00100000:0.0:1746143137.062048:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:31100:x1830962858779392:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143137.062066:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.062081:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a01 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.062106:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.062114:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 31 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.062122:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.062127:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.062129:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.062132:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->4390911] (req 4194304->4390911) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.062172:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.062183:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 10 pid: 8449 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143137.062196:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861307008:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143137.062276:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 31 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.062289:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 31 pid: 20836 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143137.062296:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861307136:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143137.062320:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 26 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.062327:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 26 pid: 754 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143137.062333:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861307264:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143137.062348:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4894900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.074202:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861307008:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143137.074213:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861307136:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143137.074220:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861307264:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143137.074253:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [4194304->4390911] (req 4194304->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.074267:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801352c7600, rc 0) 00000100:00100000:2.0:1746143137.074303:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31100:x1830962858779392:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 12277us (13300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.074310:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12730 00000100:00100000:3.0:1746143137.074384:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1970:x1830962858779264:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19768us (19887us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143137.074392:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6186 00002000:00100000:3.0:1746143137.074400:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008e80d500 x1830962858779264/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.074407:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d500 with x1830962858779264 ext(1048576->2097151) 00002000:00010000:3.0:1746143137.074411:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80d500 00000100:00100000:0.0:1746143137.076087:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.076124:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.076767:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858779648 00000100:00100000:2.0:1746143137.076774:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858779648 00000100:00100000:0.0:1746143137.076782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143137.076801:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 31 pid: 20836 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143137.077814:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858779776 00000100:00100000:2.0:1746143137.077819:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858779776 00000100:00100000:0.0:1746143137.077856:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143137.077857:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 27 pid: 754 timeout: 1018 lvb_type: 1 00000100:00100000:2.0:1746143137.077872:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858779520 00000100:00100000:0.0:1746143137.077872:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.077875:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858779520 00010000:00010000:2.0:1746143137.077885:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 11 pid: 8449 timeout: 1018 lvb_type: 1 00000100:00100000:0.0:1746143137.077885:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.077906:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6750 00000100:00100000:2.0:1746143137.077913:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858779648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143137.077915:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143137.077924:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143137.077931:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6751 00000100:00100000:0.0:1746143137.077936:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1971:x1830962858779776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143137.077942:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 31 pid: 20836 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143137.077942:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.077949:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 27 pid: 754 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143137.077952:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 31 pid: 20836 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143137.077971:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b5dce00/0x25aee876ca70dea0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509f3 expref: 31 pid: 20836 timeout: 1018 lvb_type: 1 00000100:00100000:1.0:1746143137.077984:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6752 00000100:00100000:1.0:1746143137.077991:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858779520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.077997:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143137.078048:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858780032 00000100:00100000:3.0:1746143137.078052:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858780032 00002000:00100000:3.0:1746143137.078075:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880094427b80 x1830962858780032/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.078083:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427b80 with x1830962858780032 ext(0->1048575) 00002000:00010000:3.0:1746143137.078086:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094427b80 00000100:00100000:3.0:1746143137.078468:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858780288 00000100:00100000:3.0:1746143137.078471:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858780288 00002000:00100000:3.0:1746143137.078484:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094427100 x1830962858780288/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.078491:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427100 with x1830962858780288 ext(1048576->2097151) 00002000:00010000:3.0:1746143137.078494:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094427100 00000100:00100000:3.0:1746143137.078500:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858780544 00000100:00100000:3.0:1746143137.078501:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858780544 00002000:00100000:3.0:1746143137.078508:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094427480 x1830962858780544/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.078514:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427480 with x1830962858780544 ext(1048576->2097151) 00002000:00010000:3.0:1746143137.078516:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094427480 00000100:00100000:3.0:1746143137.078522:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858780800 00000100:00100000:3.0:1746143137.078524:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858780800 00002000:00100000:3.0:1746143137.078530:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094425f80 x1830962858780800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.078536:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425f80 with x1830962858780800 ext(1048576->2097151) 00002000:00010000:3.0:1746143137.078539:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094425f80 00000100:00100000:3.0:1746143137.078547:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6187 00000100:00100000:3.0:1746143137.078552:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1971:x1830962858780032:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:0.0:1746143137.078620:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 27 pid: 754 timeout: 1018 lvb_type: 1 00010000:00010000:2.0:1746143137.078654:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143137.078672:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d928a00/0x25aee876ca70ddb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650960 expref: 27 pid: 754 timeout: 1018 lvb_type: 1 00010000:00010000:0.0:1746143137.078686:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143137.078691:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858779648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 777us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.078697:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6750 00000100:00100000:0.0:1746143137.078699:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858779776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 764us (2575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.078703:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6751 00000100:00100000:2.0:1746143137.078720:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6188 00000100:00100000:2.0:1746143137.078725:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858780288:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143137.079068:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6189 00000100:00100000:0.0:1746143137.079074:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858780544:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:1.0:1746143137.080057:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 11 pid: 8449 timeout: 1018 lvb_type: 1 00010000:00010000:1.0:1746143137.080069:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 11 pid: 8449 timeout: 1018 lvb_type: 1 00010000:00010000:1.0:1746143137.080082:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c10c00/0x25aee876ca70ddff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650991 expref: 11 pid: 8449 timeout: 1018 lvb_type: 1 00010000:00010000:1.0:1746143137.080100:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.080102:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.080108:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.080115:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.080144:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 31 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.080165:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e190000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861307392:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143137.080215:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143137.080234:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6190 00000100:00100000:1.0:1746143137.080241:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858780800:12345-192.168.201.28@tcp:3:cat.0 00000100:00080000:2.0:1746143137.081177:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143137.090266:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.090959:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858781056 00000100:00100000:2.0:1746143137.090967:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858781056 00002000:00100000:2.0:1746143137.091015:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009314f800 x1830962858781056/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.091047:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314f800 with x1830962858781056 ext(1048576->2097151) 00002000:00010000:2.0:1746143137.091056:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314f800 00000100:00100000:2.0:1746143137.091076:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6191 00000100:00100000:2.0:1746143137.091084:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858781056:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143137.091110:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e190000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861307392:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143137.091128:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.091165:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858779520:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13163us (14376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.091173:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6752 00000100:00100000:1.0:1746143137.093244:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.093274:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858781312 00000100:00100000:3.0:1746143137.094227:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858781312 00002000:00100000:3.0:1746143137.094268:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4386816->4390911) req@ffff88008e190000 x1830962858781312/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.094278:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190000 with x1830962858781312 ext(4386816->4390911) 00002000:00010000:3.0:1746143137.094282:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e190000 00000100:00100000:3.0:1746143137.094308:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6192 00000100:00100000:3.0:1746143137.094316:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1971:x1830962858781312:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.094414:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1971:x1830962858781312:12345-192.168.201.28@tcp:3:cat.0 Request processed in 98us (1174us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143137.094420:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6192 00002000:00100000:3.0:1746143137.094426:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4386816->4390911) req@ffff88008e190000 x1830962858781312/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.094448:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190000 with x1830962858781312 ext(4386816->4390911) 00002000:00010000:3.0:1746143137.094657:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e190000 00000100:00100000:1.0:1746143137.099463:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1971:x1830962858780032:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20902us (21599us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.099475:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6187 00002000:00100000:1.0:1746143137.099487:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880094427b80 x1830962858780032/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.099494:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427b80 with x1830962858780032 ext(0->1048575) 00002000:00010000:1.0:1746143137.099499:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094427b80 00000100:00100000:1.0:1746143137.109559:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858780800:12345-192.168.201.28@tcp:3:cat.0 Request processed in 29310us (31634us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.109569:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6190 00002000:00100000:1.0:1746143137.109580:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094425f80 x1830962858780800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.109589:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425f80 with x1830962858780800 ext(1048576->2097151) 00002000:00010000:1.0:1746143137.109594:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094425f80 00000100:00100000:2.0:1746143137.116609:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858780544:12345-192.168.201.28@tcp:3:cat.0 Request processed in 37526us (38714us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143137.116621:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6189 00002000:00100000:2.0:1746143137.116632:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880094427480 x1830962858780544/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.116641:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427480 with x1830962858780544 ext(1048576->2097151) 00002000:00010000:2.0:1746143137.116646:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094427480 00000100:00100000:1.0:1746143137.126408:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858780288:12345-192.168.201.28@tcp:3:cat.0 Request processed in 47672us (48524us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.126420:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6188 00002000:00100000:1.0:1746143137.126842:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094427100 x1830962858780288/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.126852:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427100 with x1830962858780288 ext(1048576->2097151) 00002000:00010000:1.0:1746143137.126858:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094427100 00000100:00100000:2.0:1746143137.132730:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858781056:12345-192.168.201.28@tcp:3:cat.0 Request processed in 41638us (42461us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143137.132741:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6191 00002000:00100000:2.0:1746143137.132751:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88009314f800 x1830962858781056/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.132760:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009314f800 with x1830962858781056 ext(1048576->2097151) 00002000:00010000:2.0:1746143137.132766:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009314f800 00000100:00100000:0.0:1746143137.140483:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.140549:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858781568 00000100:00100000:3.0:1746143137.140558:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858781568 00000100:00100000:3.0:1746143137.140608:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3482 00000100:00100000:3.0:1746143137.140616:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c04c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31100:x1830962858781568:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143137.141091:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c04c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31100:x1830962858781568:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 475us (614us total) trans 8589942444 rc 0/0 00000100:00100000:3.0:1746143137.141098:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3482 00000100:00100000:0.0:1746143137.155575:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.155616:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.155703:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858781696 00000100:00100000:3.0:1746143137.155711:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858781696 00000100:00100000:2.0:1746143137.155736:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858781824 00000100:00100000:2.0:1746143137.155739:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858781824 00000100:00100000:3.0:1746143137.155751:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12731 00000100:00100000:2.0:1746143137.155762:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12732 00000100:00100000:2.0:1746143137.155767:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1969:x1830962858781824:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143137.155769:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858781696:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143137.155785:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.155785:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.155799:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70debc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a08 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.155799:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092cc8e00/0x25aee876ca70deb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a0f expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143137.155839:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861307520:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143137.155839:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861307648:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143137.155957:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143137.156542:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450000 going to sleep for 11 seconds 00002000:00010000:2.0:1746143137.158106:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143135 -> 1746143136 00002000:00010000:2.0:1746143137.158112:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143135 -> 1746143136 00002000:00010000:2.0:1746143137.158113:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143135 -> 1746143136 00000100:00100000:2.0:1746143137.158133:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861307648:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.158167:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092cc8e00/0x25aee876ca70deb5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a0f expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143137.158169:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143135 -> 1746143136 00002000:00010000:3.0:1746143137.158171:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143135 -> 1746143136 00002000:00010000:3.0:1746143137.158173:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143135 -> 1746143136 00010000:00010000:2.0:1746143137.158180:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092cc8e00/0x25aee876ca70deb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a0f expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143137.158185:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861307520:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.158194:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8e00, rc 0) 00010000:00010000:3.0:1746143137.158198:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70debc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a08 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.158206:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70debc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a08 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.158225:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e934400, rc 0) 00000100:00100000:2.0:1746143137.158238:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1969:x1830962858781824:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2470us (2619us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143137.158239:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858781696:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2483us (2673us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143137.158245:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12731 00000100:00100000:2.0:1746143137.158310:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12732 00000100:00100000:0.0:1746143137.163561:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.163669:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858781952 00000100:00100000:3.0:1746143137.163677:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858781952 00000100:00100000:3.0:1746143137.163723:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12733 00000100:00100000:3.0:1746143137.163730:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:31098:x1830962858781952:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143137.163746:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.163761:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a16 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.163968:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.163976:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143137.163978:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143137.163981:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.164007:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.164017:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 29 pid: 4758 timeout: 1019 lvb_type: 0 00000100:00100000:3.0:1746143137.164100:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861307776:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143137.164619:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.168930:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.168936:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861307776:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143137.168969:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.168984:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e935600, rc 0) 00000100:00100000:2.0:1746143137.168997:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858782080 00000100:00100000:2.0:1746143137.169003:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858782080 00000100:00100000:3.0:1746143137.169061:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:31098:x1830962858781952:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5331us (5507us total) trans 0 rc 0/0 00002000:00100000:2.0:1746143137.169062:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4390911) req@ffff880094427800 x1830962858782080/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143137.169069:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12733 00002000:00100000:2.0:1746143137.169070:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427800 with x1830962858782080 ext(4194304->4390911) 00010000:00010000:2.0:1746143137.169075:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 30 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.169086:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 30 pid: 4758 timeout: 1019 lvb_type: 0 00002000:00010000:2.0:1746143137.169092:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094427800 00000100:00100000:2.0:1746143137.169120:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2023 00000100:00100000:2.0:1746143137.169126:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858782080:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143137.172677:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858782080:12345-192.168.201.28@tcp:4:cat.0 Request processed in 3541us (3747us total) trans 21474840107 rc 0/0 00000100:00100000:2.0:1746143137.172690:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2023 00002000:00100000:2.0:1746143137.172702:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4390911) req@ffff880094427800 x1830962858782080/t21474840107(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/448 e 0 to 0 dl 1746143148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.172712:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094427800 with x1830962858782080 ext(4194304->4390911) 00010000:00010000:2.0:1746143137.172723:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.172738:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00002000:00010000:2.0:1746143137.172745:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094427800 00000100:00100000:0.0:1746143137.175756:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.175798:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.176122:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858782592 00000100:00100000:1.0:1746143137.176134:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858782592 00002000:00100000:1.0:1746143137.176186:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094426d80 x1830962858782592/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.176237:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094426d80 with x1830962858782592 ext(2097152->3145727) 00010000:00010000:1.0:1746143137.176248:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.176262:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00002000:00010000:1.0:1746143137.176270:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094426d80 00000100:00100000:1.0:1746143137.176350:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858782720 00000100:00100000:1.0:1746143137.176354:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858782720 00002000:00100000:1.0:1746143137.176365:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094425500 x1830962858782720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.176373:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425500 with x1830962858782720 ext(3145728->4194303) 00010000:00010000:1.0:1746143137.176377:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 33 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.176385:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 33 pid: 4758 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143137.176390:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2024 00002000:00010000:1.0:1746143137.176392:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094425500 00000100:00100000:2.0:1746143137.176400:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858782592:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143137.176404:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2025 00000100:00100000:1.0:1746143137.176411:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+33:1969:x1830962858782720:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143137.178983:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.179017:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.179173:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858782464 00000100:00100000:3.0:1746143137.179181:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858782464 00002000:00100000:3.0:1746143137.179224:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008e80e680 x1830962858782464/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.179235:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80e680 with x1830962858782464 ext(2097152->3145727) 00002000:00010000:3.0:1746143137.179242:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80e680 00000100:00100000:3.0:1746143137.179258:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858782976 00000100:00100000:3.0:1746143137.179261:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858782976 00002000:00100000:3.0:1746143137.179271:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4132863) req@ffff88008e80c000 x1830962858782976/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.179278:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c000 with x1830962858782976 ext(3145728->4132863) 00002000:00010000:3.0:1746143137.179281:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80c000 00000100:00100000:3.0:1746143137.179294:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6193 00000100:00100000:3.0:1746143137.179300:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858782464:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143137.179702:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6194 00000100:00100000:1.0:1746143137.179715:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858782976:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.188757:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+34:1969:x1830962858782592:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12349us (12999us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143137.188769:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2024 00002000:00100000:3.0:1746143137.188781:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880094426d80 x1830962858782592/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.188790:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094426d80 with x1830962858782592 ext(2097152->3145727) 00010000:00010000:3.0:1746143137.188799:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 34 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143137.188813:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 34 pid: 4758 timeout: 1019 lvb_type: 0 00002000:00010000:3.0:1746143137.188820:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094426d80 00000100:00100000:1.0:1746143137.192350:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858782720:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15926us (16537us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.192364:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2025 00002000:00100000:1.0:1746143137.192379:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094425500 x1830962858782720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.192389:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425500 with x1830962858782720 ext(3145728->4194303) 00010000:00010000:1.0:1746143137.192400:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.192422:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00002000:00010000:1.0:1746143137.192429:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094425500 00000100:00100000:0.0:1746143137.192816:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.192908:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858783232 00000100:00100000:3.0:1746143137.192919:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858783232 00000100:00100000:3.0:1746143137.193340:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12734 00000100:00100000:3.0:1746143137.193349:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:31104:x1830962858783232:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143137.193366:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.193383:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a1d expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.193409:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 28 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.193418:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 31 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.193430:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 9 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.193436:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143137.193438:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143137.193441:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [516096->1048575] (req 516096->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.194525:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 9 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.194538:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 9 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143137.194551:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861307904:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143137.194634:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 31 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.194643:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 31 pid: 20836 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143137.194651:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861308032:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143137.194674:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 28 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.194688:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 28 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143137.194696:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861308160:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143137.194711:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.195787:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858782464:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16479us (16806us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143137.195799:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6193 00002000:00100000:2.0:1746143137.195810:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008e80e680 x1830962858782464/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.195820:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80e680 with x1830962858782464 ext(2097152->3145727) 00002000:00010000:2.0:1746143137.195827:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80e680 00000100:00100000:1.0:1746143137.198084:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858782976:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18366us (19059us total) trans 0 rc 987136/987136 00000100:00100000:1.0:1746143137.198096:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6194 00002000:00100000:1.0:1746143137.198104:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4132863) req@ffff88008e80c000 x1830962858782976/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 987136/987136 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.198467:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c000 with x1830962858782976 ext(3145728->4132863) 00002000:00010000:1.0:1746143137.198474:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80c000 00000100:00100000:3.0:1746143137.199456:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861307904:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143137.199469:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861308032:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143137.199478:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861308160:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143137.199514:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [516096->1048575] (req 516096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.199531:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e934600, rc 0) 00000100:00100000:3.0:1746143137.199716:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:31104:x1830962858783232:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6367us (6898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.199724:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12734 00000100:00100000:0.0:1746143137.200662:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.200713:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858783488 00000100:00100000:1.0:1746143137.200721:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858783488 00010000:00010000:1.0:1746143137.200746:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 28 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.200781:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6753 00000100:00100000:1.0:1746143137.200787:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858783488:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.200797:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.200816:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 28 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.200827:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 28 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.200849:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d928400/0x25aee876ca70ddab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650944 expref: 28 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.200899:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.200930:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858783488:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 142us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.200935:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6753 00000100:00100000:0.0:1746143137.201336:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.201698:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858783744 00000100:00100000:1.0:1746143137.201701:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858783744 00010000:00010000:1.0:1746143137.201716:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.201740:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6754 00000100:00100000:1.0:1746143137.201745:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1970:x1830962858783744:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.201752:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.201762:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.201771:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.201788:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801352c7600/0x25aee876ca70deae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a01 expref: 32 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.201798:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.201800:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.201805:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.201814:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.201847:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.201859:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e192d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861308288:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143137.203496:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.203596:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.203657:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858783360 00000100:00100000:3.0:1746143137.203661:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858783360 00010000:00010000:3.0:1746143137.203679:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 10 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143137.204250:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6755 00000100:00100000:3.0:1746143137.204258:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858783360:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143137.204266:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143137.204282:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 10 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:3.0:1746143137.204292:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 10 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:3.0:1746143137.204307:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b115400/0x25aee876ca70ddf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650975 expref: 10 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.204871:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.204951:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e192d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861308288:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143137.204967:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.204989:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1970:x1830962858783744:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3244us (3654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.204995:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6754 00000100:00100000:1.0:1746143137.205010:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858783616 00000100:00100000:1.0:1746143137.205013:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858783616 00010000:00010000:1.0:1746143137.205023:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 31 pid: 20836 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.205063:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6756 00000100:00100000:1.0:1746143137.205068:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858783616:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.205075:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.205083:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 31 pid: 20836 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.205092:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 31 pid: 20836 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.205111:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b5dca00/0x25aee876ca70de84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d7 expref: 31 pid: 20836 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.205121:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.205122:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.205127:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.205135:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.205168:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.205179:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e192d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861308416:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143137.205221:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143137.205372:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143137.205393:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858783360:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1136us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.205399:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6755 00000100:00100000:0.0:1746143137.206134:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.206216:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858783872 00000100:00100000:3.0:1746143137.206220:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858783872 00000100:00100000:3.0:1746143137.206241:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12735 00000100:00100000:3.0:1746143137.206246:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31105:x1830962858783872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143137.206258:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.206267:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a24 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.206279:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143137.206281:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143137.206285:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.206295:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.206307:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e934400, rc 0) 00000100:00100000:3.0:1746143137.206459:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:31105:x1830962858783872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 211us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.206464:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12735 00000100:00100000:1.0:1746143137.207149:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e192d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861308416:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143137.207177:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143137.207178:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.207198:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858783616:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2129us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.207205:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6756 00000100:00100000:2.0:1746143137.207633:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858784128 00000100:00100000:2.0:1746143137.207638:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858784128 00002000:00100000:2.0:1746143137.207667:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (516096->520191) req@ffff88009ad58000 x1830962858784128/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.207676:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58000 with x1830962858784128 ext(516096->520191) 00002000:00010000:2.0:1746143137.207680:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad58000 00000100:00100000:2.0:1746143137.208053:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6195 00000100:00100000:2.0:1746143137.208061:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858784128:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143137.208204:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858784128:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 143us (1025us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143137.208210:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6195 00002000:00100000:2.0:1746143137.208216:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fc:0x0] (516096->520191) req@ffff88009ad58000 x1830962858784128/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.208223:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58000 with x1830962858784128 ext(516096->520191) 00002000:00010000:2.0:1746143137.208226:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad58000 00000100:00100000:1.0:1746143137.208608:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.208618:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858784384 00000100:00100000:3.0:1746143137.208622:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858784384 00002000:00100000:3.0:1746143137.208645:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008e192d80 x1830962858784384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.208652:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192d80 with x1830962858784384 ext(2097152->3145727) 00002000:00010000:3.0:1746143137.208656:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e192d80 00000100:00100000:3.0:1746143137.208669:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6196 00000100:00100000:3.0:1746143137.208675:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858784384:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143137.214110:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.214192:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.214381:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858784640 00000100:00100000:2.0:1746143137.214390:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858784640 00002000:00100000:2.0:1746143137.214428:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ad58a80 x1830962858784640/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.214438:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58a80 with x1830962858784640 ext(3145728->4194303) 00002000:00010000:2.0:1746143137.214443:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad58a80 00000100:00100000:2.0:1746143137.214478:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6197 00000100:00100000:2.0:1746143137.214485:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858784640:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.215137:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858784768 00000100:00100000:3.0:1746143137.215142:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858784768 00000100:00100000:3.0:1746143137.215179:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12736 00000100:00100000:3.0:1746143137.215185:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:31104:x1830962858784768:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143137.215194:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.215209:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a2b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.215230:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.215255:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.215263:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 6 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.215269:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143137.215271:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143137.215274:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 8 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.215302:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 6 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.215312:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 6 pid: 8448 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143137.215326:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861308544:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143137.215832:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 18 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.215840:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 18 pid: 20836 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143137.215848:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861308672:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143137.216452:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.216467:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 8 pid: 4756 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143137.216476:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861308800:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143137.216521:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143137.217182:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858784384:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 8505us (8573us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143137.217191:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6196 00002000:00100000:3.0:1746143137.217199:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff88008e192d80 x1830962858784384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.217208:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e192d80 with x1830962858784384 ext(2097152->3145727) 00002000:00010000:3.0:1746143137.217212:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e192d80 00000100:00100000:0.0:1746143137.221697:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.221796:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861308544:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143137.221806:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861308672:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143137.221814:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861308800:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143137.222373:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 8 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.222392:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e935a00, rc 0) 00000100:00100000:3.0:1746143137.222441:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31104:x1830962858784768:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7254us (8247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.222450:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12736 00000100:00100000:0.0:1746143137.222657:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858784896 00000100:00100000:0.0:1746143137.222663:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858784896 00010000:00010000:0.0:1746143137.222687:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 7 pid: 8448 timeout: 1019 lvb_type: 1 00000100:00100000:0.0:1746143137.222717:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6757 00000100:00100000:0.0:1746143137.222724:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858784896:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143137.222734:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.222751:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 7 pid: 8448 timeout: 1019 lvb_type: 1 00010000:00010000:0.0:1746143137.222957:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 7 pid: 8448 timeout: 1019 lvb_type: 1 00010000:00010000:0.0:1746143137.222978:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094df0200/0x25aee876ca70dddc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165097c expref: 7 pid: 8448 timeout: 1019 lvb_type: 1 00010000:00010000:0.0:1746143137.222994:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143137.223015:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858784896:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 292us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.223021:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6757 00000100:00100000:0.0:1746143137.225166:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.226747:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858785024 00000100:00100000:2.0:1746143137.226758:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858785024 00000100:00100000:1.0:1746143137.226775:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143137.226795:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 8 pid: 4756 timeout: 1019 lvb_type: 1 00000100:00100000:0.0:1746143137.227082:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858785152 00000100:00100000:0.0:1746143137.227086:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858785152 00010000:00010000:0.0:1746143137.227102:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 19 pid: 20836 timeout: 1019 lvb_type: 1 00000100:00100000:0.0:1746143137.227144:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6758 00000100:00100000:0.0:1746143137.227160:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858785152:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143137.227175:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.227196:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 19 pid: 20836 timeout: 1019 lvb_type: 1 00010000:00010000:0.0:1746143137.227206:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 19 pid: 20836 timeout: 1019 lvb_type: 1 00000100:00100000:2.0:1746143137.227333:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6759 00000100:00100000:2.0:1746143137.227344:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858785024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143137.227358:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.229171:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b5dd000/0x25aee876ca70de8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509de expref: 19 pid: 20836 timeout: 1019 lvb_type: 1 00010000:00010000:2.0:1746143137.229190:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 8 pid: 4756 timeout: 1019 lvb_type: 1 00010000:00010000:0.0:1746143137.229196:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143137.229206:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 8 pid: 4756 timeout: 1019 lvb_type: 1 00010000:00010000:2.0:1746143137.229228:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70ddc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165094b expref: 8 pid: 4756 timeout: 1019 lvb_type: 1 00000100:00100000:0.0:1746143137.229249:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858785152:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2098us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.229255:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6758 00010000:00010000:2.0:1746143137.229260:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.229262:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.229269:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.229277:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.229309:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.229323:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861308928:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143137.229794:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.230079:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858785280 00000100:00100000:3.0:1746143137.230084:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858785280 00000100:00100000:3.0:1746143137.230106:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12737 00000100:00100000:3.0:1746143137.230110:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31098:x1830962858785280:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143137.230123:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.230134:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a32 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.230161:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.230169:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143137.230171:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143137.230175:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.230206:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.230219:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 17 pid: 4758 timeout: 1019 lvb_type: 0 00000100:00100000:3.0:1746143137.230231:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861309056:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143137.230868:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.230879:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.231173:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858784640:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16686us (17069us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143137.231184:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6197 00002000:00100000:2.0:1746143137.231193:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ad58a80 x1830962858784640/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.231202:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58a80 with x1830962858784640 ext(3145728->4194303) 00002000:00010000:2.0:1746143137.231206:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad58a80 00000100:00100000:3.0:1746143137.236981:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861309056:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143137.237020:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.237065:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a586f000, rc 0) 00000100:00100000:3.0:1746143137.237132:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31098:x1830962858785280:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7018us (7336us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.237141:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12737 00000100:00100000:2.0:1746143137.237827:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.238347:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.238745:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858785408 00000100:00100000:3.0:1746143137.238753:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858785408 00002000:00100000:3.0:1746143137.238793:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (4132864->4194303) req@ffff88008e80c700 x1830962858785408/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.238804:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c700 with x1830962858785408 ext(4132864->4194303) 00010000:00010000:3.0:1746143137.238812:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 18 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143137.238826:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 18 pid: 4758 timeout: 1019 lvb_type: 0 00002000:00010000:3.0:1746143137.238833:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e80c700 00000100:00100000:0.0:1746143137.239310:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861308928:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143137.239332:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143137.239369:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858785024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 12027us (14222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.239380:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6759 00000100:00100000:1.0:1746143137.239384:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.239483:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858785664 00000100:00100000:3.0:1746143137.239487:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858785664 00002000:00100000:3.0:1746143137.239502:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1392640->1396735) req@ffff88008e80ea00 x1830962858785664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.239510:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80ea00 with x1830962858785664 ext(1392640->1396735) 00002000:00010000:3.0:1746143137.239513:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80ea00 00000100:00100000:3.0:1746143137.239525:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2026 00000100:00100000:3.0:1746143137.239533:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858785408:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143137.239716:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6198 00000100:00100000:3.0:1746143137.239722:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1971:x1830962858785664:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143137.240619:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1971:x1830962858785664:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 893us (2268us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143137.240627:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6198 00002000:00100000:3.0:1746143137.240633:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1392640->1396735) req@ffff88008e80ea00 x1830962858785664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.240641:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80ea00 with x1830962858785664 ext(1392640->1396735) 00000100:00100000:2.0:1746143137.240645:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858785792 00002000:00010000:3.0:1746143137.240646:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e80ea00 00000100:00100000:2.0:1746143137.240650:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858785792 00000100:00100000:2.0:1746143137.240684:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12738 00000100:00100000:2.0:1746143137.240690:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:31105:x1830962858785792:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.240700:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.240714:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a39 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.240980:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143137.240982:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143137.241000:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.241011:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.241021:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801352c6e00, rc 0) 00000100:00100000:2.0:1746143137.241055:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31105:x1830962858785792:12345-192.168.201.28@tcp:101:cat.0 Request processed in 365us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.241061:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12738 00000100:00100000:3.0:1746143137.244196:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858785408:12345-192.168.201.28@tcp:4:cat.0 Request processed in 4653us (6359us total) trans 17179872841 rc 0/0 00000100:00100000:3.0:1746143137.244210:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2026 00002000:00100000:3.0:1746143137.244221:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (4132864->4194303) req@ffff88008e80c700 x1830962858785408/t17179872841(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/448 e 0 to 0 dl 1746143148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.244231:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80c700 with x1830962858785408 ext(4132864->4194303) 00010000:00010000:3.0:1746143137.244243:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 21 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143137.244260:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 21 pid: 4758 timeout: 1019 lvb_type: 0 00002000:00010000:3.0:1746143137.244268:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e80c700 00000100:00100000:0.0:1746143137.244465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.244865:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858786048 00000100:00100000:3.0:1746143137.244873:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858786048 00000100:00100000:3.0:1746143137.245535:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3483 00000100:00100000:3.0:1746143137.245543:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31104:x1830962858786048:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143137.246242:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31104:x1830962858786048:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 698us (1776us total) trans 8589942445 rc 0/0 00000100:00100000:3.0:1746143137.246248:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3483 00000100:00100000:0.0:1746143137.254132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.254257:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858786176 00000100:00100000:2.0:1746143137.254266:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858786176 00010000:00010000:2.0:1746143137.254300:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 21 pid: 4758 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143137.254323:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6760 00000100:00100000:2.0:1746143137.254328:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858786176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143137.254342:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143137.254361:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 21 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.254371:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 21 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.254394:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093db5e00/0x25aee876ca70de7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509d0 expref: 21 pid: 4758 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.254410:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.254411:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.254417:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.254423:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.254429:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.254429:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.254431:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.254435:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.254458:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.254467:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861309184:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143137.255194:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.255209:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861309312:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143137.255973:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.267178:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861309184:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143137.269297:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.269351:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861309312:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143137.269379:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143137.269615:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858786176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 15285us (15491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.269627:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6760 00000100:00100000:0.0:1746143137.269740:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.271279:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.271316:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.271339:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858786432 00000100:00100000:1.0:1746143137.271346:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858786432 00002000:00100000:1.0:1746143137.271396:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ad58380 x1830962858786432/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.271407:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58380 with x1830962858786432 ext(3145728->4194303) 00002000:00010000:1.0:1746143137.271412:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad58380 00000100:00100000:1.0:1746143137.271427:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858786688 00000100:00100000:1.0:1746143137.271431:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858786688 00002000:00100000:1.0:1746143137.271442:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009ad5b800 x1830962858786688/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.271673:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5b800 with x1830962858786688 ext(2097152->3145727) 00002000:00010000:1.0:1746143137.271677:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad5b800 00000100:00100000:1.0:1746143137.271688:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858787072 00000100:00100000:1.0:1746143137.271690:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858787072 00002000:00100000:1.0:1746143137.271701:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008e193b80 x1830962858787072/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.271714:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193b80 with x1830962858787072 ext(3145728->4194303) 00002000:00010000:1.0:1746143137.271716:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e193b80 00000100:00100000:1.0:1746143137.271725:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858787200 00000100:00100000:1.0:1746143137.271727:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858787200 00002000:00100000:1.0:1746143137.271739:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008eaadc00 x1830962858787200/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.271746:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaadc00 with x1830962858787200 ext(3145728->4194303) 00002000:00010000:1.0:1746143137.271748:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaadc00 00000100:00100000:1.0:1746143137.271759:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6199 00000100:00100000:1.0:1746143137.271766:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858786432:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143137.271807:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6200 00000100:00100000:2.0:1746143137.272013:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858786688:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143137.272202:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6201 00000100:00100000:1.0:1746143137.272208:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858787072:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143137.272282:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6202 00000100:00100000:1.0:1746143137.272287:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858787200:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143137.298759:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858786432:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26979us (29456us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.298773:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6199 00002000:00100000:1.0:1746143137.298787:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ad58380 x1830962858786432/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.298798:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58380 with x1830962858786432 ext(3145728->4194303) 00002000:00010000:1.0:1746143137.298804:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad58380 00000100:00100000:0.0:1746143137.314644:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.314674:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.314742:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858787456 00000100:00100000:0.0:1746143137.314751:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858787456 00000100:00100000:0.0:1746143137.314790:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858787328 00000100:00100000:0.0:1746143137.314793:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858787328 00000100:00100000:0.0:1746143137.314811:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12739 00000100:00100000:0.0:1746143137.314819:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858787456:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.314951:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.314971:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29600/0x25aee876ca70deed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a47 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.315025:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861309440:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143137.315066:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12740 00000100:00100000:0.0:1746143137.315072:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858787328:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.315080:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.315091:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092cc8200/0x25aee876ca70def4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a40 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.315123:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861309568:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143137.315214:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.315246:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4894900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.318936:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858786688:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 47111us (49184us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143137.318949:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6200 00002000:00100000:2.0:1746143137.318962:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009ad5b800 x1830962858786688/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.318972:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5b800 with x1830962858786688 ext(2097152->3145727) 00002000:00010000:2.0:1746143137.318979:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad5b800 00002000:00010000:0.0:1746143137.324422:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143135 -> 1746143136 00002000:00010000:0.0:1746143137.324430:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143134 -> 1746143136 00002000:00010000:0.0:1746143137.324432:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143135 -> 1746143136 00000100:00100000:0.0:1746143137.324454:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861309440:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143137.324668:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29600/0x25aee876ca70deed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a47 expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.324682:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f29600/0x25aee876ca70deed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a47 expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.324694:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f29600, rc 0) 00000100:00100000:0.0:1746143137.324736:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858787456:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9917us (10102us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143137.324744:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12739 00002000:00010000:0.0:1746143137.325203:0:26949:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime: 1746143134 -> 1746143136 00002000:00010000:0.0:1746143137.325207:0:26949:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime: 1746143134 -> 1746143136 00002000:00010000:0.0:1746143137.325209:0:26949:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime: 1746143134 -> 1746143136 00000100:00100000:0.0:1746143137.325221:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861309568:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143137.325239:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092cc8200/0x25aee876ca70def4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a40 expref: 32 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.325255:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092cc8200/0x25aee876ca70def4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a40 expref: 32 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.325264:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8200, rc 0) 00000100:00100000:0.0:1746143137.325285:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858787328:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10213us (10610us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143137.325292:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12740 00000100:00100000:1.0:1746143137.326396:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858787200:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 54105us (55076us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.326406:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6202 00002000:00100000:1.0:1746143137.326416:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008eaadc00 x1830962858787200/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.326425:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaadc00 with x1830962858787200 ext(3145728->4194303) 00002000:00010000:1.0:1746143137.326431:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eaadc00 00000100:00100000:0.0:1746143137.330927:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858787072:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 58706us (59640us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143137.330941:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6201 00002000:00100000:0.0:1746143137.330953:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008e193b80 x1830962858787072/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143137.330964:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e193b80 with x1830962858787072 ext(3145728->4194303) 00002000:00010000:0.0:1746143137.330970:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e193b80 00000100:00100000:0.0:1746143137.340775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.344978:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.345021:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858787712 00000100:00100000:0.0:1746143137.345043:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858787712 00000100:00100000:1.0:1746143137.345069:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858787968 00000100:00100000:1.0:1746143137.345078:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858787968 00002000:00100000:1.0:1746143137.345116:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009ad59f80 x1830962858787968/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.345126:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59f80 with x1830962858787968 ext(4194304->5210111) 00002000:00010000:1.0:1746143137.345132:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad59f80 00000100:00100000:1.0:1746143137.345163:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6203 00000100:00100000:1.0:1746143137.345169:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858787968:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.345442:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3301:1830962861309696:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.345500:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143137.345529:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861310208:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.345550:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143137.345565:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143137.345569:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1830962861309824:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.345587:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143137.345598:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1830962861310336:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.345611:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143137.345631:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1830962861309952:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.345647:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143137.345657:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00100000:0.0:1746143137.345659:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009ad5bb80 x1830962858787712/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143137.345661:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861310080:0@lo:400:kworker.0 00002000:00100000:0.0:1746143137.345666:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5bb80 with x1830962858787712 ext(4194304->5210111) 00002000:00010000:0.0:1746143137.345670:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5bb80 00000100:00100000:3.0:1746143137.345675:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143137.345688:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6204 00000100:00100000:0.0:1746143137.345693:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1970:x1830962858787712:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.345698:0:14792:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861309696 00000100:00100000:3.0:1746143137.345701:0:14792:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861309696 00000100:00100000:3.0:1746143137.345723:0:14792:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1746143137.345728:0:14792:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3301:x1830962861309696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.345756:0:14792:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3301:x1830962861309696:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.345765:0:14792:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1746143137.345790:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861309824 00000100:00100000:3.0:1746143137.345792:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861309824 00000100:00100000:3.0:1746143137.345814:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861310336 00000100:00100000:3.0:1746143137.345816:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861310336 00000100:00100000:3.0:1746143137.345824:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861309952 00000100:00100000:3.0:1746143137.345826:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861309952 00000100:00100000:3.0:1746143137.345839:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1746143137.345843:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830962861309824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.346067:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830962861309824:12345-0@lo:400:kworker.0 Request processed in 224us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.346072:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1746143137.346081:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1746143137.346085:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1830962861310336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.346099:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1830962861310336:12345-0@lo:400:kworker.0 Request processed in 14us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.346103:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1746143137.346110:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1746143137.346113:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1830962861309952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.346129:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1830962861309952:12345-0@lo:400:kworker.0 Request processed in 16us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.346133:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:3.0:1746143137.346167:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143137.346197:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1830962861309824:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.346205:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1830962861310336:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.346213:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3301:1830962861309696:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.349001:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861310208 00000100:00100000:3.0:1746143137.349013:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861310208 00000100:00100000:3.0:1746143137.349066:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861310080 00000100:00100000:3.0:1746143137.349068:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861310080 00000100:00100000:3.0:1746143137.349356:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1746143137.349364:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861310208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143137.349433:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1830962861309952:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.349434:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861310208:12345-0@lo:400:kworker.0 Request processed in 72us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.349440:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1746143137.349466:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1746143137.350566:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3299:x1830962861310080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.353449:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3299:x1830962861310080:12345-0@lo:400:kworker.0 Request processed in 3968us (7762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.353463:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1746143137.353786:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861310080:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.353819:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861310208:0@lo:400:kworker.0 00000100:00100000:3.0:1746143137.359130:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746143137.359147:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861310464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746143137.359219:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143137.359256:0:25353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861310464 00000100:00100000:2.0:1746143137.359267:0:25353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861310464 00000100:00100000:2.0:1746143137.359321:0:25353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1746143137.359329:0:25353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3300:x1830962861310464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746143137.359351:0:25353:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 542441472 pending 30670848 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746143137.359407:0:25353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3300:x1830962861310464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.359413:0:25353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1746143137.359651:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861310464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143137.362655:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858787968:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17476us (17674us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143137.362668:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6203 00002000:00100000:1.0:1746143137.362680:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009ad59f80 x1830962858787968/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.362691:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59f80 with x1830962858787968 ext(4194304->5210111) 00002000:00010000:1.0:1746143137.362697:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad59f80 00000100:00100000:0.0:1746143137.374346:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1970:x1830962858787712:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28643us (33568us total) trans 0 rc 1015808/1015808 00000100:00100000:0.0:1746143137.374357:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6204 00002000:00100000:0.0:1746143137.374369:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009ad5bb80 x1830962858787712/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143137.374378:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5bb80 with x1830962858787712 ext(4194304->5210111) 00002000:00010000:0.0:1746143137.374384:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5bb80 00000100:00100000:1.0:1746143137.374510:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.374574:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858788224 00000100:00100000:0.0:1746143137.374581:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858788224 00000100:00100000:0.0:1746143137.374627:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3484 00000100:00100000:0.0:1746143137.374635:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31098:x1830962858788224:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143137.375053:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31098:x1830962858788224:12345-192.168.201.28@tcp:35:cat.0 Request processed in 418us (547us total) trans 8589942446 rc 0/0 00000100:00100000:0.0:1746143137.375059:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3484 00000100:00100000:0.0:1746143137.381615:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.381663:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.381754:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858788736 00000100:00100000:1.0:1746143137.381763:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858788736 00000100:00100000:1.0:1746143137.381800:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858788608 00000100:00100000:1.0:1746143137.381802:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858788608 00000100:00100000:1.0:1746143137.381816:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12741 00000100:00100000:1.0:1746143137.381824:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858788736:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143137.381839:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143137.381854:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009532c400/0x25aee876ca70defb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a5c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.381903:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861310592:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143137.381961:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.382704:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12742 00000100:00100000:0.0:1746143137.382712:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858788608:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.382721:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.382940:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092cc8c00/0x25aee876ca70df02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a55 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.382967:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861310720:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143137.382998:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4894900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.383356:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.385345:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861310592:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143137.385375:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009532c400/0x25aee876ca70defb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a5c expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143137.386433:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858788480 00000100:00100000:3.0:1746143137.386445:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858788480 00000100:00100000:3.0:1746143137.386495:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8233 00000100:00100000:3.0:1746143137.386503:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31110:x1830962858788480:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143137.386529:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.386547:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db800/0x25aee876ca70df09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a4e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.386708:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.386722:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.386735:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.386748:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.386754:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.386760:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387332:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387341:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387347:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:3.0:1746143137.387357:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143137.387627:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387639:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387645:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387651:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800939dba00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143137.387654:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387662:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387672:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143137.387675:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143137.387680:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387685:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dba00/0x25aee876ca70df1e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387714:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387719:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387724:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387728:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800939db200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143137.387730:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387738:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387745:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143137.387747:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143137.387750:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387754:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db200/0x25aee876ca70df10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387762:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387767:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387772:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387776:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800939dac00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143137.387779:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387784:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387790:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a547b300) 00010000:00010000:3.0:1746143137.387792:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143137.387794:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143137.387799:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939dac00/0x25aee876ca70df17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143137.387830:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009532c400/0x25aee876ca70defb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a5c expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.387840:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db800/0x25aee876ca70df09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a4e expref: 203 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.387846:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009532c400, rc 0) 00010000:00010000:3.0:1746143137.387847:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939db800/0x25aee876ca70df09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a4e expref: 203 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.387856:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939db800, rc 0) 00000100:00100000:1.0:1746143137.387907:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858788736:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6083us (6299us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143137.387916:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12741 00000100:00100000:0.0:1746143137.388171:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861310720:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143137.388203:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092cc8c00/0x25aee876ca70df02 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a55 expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.388214:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092cc8c00/0x25aee876ca70df02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a55 expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.388225:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8c00, rc 0) 00000100:00100000:0.0:1746143137.388246:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858788608:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5536us (6582us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143137.388251:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12742 00000100:00100000:1.0:1746143137.392065:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.392090:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.392106:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858788992 00000100:00100000:1.0:1746143137.392114:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858788992 00000100:00100000:1.0:1746143137.392162:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858788864 00000100:00100000:1.0:1746143137.392165:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858788864 00000100:00100000:1.0:1746143137.392183:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12743 00000100:00100000:1.0:1746143137.392189:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858788992:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143137.392203:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143137.392217:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53a8800/0x25aee876ca70df2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a6a expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.392267:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861310848:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143137.392354:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12744 00000100:00100000:0.0:1746143137.392362:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858788864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.392370:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.392380:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092cc8400/0x25aee876ca70df33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a63 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.392406:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861310976:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143137.392725:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5dfdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143137.393307:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.394405:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861311104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143137.395292:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143137.395578:0:25353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861311104 00000100:00100000:2.0:1746143137.395584:0:25353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861311104 00000100:00100000:2.0:1746143137.395618:0:25353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1746143137.395625:0:25353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861311104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143137.395643:0:25353:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 545718272 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:2.0:1746143137.395674:0:25353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861311104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.395680:0:25353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1746143137.395725:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861311104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143137.396113:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861310976:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143137.396137:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092cc8400/0x25aee876ca70df33 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a63 expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143137.396163:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092cc8400/0x25aee876ca70df33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a63 expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143137.396173:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cc8400, rc 0) 00000100:00100000:2.0:1746143137.396226:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31110:x1830962858788480:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9721us (12868us total) trans 8589942447 rc 301/301 00000100:00100000:2.0:1746143137.396233:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8233 00000100:00100000:1.0:1746143137.398768:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858788864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6402us (6671us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143137.398774:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12744 00000100:00100000:1.0:1746143137.400290:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861310848:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143137.400317:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53a8800/0x25aee876ca70df2c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a6a expref: 21 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143137.400331:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53a8800/0x25aee876ca70df2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a6a expref: 21 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143137.400347:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53a8800, rc 0) 00000100:00100000:1.0:1746143137.400380:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858788992:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8190us (8324us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143137.400387:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12743 00000100:00100000:0.0:1746143137.406515:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.407499:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858789248 00000100:00100000:1.0:1746143137.407508:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858789248 00000100:00100000:1.0:1746143137.407550:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3485 00000100:00100000:1.0:1746143137.407557:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31105:x1830962858789248:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:1.0:1746143137.407719:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:31105:x1830962858789248:12345-192.168.201.28@tcp:35:cat.0 Request processed in 162us (1210us total) trans 8589942448 rc 0/0 00000100:00100000:1.0:1746143137.407727:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3485 00000100:00100000:3.0:1746143137.430386:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.430442:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858789376 00000100:00100000:1.0:1746143137.430450:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858789376 00000100:00100000:1.0:1746143137.430488:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12745 00000100:00100000:1.0:1746143137.430495:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31110:x1830962858789376:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143137.430512:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143137.430526:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a71 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.430551:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.430560:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.430572:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.430574:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.430578:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2105344->2527231] (req 2105344->2527231) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.430606:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.430616:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.430629:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861311232:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.430691:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.430698:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 26 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.430704:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861311360:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143137.430718:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143137.436966:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861311232:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143137.436979:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861311360:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.437004:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2105344->2527231] (req 2105344->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 32 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.437024:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f8e00, rc 0) 00000100:00100000:1.0:1746143137.437091:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:31110:x1830962858789376:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 6595us (6711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.437099:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12745 00000100:00100000:0.0:1746143137.441250:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.441278:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858789504 00000100:00100000:0.0:1746143137.441286:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858789504 00010000:00010000:0.0:1746143137.441316:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143137.441344:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6761 00000100:00100000:0.0:1746143137.441351:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1968:x1830962858789504:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143137.441362:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.441380:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.441390:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.441581:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e934400/0x25aee876ca70ded1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a24 expref: 32 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.441598:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143137.441632:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1968:x1830962858789504:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 280us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.441638:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6761 00000001:00080000:2.0:1746143137.446157:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840094 is committed 00000001:00080000:2.0:1746143137.446187:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840066 is committed 00000001:00080000:2.0:1746143137.446197:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840051 is committed 00000001:00080000:2.0:1746143137.446212:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840106 is committed 00000001:00080000:2.0:1746143137.446223:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840087 is committed 00000001:00080000:2.0:1746143137.446245:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840052 is committed 00000001:00080000:2.0:1746143137.446273:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840107 is committed 00000100:00100000:1.0:1746143137.448223:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.449009:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858789632 00000100:00100000:0.0:1746143137.449018:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858789632 00010000:00010000:0.0:1746143137.449066:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 9 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143137.449104:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6762 00000100:00100000:0.0:1746143137.449112:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858789632:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143137.449126:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.449146:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 9 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.449172:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 9 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.449193:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e935600/0x25aee876ca70dec3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a16 expref: 9 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.449206:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.449209:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.449215:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.449223:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.449254:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.449267:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861311488:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143137.449332:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093e40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.452345:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.452461:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858789888 00000100:00100000:2.0:1746143137.452468:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858789888 00002000:00100000:2.0:1746143137.452508:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2105344->2109439) req@ffff88009535c000 x1830962858789888/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.452517:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535c000 with x1830962858789888 ext(2105344->2109439) 00002000:00010000:2.0:1746143137.452522:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535c000 00000100:00100000:2.0:1746143137.452539:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6205 00000100:00100000:2.0:1746143137.452546:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1968:x1830962858789888:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143137.452692:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1968:x1830962858789888:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 146us (351us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143137.452699:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6205 00002000:00100000:2.0:1746143137.452704:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (2105344->2109439) req@ffff88009535c000 x1830962858789888/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.452710:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535c000 with x1830962858789888 ext(2105344->2109439) 00002000:00010000:2.0:1746143137.452713:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535c000 00000100:00100000:1.0:1746143137.452871:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16965:1830962861311488:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143137.452887:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.452909:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858789632:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3798us (4691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.452915:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6762 00000100:00100000:0.0:1746143137.464384:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.465135:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858790144 00000100:00100000:2.0:1746143137.465146:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858790144 00002000:00100000:3.0:1746143137.465278:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2523136->2527231) req@ffff88009535ea00 x1830962858790144/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.465290:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ea00 with x1830962858790144 ext(2523136->2527231) 00002000:00010000:3.0:1746143137.465296:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535ea00 00000100:00100000:3.0:1746143137.465329:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6206 00000100:00100000:3.0:1746143137.465337:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858790144:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143137.466167:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858790144:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 828us (1793us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143137.466175:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6206 00002000:00100000:3.0:1746143137.466181:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2523136->2527231) req@ffff88009535ea00 x1830962858790144/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.466188:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ea00 with x1830962858790144 ext(2523136->2527231) 00002000:00010000:3.0:1746143137.466191:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535ea00 00000100:00100000:0.0:1746143137.468721:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.468801:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858790400 00000100:00100000:1.0:1746143137.468812:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858790400 00000100:00100000:1.0:1746143137.469101:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3486 00000100:00100000:1.0:1746143137.469110:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:31110:x1830962858790400:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143137.469318:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:31110:x1830962858790400:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 202us (599us total) trans 8589942449 rc 0/0 00000100:00100000:1.0:1746143137.469325:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3486 00000100:00100000:0.0:1746143137.485276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.485402:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858790656 00000100:00100000:2.0:1746143137.485411:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858790656 00000100:00100000:2.0:1746143137.485468:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8234 00000100:00100000:2.0:1746143137.485476:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31114:x1830962858790656:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143137.485565:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.485585:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70df41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a78 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.485700:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.485713:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.485723:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.485737:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.485916:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.485923:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486067:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486075:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486080:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143137.486090:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143137.486188:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486195:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486201:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486206:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe83a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.486209:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486215:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486227:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143137.486230:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143137.486234:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486239:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83a00/0x25aee876ca70df56 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486271:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486276:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486280:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486285:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801352c6600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.486287:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486292:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486297:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143137.486299:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143137.486301:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486305:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801352c6600/0x25aee876ca70df48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486319:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486324:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486330:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486333:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe82c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.486336:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486340:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486344:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449600) 00010000:00010000:2.0:1746143137.486346:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143137.486348:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486352:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82c00/0x25aee876ca70df4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.486386:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70df41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a78 expref: 12 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.486393:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a8800/0x25aee876ca70df41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a78 expref: 12 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.486401:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53a8800, rc 0) 00000100:00100000:2.0:1746143137.486447:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31114:x1830962858790656:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 971us (1182us total) trans 8589942450 rc 301/301 00000100:00100000:2.0:1746143137.486454:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8234 00000100:00100000:0.0:1746143137.508143:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.508348:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858790912 00000100:00100000:3.0:1746143137.508358:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858790912 00000100:00100000:3.0:1746143137.508410:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8235 00000100:00100000:3.0:1746143137.508417:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31118:x1830962858790912:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143137.508444:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.508461:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550c00/0x25aee876ca70df64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a7f expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.508571:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508583:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508593:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508605:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508610:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508615:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508720:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508727:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508732:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:3.0:1746143137.508740:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143137.508815:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508822:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508827:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508831:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e550e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143137.508835:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508841:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508849:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143137.508852:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143137.508855:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508858:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550e00/0x25aee876ca70df79 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508874:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508879:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508883:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508887:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e551600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143137.508888:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508895:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508900:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143137.508901:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143137.508903:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508908:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e551600/0x25aee876ca70df6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508914:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508919:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508923:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508927:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e550000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143137.508929:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508933:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508937:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090531d00) 00010000:00010000:3.0:1746143137.508939:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143137.508940:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508944:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550000/0x25aee876ca70df72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143137.508974:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550c00/0x25aee876ca70df64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a7f expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.508981:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e550c00/0x25aee876ca70df64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a7f expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.508988:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e550c00, rc 0) 00000100:00100000:3.0:1746143137.509057:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31118:x1830962858790912:12345-192.168.201.28@tcp:101:cat.0 Request processed in 638us (923us total) trans 8589942451 rc 301/301 00000100:00100000:3.0:1746143137.509065:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8235 00000100:00100000:0.0:1746143137.511136:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.512428:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.512709:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858791168 00000100:00100000:0.0:1746143137.512718:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858791168 00000100:00100000:0.0:1746143137.512759:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12746 00000100:00100000:0.0:1746143137.512766:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31114:x1830962858791168:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143137.512783:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.512800:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a8d expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.513006:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.513016:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.513024:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.513025:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.513029:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2834432->3117055] (req 2834432->3117055) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.513072:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.513086:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 19 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143137.513098:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861311616:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143137.513196:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.513205:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 9 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143137.513213:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861311744:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143137.513240:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093e40300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.514016:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858791040 00000100:00100000:2.0:1746143137.514022:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858791040 00000100:00100000:2.0:1746143137.514078:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8236 00000100:00100000:2.0:1746143137.514084:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31118:x1830962858791040:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.514099:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.514112:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83200/0x25aee876ca70df8e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a86 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.514199:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.514212:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.514223:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143137.514247:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143137.514251:0:14795:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143137.514265:0:14795:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143137.514285:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe83200/0x25aee876ca70df8e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 14 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.514310:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.514317:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143137.514320:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143137.514322:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82200, rc 0) 00000100:00100000:2.0:1746143137.514350:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31118:x1830962858791040:12345-192.168.201.28@tcp:101:cat.0 Request processed in 267us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.514360:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8236 00000100:00100000:0.0:1746143137.514914:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861311616:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143137.514926:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861311744:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143137.514947:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2834432->3117055] (req 2834432->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.514958:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a28800, rc 0) 00000100:00100000:0.0:1746143137.516322:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31114:x1830962858791168:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3551us (3899us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.516331:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12746 00000100:00100000:0.0:1746143137.518199:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.518244:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.518623:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858791296 00000100:00100000:2.0:1746143137.518631:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858791296 00010000:00010000:2.0:1746143137.518664:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 9 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143137.518848:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.518872:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.518890:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858791552 00000100:00100000:0.0:1746143137.518894:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858791552 00000100:00100000:0.0:1746143137.518917:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858791680 00000100:00100000:0.0:1746143137.518919:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858791680 00000100:00100000:0.0:1746143137.518933:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12747 00000100:00100000:0.0:1746143137.518939:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1970:x1830962858791552:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.518958:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.518972:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a29400/0x25aee876ca70df9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a94 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.519023:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861311872:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143137.519105:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093e40300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.519664:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858791424 00000100:00100000:2.0:1746143137.519667:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858791424 00010000:00010000:2.0:1746143137.519681:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 20 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.519753:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6763 00000100:00100000:1.0:1746143137.519761:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858791296:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.519772:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.519795:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.519811:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.519831:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a586f000/0x25aee876ca70dedf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a32 expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143137.519869:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6764 00000100:00100000:2.0:1746143137.519876:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858791424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143137.519883:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143137.519892:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 20 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.519902:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 20 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.519915:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801352c6e00/0x25aee876ca70dee6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a39 expref: 20 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.519930:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.519932:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.519940:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.519952:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.519976:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 9 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.519985:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861312000:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143137.520010:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.520028:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12748 00000100:00100000:2.0:1746143137.520051:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858791680:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.520058:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143137.520336:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.520358:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858791296:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 597us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.520365:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6763 00010000:00010000:2.0:1746143137.520683:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe82400/0x25aee876ca70dfa3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650a9b expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.520711:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861312128:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143137.521261:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.521532:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009535ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21048:1830962861311872:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.521559:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a29400/0x25aee876ca70df9c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a94 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.521570:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a29400/0x25aee876ca70df9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a94 expref: 9 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.521578:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a29400, rc 0) 00000100:00100000:2.0:1746143137.521605:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1970:x1830962858791552:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2665us (2757us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143137.521612:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12747 00000100:00100000:0.0:1746143137.525589:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.525959:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858791936 00000100:00100000:3.0:1746143137.525967:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858791936 00002000:00100000:3.0:1746143137.526011:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2834432->2838527) req@ffff88009535ce00 x1830962858791936/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.526020:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ce00 with x1830962858791936 ext(2834432->2838527) 00002000:00010000:3.0:1746143137.526026:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009535ce00 00000100:00100000:2.0:1746143137.526112:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861312128:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.526143:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe82400/0x25aee876ca70dfa3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a9b expref: 10 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.526165:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe82400/0x25aee876ca70dfa3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a9b expref: 10 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.526177:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82400, rc 0) 00000100:00100000:2.0:1746143137.526222:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858791680:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6170us (7348us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143137.526230:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12748 00000100:00100000:2.0:1746143137.526268:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e80fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861312000:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143137.526277:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143137.526295:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858791424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6420us (8051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.526302:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6764 00000100:00100000:3.0:1746143137.526637:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6207 00000100:00100000:3.0:1746143137.526645:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858791936:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143137.527780:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858791936:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1134us (2197us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143137.527786:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6207 00002000:00100000:3.0:1746143137.527793:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2834432->2838527) req@ffff88009535ce00 x1830962858791936/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.527801:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ce00 with x1830962858791936 ext(2834432->2838527) 00002000:00010000:3.0:1746143137.527806:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009535ce00 00000100:00100000:0.0:1746143137.532882:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.532993:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.533078:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858792704 00000100:00100000:2.0:1746143137.533087:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858792704 00002000:00100000:2.0:1746143137.533125:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fc:0x0] (0->516095) req@ffff88009535c380 x1830962858792704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.533134:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535c380 with x1830962858792704 ext(0->516095) 00002000:00010000:2.0:1746143137.533139:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535c380 00000100:00100000:0.0:1746143137.533164:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.533172:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6208 00000100:00100000:2.0:1746143137.533180:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1971:x1830962858792704:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143137.533182:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858792320 00000100:00100000:0.0:1746143137.533186:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858792320 00002000:00100000:0.0:1746143137.533205:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3112960->3117055) req@ffff8800a84e4e00 x1830962858792320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143137.533213:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e4e00 with x1830962858792320 ext(3112960->3117055) 00002000:00010000:0.0:1746143137.533216:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e4e00 00000100:00100000:0.0:1746143137.533227:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858792448 00000100:00100000:0.0:1746143137.533229:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858792448 00002000:00100000:0.0:1746143137.533239:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1396736->2097151) req@ffff8800a84e5180 x1830962858792448/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143137.533245:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5180 with x1830962858792448 ext(1396736->2097151) 00002000:00010000:0.0:1746143137.533248:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e5180 00000100:00100000:0.0:1746143137.533258:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6209 00000100:00100000:0.0:1746143137.533263:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858792320:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143137.533337:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6210 00000100:00100000:1.0:1746143137.533353:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858792448:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143137.533390:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858792320:12345-192.168.201.28@tcp:3:cat.0 Request processed in 125us (396us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143137.533398:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6209 00002000:00100000:0.0:1746143137.533404:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3112960->3117055) req@ffff8800a84e4e00 x1830962858792320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143137.534065:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e4e00 with x1830962858792320 ext(3112960->3117055) 00002000:00010000:0.0:1746143137.534069:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e4e00 00000100:00100000:0.0:1746143137.535722:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.535742:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858792960 00000100:00100000:2.0:1746143137.535748:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858792960 00000100:00100000:2.0:1746143137.536133:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3487 00000100:00100000:2.0:1746143137.536141:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31114:x1830962858792960:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143137.536586:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31114:x1830962858792960:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 444us (868us total) trans 8589942452 rc 0/0 00000100:00100000:2.0:1746143137.536593:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3487 00010000:00010000:0.0:1746143137.539169:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143137.545648:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1971:x1830962858792704:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12460us (12765us total) trans 0 rc 516096/516096 00000100:00100000:2.0:1746143137.545661:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6208 00002000:00100000:2.0:1746143137.545672:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2fc:0x0] (0->516095) req@ffff88009535c380 x1830962858792704/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 516096/516096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.545681:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535c380 with x1830962858792704 ext(0->516095) 00002000:00010000:2.0:1746143137.545685:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535c380 00000100:00100000:1.0:1746143137.548521:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858792448:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15163us (15345us total) trans 0 rc 700416/700416 00000100:00100000:1.0:1746143137.548535:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6210 00002000:00100000:1.0:1746143137.548546:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1396736->2097151) req@ffff8800a84e5180 x1830962858792448/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.548556:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5180 with x1830962858792448 ext(1396736->2097151) 00002000:00010000:1.0:1746143137.548563:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e5180 00000100:00100000:0.0:1746143137.559995:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.560535:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858793088 00000100:00100000:2.0:1746143137.560549:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858793088 00000100:00100000:2.0:1746143137.560607:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12749 00000100:00100000:2.0:1746143137.560615:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31118:x1830962858793088:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.560634:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.560652:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650aa2 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.560687:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.560701:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143137.560702:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143137.560706:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 9 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.560737:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.560750:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 12 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143137.560763:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861312256:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143137.562534:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.565131:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861312256:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143137.565177:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 9 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.565195:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82a00, rc 0) 00000100:00100000:2.0:1746143137.565251:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31118:x1830962858793088:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4635us (5265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.565260:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12749 00000100:00100000:0.0:1746143137.566399:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.566472:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858793216 00000100:00100000:1.0:1746143137.566479:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858793216 00002000:00100000:1.0:1746143137.566521:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2105344->2527231) req@ffff8800a84e6a00 x1830962858793216/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.566537:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e6a00 with x1830962858793216 ext(2105344->2527231) 00010000:00010000:1.0:1746143137.566545:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 13 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.566557:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 13 pid: 21048 timeout: 1019 lvb_type: 0 00002000:00010000:1.0:1746143137.566563:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a84e6a00 00000100:00100000:1.0:1746143137.566593:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2027 00000100:00100000:1.0:1746143137.566600:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858793216:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:1.0:1746143137.574789:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858793216:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 8179us (8381us total) trans 21474840108 rc 0/0 00000100:00100000:1.0:1746143137.574801:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2027 00002000:00100000:1.0:1746143137.574812:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2105344->2527231) req@ffff8800a84e6a00 x1830962858793216/t21474840108(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/448 e 0 to 0 dl 1746143148 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.574821:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e6a00 with x1830962858793216 ext(2105344->2527231) 00010000:00010000:1.0:1746143137.574831:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 15 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.574845:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 15 pid: 21048 timeout: 1019 lvb_type: 0 00002000:00010000:1.0:1746143137.574852:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a84e6a00 00000100:00100000:0.0:1746143137.581239:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.581332:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858793344 00000100:00100000:2.0:1746143137.581344:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858793344 00010000:00010000:2.0:1746143137.581392:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 15 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143137.581447:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6765 00000100:00100000:2.0:1746143137.581455:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1970:x1830962858793344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143137.581686:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143137.581717:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 15 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.581729:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 15 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.581753:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800901f8e00/0x25aee876ca70df3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2105344->2527231) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a71 expref: 15 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.581785:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.581787:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.581794:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 8 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.581803:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 8 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.581838:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 8 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.581849:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861312384:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143137.583028:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.587180:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861312384:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143137.587204:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143137.587250:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1970:x1830962858793344:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5794us (6018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.587262:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6765 00000100:00100000:0.0:1746143137.602852:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.602911:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.602974:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858793728 00000100:00100000:2.0:1746143137.602977:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858793856 00000100:00100000:2.0:1746143137.602985:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858793856 00000100:00100000:1.0:1746143137.602985:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858793728 00002000:00100000:1.0:1746143137.603058:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a84e7100 x1830962858793728/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.603061:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a84e6d80 x1830962858793856/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.603068:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e7100 with x1830962858793728 ext(2097152->3145727) 00002000:00100000:2.0:1746143137.603069:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e6d80 with x1830962858793856 ext(3145728->4194303) 00002000:00010000:2.0:1746143137.603074:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e6d80 00002000:00010000:1.0:1746143137.603074:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e7100 00000100:00100000:2.0:1746143137.603099:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6211 00000100:00100000:2.0:1746143137.603108:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858793856:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143137.603139:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6212 00000100:00100000:1.0:1746143137.603155:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858793728:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143137.606124:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.606162:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858794112 00000100:00100000:0.0:1746143137.606168:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858794112 00002000:00100000:0.0:1746143137.606205:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3428351) req@ffff8800a84e6680 x1830962858794112/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 504/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143137.606213:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e6680 with x1830962858794112 ext(2097152->3428351) 00002000:00010000:0.0:1746143137.606219:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e6680 00000100:00100000:0.0:1746143137.606237:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6213 00000100:00100000:0.0:1746143137.606244:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858794112:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143137.607985:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.608009:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858794240 00000100:00100000:2.0:1746143137.608014:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858794240 00002000:00100000:2.0:1746143137.608069:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3428352->4194303) req@ffff880090f20000 x1830962858794240/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.608080:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20000 with x1830962858794240 ext(3428352->4194303) 00002000:00010000:2.0:1746143137.608086:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f20000 00000100:00100000:2.0:1746143137.608103:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6214 00000100:00100000:2.0:1746143137.608111:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858794240:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.622888:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858793856:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19769us (19965us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143137.622900:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6211 00002000:00100000:3.0:1746143137.622913:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a84e6d80 x1830962858793856/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.622923:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e6d80 with x1830962858793856 ext(3145728->4194303) 00002000:00010000:3.0:1746143137.622929:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e6d80 00000100:00100000:1.0:1746143137.637234:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858793728:12345-192.168.201.28@tcp:3:cat.0 Request processed in 34074us (34379us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.637248:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6212 00002000:00100000:1.0:1746143137.637263:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a84e7100 x1830962858793728/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.637273:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e7100 with x1830962858793728 ext(2097152->3145727) 00002000:00010000:1.0:1746143137.637281:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e7100 00000100:00100000:2.0:1746143137.639270:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858794240:12345-192.168.201.28@tcp:3:cat.0 Request processed in 31151us (31284us total) trans 0 rc 765952/765952 00000100:00100000:2.0:1746143137.639281:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6214 00002000:00100000:2.0:1746143137.639291:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3428352->4194303) req@ffff880090f20000 x1830962858794240/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.639299:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20000 with x1830962858794240 ext(3428352->4194303) 00002000:00010000:2.0:1746143137.639305:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f20000 00000100:00100000:0.0:1746143137.642751:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.642963:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858794624 00000100:00100000:2.0:1746143137.642971:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858794624 00000100:00100000:2.0:1746143137.643055:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8237 00000100:00100000:2.0:1746143137.643064:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:31122:x1830962858794624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.643087:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.643106:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7c600/0x25aee876ca70dfb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650aa9 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.644077:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644091:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644103:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644124:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644131:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644138:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644268:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644282:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644288:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143137.644297:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143137.644378:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644384:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644391:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644396:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a7d400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.644400:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644406:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644416:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143137.644419:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143137.644422:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644427:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d400/0x25aee876ca70dfc6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644449:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644458:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644462:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644467:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a7da00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.644469:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644474:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.644481:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143137.644482:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143137.644485:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00000100:00100000:1.0:1746143137.645869:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1968:x1830962858794112:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39618us (39746us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746143137.645873:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00000100:00100000:1.0:1746143137.645881:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6213 00010000:00010000:2.0:1746143137.645887:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00002000:00100000:1.0:1746143137.645891:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3428351) req@ffff8800a84e6680 x1830962858794112/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 504/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143137.645892:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.645899:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00002000:00100000:1.0:1746143137.645902:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e6680 with x1830962858794112 ext(2097152->3428351) 00010000:00010000:2.0:1746143137.645903:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a7d800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.645906:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00002000:00010000:1.0:1746143137.645906:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e6680 00010000:00010000:2.0:1746143137.645915:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.645923:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449600) 00010000:00010000:2.0:1746143137.645925:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143137.645928:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.645933:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7d800/0x25aee876ca70dfbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.645974:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7c600/0x25aee876ca70dfb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa9 expref: 206 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.645981:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a7c600/0x25aee876ca70dfb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa9 expref: 206 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.645989:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7c600, rc 0) 00000100:00100000:2.0:1746143137.646366:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:31122:x1830962858794624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3302us (3626us total) trans 8589942453 rc 301/301 00000100:00100000:2.0:1746143137.646373:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8237 00000100:00100000:0.0:1746143137.657281:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.657335:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.658110:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858794752 00000100:00100000:2.0:1746143137.658123:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858794752 00000100:00100000:2.0:1746143137.658194:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858794880 00000100:00100000:2.0:1746143137.658196:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858794880 00000100:00100000:2.0:1746143137.658223:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12750 00000100:00100000:2.0:1746143137.658231:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1971:x1830962858794752:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.658249:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.658268:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfd4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ab0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.658324:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861312512:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143137.658427:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.658464:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12751 00000100:00100000:2.0:1746143137.658470:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858794880:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.658478:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.658488:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7d600/0x25aee876ca70dfdb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ab7 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.658515:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861312640:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143137.658537:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.660993:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.661049:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.661227:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861312640:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.661254:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a7d600/0x25aee876ca70dfdb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ab7 expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.661267:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a7d600/0x25aee876ca70dfdb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ab7 expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.661285:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7d600, rc 0) 00000100:00100000:2.0:1746143137.661325:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858794880:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2855us (3989us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143137.661333:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12751 00000100:00100000:2.0:1746143137.661353:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858795008 00000100:00100000:2.0:1746143137.661358:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858795008 00000100:00100000:2.0:1746143137.661380:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858795136 00000100:00100000:2.0:1746143137.661383:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858795136 00000100:00100000:2.0:1746143137.661396:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12752 00000100:00100000:2.0:1746143137.661402:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858795008:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.661414:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.661426:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650abe expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.661442:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.661445:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.661453:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.661468:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.661478:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7ce00, rc 0) 00000100:00100000:2.0:1746143137.661495:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1970:x1830962858795008:12345-192.168.201.28@tcp:101:cat.0 Request processed in 94us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.661501:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12752 00000100:00100000:2.0:1746143137.661511:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12753 00000100:00100000:2.0:1746143137.661517:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858795136:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.661525:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.661533:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7d800/0x25aee876ca70dfe9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ac5 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.661566:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861312768:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143137.661570:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861312512:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143137.661588:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfd4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ab0 expref: 16 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.661597:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a7da00/0x25aee876ca70dfd4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ab0 expref: 16 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.661609:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7da00, rc 0) 00000100:00100000:2.0:1746143137.661610:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143137.661628:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1971:x1830962858794752:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3398us (4356us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143137.661634:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12750 00000100:00100000:2.0:1746143137.665305:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861312768:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.665341:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a7d800/0x25aee876ca70dfe9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ac5 expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.665357:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a7d800/0x25aee876ca70dfe9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ac5 expref: 20 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.665368:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7d800, rc 0) 00000100:00100000:2.0:1746143137.665425:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1970:x1830962858795136:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3906us (4374us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143137.665434:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12753 00000100:00100000:0.0:1746143137.669754:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.670075:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.670183:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858795520 00000100:00100000:1.0:1746143137.670194:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858795520 00002000:00100000:1.0:1746143137.670240:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a84e7b80 x1830962858795520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143137.670244:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858795264 00000100:00100000:2.0:1746143137.670250:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858795264 00002000:00100000:1.0:1746143137.670258:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e7b80 with x1830962858795520 ext(4194304->5210111) 00002000:00010000:1.0:1746143137.670269:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e7b80 00000100:00100000:2.0:1746143137.670287:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12754 00000100:00100000:1.0:1746143137.670287:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6215 00000100:00100000:1.0:1746143137.670295:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1969:x1830962858795520:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143137.670296:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:31122:x1830962858795264:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.670310:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.670410:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650acc expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.670439:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 9 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.670447:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143137.670449:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143137.670452:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.670485:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 9 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.670498:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 9 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143137.670510:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861312896:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143137.670751:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.673242:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861312896:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143137.673269:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.673286:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7c200, rc 0) 00000100:00100000:2.0:1746143137.673329:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:31122:x1830962858795264:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3034us (3585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.673338:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12754 00000100:00100000:0.0:1746143137.676945:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.677018:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858795648 00000100:00100000:2.0:1746143137.677027:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858795648 00002000:00100000:2.0:1746143137.677092:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (516096->1048575) req@ffff8800a84e5880 x1830962858795648/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.677103:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5880 with x1830962858795648 ext(516096->1048575) 00010000:00010000:2.0:1746143137.677114:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 11 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.677135:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 11 pid: 8449 timeout: 1019 lvb_type: 0 00002000:00010000:2.0:1746143137.677143:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a84e5880 00000100:00100000:2.0:1746143137.677185:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2028 00000100:00100000:2.0:1746143137.677194:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858795648:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143137.684663:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858795520:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14354us (14615us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143137.684677:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6215 00002000:00100000:1.0:1746143137.684691:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800a84e7b80 x1830962858795520/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.684701:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e7b80 with x1830962858795520 ext(4194304->5210111) 00002000:00010000:1.0:1746143137.684708:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e7b80 00000100:00100000:0.0:1746143137.691719:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.691996:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858795776 00000100:00100000:3.0:1746143137.692996:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858795776 00000100:00100000:3.0:1746143137.693075:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12755 00000100:00100000:3.0:1746143137.693085:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858795776:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143137.693105:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.693127:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70dff7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ad3 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143137.693813:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861313024:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143137.694125:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.694319:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858795648:12345-192.168.201.28@tcp:4:cat.0 Request processed in 17124us (17383us total) trans 21474840109 rc 0/0 00000100:00100000:2.0:1746143137.694329:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2028 00002000:00100000:2.0:1746143137.694340:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (516096->1048575) req@ffff8800a84e5880 x1830962858795648/t21474840109(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/448 e 0 to 0 dl 1746143148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.694349:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5880 with x1830962858795648 ext(516096->1048575) 00010000:00010000:2.0:1746143137.694356:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 13 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.694369:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 13 pid: 8449 timeout: 1019 lvb_type: 0 00002000:00010000:2.0:1746143137.694376:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a84e5880 00000100:00100000:3.0:1746143137.697394:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861313024:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143137.697429:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70dff7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ad3 expref: 12 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.697443:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090014200/0x25aee876ca70dff7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ad3 expref: 12 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.697472:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090014200, rc 0) 00000100:00100000:3.0:1746143137.697518:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858795776:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4434us (5809us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143137.697527:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12755 00000100:00100000:2.0:1746143137.701624:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.701702:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858795904 00000100:00100000:0.0:1746143137.701711:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858795904 00010000:00010000:0.0:1746143137.701757:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 11 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143137.701787:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6766 00000100:00100000:0.0:1746143137.701794:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858795904:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143137.701808:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143137.701829:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 11 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.701841:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 11 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.701864:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e934600/0x25aee876ca70deca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a1d expref: 11 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143137.701903:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.701905:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.701913:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.701922:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.701958:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143137.701970:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861313152:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143137.702062:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093e40240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.704316:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.704413:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858796160 00000100:00100000:0.0:1746143137.704419:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858796160 00000100:00100000:0.0:1746143137.704465:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8238 00000100:00100000:0.0:1746143137.704473:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:31124:x1830962858796160:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143137.704496:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.704513:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70dffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ada expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.704627:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704638:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704649:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704659:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704664:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704669:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704766:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704773:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704778:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143137.704785:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143137.704865:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704872:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704877:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704882:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bdca00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143137.704886:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704891:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704901:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143137.704903:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143137.704907:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704912:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdca00/0x25aee876ca70e013 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704928:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704933:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704938:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704942:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bdd400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143137.704944:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704948:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704954:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:0.0:1746143137.704956:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143137.704958:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704962:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bdd400/0x25aee876ca70e005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704969:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704974:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704980:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704984:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bddc00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143137.704988:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704993:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.704998:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a55dd300) 00010000:00010000:0.0:1746143137.705000:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143137.705002:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.705007:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bddc00/0x25aee876ca70e00c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143137.705078:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70dffe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ada expref: 207 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.705086:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70dffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ada expref: 207 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.705096:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4aa9a00, rc 0) 00000100:00100000:0.0:1746143137.705163:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:31124:x1830962858796160:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 689us (852us total) trans 8589942454 rc 301/301 00000100:00100000:0.0:1746143137.705170:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8238 00000100:00100000:0.0:1746143137.705753:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.705886:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861313152:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143137.705887:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858796288 00000100:00100000:3.0:1746143137.705892:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858796288 00010000:00010000:1.0:1746143137.705904:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143137.705919:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12756 00000100:00100000:3.0:1746143137.705925:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858796288:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143137.705936:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143137.705938:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858795904:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4144us (4325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.705946:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6766 00010000:00010000:3.0:1746143137.705947:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ae1 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143137.705964:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143137.705965:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143137.705973:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.705993:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.706002:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090014400, rc 0) 00000100:00100000:3.0:1746143137.706021:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858796288:12345-192.168.201.28@tcp:101:cat.0 Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143137.706027:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12756 00000100:00100000:0.0:1746143137.706961:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.707348:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858796544 00000100:00100000:2.0:1746143137.707353:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858796544 00002000:00100000:2.0:1746143137.707386:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092a73b80 x1830962858796544/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.707398:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73b80 with x1830962858796544 ext(0->1048575) 00002000:00010000:2.0:1746143137.707402:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a73b80 00000100:00100000:2.0:1746143137.707431:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6216 00000100:00100000:2.0:1746143137.707438:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858796544:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143137.712287:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.717445:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858796800 00000100:00100000:2.0:1746143137.717460:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858796800 00000100:00100000:2.0:1746143137.719119:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3488 00000100:00100000:2.0:1746143137.719132:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c04ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31118:x1830962858796800:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:2.0:1746143137.719386:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c04ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:31118:x1830962858796800:12345-192.168.201.28@tcp:35:cat.0 Request processed in 256us (7109us total) trans 8589942455 rc 0/0 00000100:00100000:2.0:1746143137.719393:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3488 00000100:00100000:2.0:1746143137.731778:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858796544:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24326us (24806us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143137.731794:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6216 00002000:00100000:2.0:1746143137.731811:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880092a73b80 x1830962858796544/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.731823:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73b80 with x1830962858796544 ext(0->1048575) 00002000:00010000:2.0:1746143137.731830:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a73b80 00000100:00100000:2.0:1746143137.747357:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.747641:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858796928 00000100:00100000:0.0:1746143137.747651:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858796928 00000100:00100000:0.0:1746143137.747706:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12757 00000100:00100000:0.0:1746143137.747715:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:31122:x1830962858796928:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.747737:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.747757:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ae8 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.747790:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.747798:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143137.747800:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143137.747803:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.747832:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.747844:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 7 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143137.747855:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861313280:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143137.748865:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093e406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.750815:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.750817:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861313280:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.750846:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.750864:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b12f200, rc 0) 00000100:00100000:2.0:1746143137.751087:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858797056 00000100:00100000:2.0:1746143137.751093:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858797056 00002000:00100000:2.0:1746143137.751130:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1396735) req@ffff880092a72d80 x1830962858797056/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.751158:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72d80 with x1830962858797056 ext(1048576->1396735) 00010000:00010000:2.0:1746143137.751165:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 8 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143137.751177:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 8 pid: 8449 timeout: 1019 lvb_type: 0 00002000:00010000:2.0:1746143137.751183:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a72d80 00000100:00100000:2.0:1746143137.751306:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2029 00000100:00100000:1.0:1746143137.751306:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:31122:x1830962858796928:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3580us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.751314:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858797056:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143137.751314:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12757 00000100:00100000:3.0:1746143137.760315:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858797056:12345-192.168.201.28@tcp:4:cat.0 Request processed in 8990us (9495us total) trans 17179872842 rc 0/0 00000100:00100000:3.0:1746143137.760330:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2029 00002000:00100000:3.0:1746143137.760343:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1396735) req@ffff880092a72d80 x1830962858797056/t17179872842(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/448 e 0 to 0 dl 1746143148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.760353:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72d80 with x1830962858797056 ext(1048576->1396735) 00010000:00010000:3.0:1746143137.760364:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143137.760380:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00002000:00010000:3.0:1746143137.760388:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a72d80 00000100:00100000:2.0:1746143137.764905:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.765093:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.765156:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858797312 00000100:00100000:2.0:1746143137.765164:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858797312 00000100:00100000:1.0:1746143137.765167:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858797440 00000100:00100000:1.0:1746143137.765170:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858797440 00010000:00010000:1.0:1746143137.765204:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143137.765220:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8239 00000100:00100000:1.0:1746143137.765228:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6767 00000100:00100000:2.0:1746143137.765229:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:31127:x1830962858797312:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:1.0:1746143137.765232:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858797440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.765246:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143137.765250:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.765268:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e02f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650aef expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.765268:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.765280:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.765300:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e935a00/0x25aee876ca70ded8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a2b expref: 10 pid: 8449 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.765327:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.765329:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.765336:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.765343:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.765560:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765570:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143137.765573:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 19 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.765579:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:1.0:1746143137.765585:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861313408:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143137.765594:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765599:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765603:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:1.0:1746143137.765663:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143137.765712:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765720:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765727:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143137.765736:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143137.765819:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765827:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765833:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765838:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fb1c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.765842:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765848:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765858:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143137.765860:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143137.765865:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765869:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1c00/0x25aee876ca70e044 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765894:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765900:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765904:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765922:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fb0200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.765925:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765930:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765937:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143137.765939:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143137.765942:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765946:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0200/0x25aee876ca70e036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765955:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765961:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765966:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765974:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fb1200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.765977:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765982:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765988:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449e00) 00010000:00010000:2.0:1746143137.765990:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143137.765992:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.765996:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e03d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.766128:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e02f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aef expref: 17 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.766135:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e02f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aef expref: 17 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.766153:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fb0400, rc 0) 00000100:00100000:2.0:1746143137.766181:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31127:x1830962858797312:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 953us (1089us total) trans 8589942456 rc 301/301 00000100:00100000:2.0:1746143137.766191:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8239 00000100:00100000:1.0:1746143137.767298:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861313408:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143137.767314:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.767348:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858797440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2114us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.767356:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6767 00000100:00100000:0.0:1746143137.771692:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.772002:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858797696 00000100:00100000:3.0:1746143137.772010:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858797696 00002000:00100000:3.0:1746143137.772080:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880092a72680 x1830962858797696/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.772097:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72680 with x1830962858797696 ext(1048576->2097151) 00002000:00010000:3.0:1746143137.772103:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a72680 00000100:00100000:3.0:1746143137.772122:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6217 00000100:00100000:3.0:1746143137.772129:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858797696:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.786831:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858797696:12345-192.168.201.28@tcp:3:cat.0 Request processed in 14693us (15141us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143137.786843:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6217 00002000:00100000:3.0:1746143137.786855:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880092a72680 x1830962858797696/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.786864:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72680 with x1830962858797696 ext(1048576->2097151) 00002000:00010000:3.0:1746143137.786870:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a72680 00000100:00100000:0.0:1746143137.800429:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.801048:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858797952 00000100:00100000:3.0:1746143137.801057:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858797952 00002000:00100000:3.0:1746143137.801102:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880092a72300 x1830962858797952/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.801112:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72300 with x1830962858797952 ext(2097152->3145727) 00002000:00010000:3.0:1746143137.801118:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a72300 00000100:00100000:3.0:1746143137.801192:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6218 00000100:00100000:3.0:1746143137.801199:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858797952:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.811737:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858797952:12345-192.168.201.28@tcp:3:cat.0 Request processed in 10527us (11308us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143137.811750:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6218 00002000:00100000:3.0:1746143137.811763:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880092a72300 x1830962858797952/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.811774:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72300 with x1830962858797952 ext(2097152->3145727) 00002000:00010000:3.0:1746143137.811781:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a72300 00000100:00100000:0.0:1746143137.818720:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.818801:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858798080 00000100:00100000:1.0:1746143137.818811:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858798080 00000100:00100000:1.0:1746143137.818865:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12758 00000100:00100000:1.0:1746143137.818872:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:31122:x1830962858798080:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143137.818891:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143137.818909:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650af6 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.818940:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 8 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.818948:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143137.818950:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143137.818953:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 21 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.818981:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 8 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.818997:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 8 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.819009:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861313536:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143137.819127:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143137.826067:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861313536:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.826105:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 21 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.826124:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f390c00, rc 0) 00000100:00100000:1.0:1746143137.826185:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31122:x1830962858798080:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7311us (7477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.826193:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12758 00000100:00100000:0.0:1746143137.826609:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.826669:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858798208 00000100:00100000:3.0:1746143137.826675:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858798208 00002000:00100000:3.0:1746143137.826713:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2834432->3117055) req@ffff880092a70a80 x1830962858798208/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.826722:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70a80 with x1830962858798208 ext(2834432->3117055) 00010000:00010000:3.0:1746143137.826730:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 9 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143137.826743:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 9 pid: 21048 timeout: 1019 lvb_type: 0 00002000:00010000:3.0:1746143137.826750:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a70a80 00000100:00100000:3.0:1746143137.826766:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2030 00000100:00100000:3.0:1746143137.826771:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858798208:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143137.839567:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858798208:12345-192.168.201.28@tcp:4:cat.0 Request processed in 12780us (12944us total) trans 17179872843 rc 0/0 00000100:00100000:3.0:1746143137.839584:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2030 00002000:00100000:3.0:1746143137.839597:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2834432->3117055) req@ffff880092a70a80 x1830962858798208/t17179872843(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/448 e 0 to 0 dl 1746143148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.839608:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70a80 with x1830962858798208 ext(2834432->3117055) 00010000:00010000:3.0:1746143137.839619:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 11 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143137.839639:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 11 pid: 21048 timeout: 1019 lvb_type: 0 00002000:00010000:3.0:1746143137.839647:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a70a80 00000100:00100000:0.0:1746143137.851446:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.851554:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858798336 00000100:00100000:1.0:1746143137.851563:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858798336 00010000:00010000:1.0:1746143137.851603:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 11 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.851651:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6768 00000100:00100000:1.0:1746143137.851660:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858798336:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.851675:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.851700:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 11 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.851718:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 11 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.851742:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a28800/0x25aee876ca70df87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3117055) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a8d expref: 11 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.851777:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.851779:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.851787:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.851796:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.851832:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.851845:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861313664:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143137.851933:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143137.864949:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861313664:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143137.864976:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.865021:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1969:x1830962858798336:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13361us (13585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.865051:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6768 00000100:00100000:2.0:1746143137.873877:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.873920:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.873953:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.874269:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858798592 00000100:00100000:3.0:1746143137.874281:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858798592 00000100:00100000:1.0:1746143137.874283:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858798848 00000100:00100000:1.0:1746143137.874288:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858798848 00002000:00100000:1.0:1746143137.874332:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eaace00 x1830962858798848/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.874344:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaace00 with x1830962858798848 ext(3145728->4194303) 00002000:00010000:1.0:1746143137.874350:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaace00 00000100:00100000:1.0:1746143137.874368:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858799104 00000100:00100000:1.0:1746143137.874370:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858799104 00002000:00100000:1.0:1746143137.874382:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a84e5500 x1830962858799104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.874390:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5500 with x1830962858799104 ext(3145728->4194303) 00002000:00010000:1.0:1746143137.874394:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e5500 00000100:00100000:1.0:1746143137.874406:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6219 00000100:00100000:1.0:1746143137.874413:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858798848:12345-192.168.201.28@tcp:3:cat.0 00002000:00100000:3.0:1746143137.874712:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880090f21500 x1830962858798592/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.874722:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21500 with x1830962858798592 ext(2097152->3145727) 00002000:00010000:3.0:1746143137.874726:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f21500 00000100:00100000:3.0:1746143137.874769:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6220 00000100:00100000:3.0:1746143137.874777:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858799104:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.874885:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6221 00000100:00100000:3.0:1746143137.874948:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858798592:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143137.893761:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858799104:12345-192.168.201.28@tcp:3:cat.0 Request processed in 18974us (19796us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143137.893774:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6220 00002000:00100000:3.0:1746143137.893956:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800a84e5500 x1830962858799104/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143137.893965:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e5500 with x1830962858799104 ext(3145728->4194303) 00002000:00010000:3.0:1746143137.893971:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e5500 00000100:00100000:1.0:1746143137.898641:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858798848:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24214us (24706us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143137.898654:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6219 00002000:00100000:1.0:1746143137.898665:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008eaace00 x1830962858798848/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.898674:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eaace00 with x1830962858798848 ext(3145728->4194303) 00002000:00010000:1.0:1746143137.898680:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eaace00 00000100:00100000:2.0:1746143137.901908:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858798592:12345-192.168.201.28@tcp:3:cat.0 Request processed in 27003us (28031us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143137.901920:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6221 00002000:00100000:2.0:1746143137.901929:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880090f21500 x1830962858798592/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.901938:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21500 with x1830962858798592 ext(2097152->3145727) 00002000:00010000:2.0:1746143137.901944:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f21500 00000100:00100000:0.0:1746143137.919296:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.919394:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858799232 00000100:00100000:1.0:1746143137.919404:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858799232 00000100:00100000:1.0:1746143137.919506:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12759 00000100:00100000:1.0:1746143137.919515:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31127:x1830962858799232:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143137.919535:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143137.919554:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650afd expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.919586:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.919593:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.919595:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.919599:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1732608->2097151] (req 1732608->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 11 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.919627:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 20 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.919640:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 20 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.919650:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861313792:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143137.921281:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143137.924232:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.924329:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858799488 00000100:00100000:2.0:1746143137.924337:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858799488 00002000:00100000:2.0:1746143137.924390:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880092a70000 x1830962858799488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.924399:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70000 with x1830962858799488 ext(4194304->5210111) 00002000:00010000:2.0:1746143137.924405:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a70000 00000100:00100000:2.0:1746143137.924437:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6222 00000100:00100000:2.0:1746143137.924444:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858799488:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143137.930092:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861313792:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.930125:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1732608->2097151] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 11 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.930155:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f390000, rc 0) 00000100:00100000:1.0:1746143137.930798:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31127:x1830962858799232:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10688us (10916us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.930810:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12759 00000100:00100000:0.0:1746143137.936834:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.936905:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858799616 00000100:00100000:1.0:1746143137.936916:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858799616 00010000:00010000:1.0:1746143137.936954:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.936997:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6769 00000100:00100000:1.0:1746143137.937006:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858799616:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.937020:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.937076:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.937089:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.937113:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b12f200/0x25aee876ca70e028 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae8 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.937153:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.937156:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.937163:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 10 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.937171:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 10 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.937205:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 10 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.937222:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861313920:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143137.937322:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143137.946293:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.947106:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858799872 00000100:00100000:2.0:1746143137.947116:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858799872 00000100:00080000:3.0:1746143137.947169:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143137.947190:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3489 00000100:00100000:2.0:1746143137.947199:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:31091:x1830962858799872:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143137.947412:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31091:x1830962858799872:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 214us (1229us total) trans 8589942457 rc 0/0 00000100:00100000:2.0:1746143137.947419:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3489 00000100:00100000:1.0:1746143137.948976:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858799488:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24527us (24748us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143137.948987:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6222 00002000:00100000:1.0:1746143137.948997:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880092a70000 x1830962858799488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.949007:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70000 with x1830962858799488 ext(4194304->5210111) 00002000:00010000:1.0:1746143137.949013:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a70000 00000100:00100000:0.0:1746143137.949780:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.950447:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858800000 00000100:00100000:1.0:1746143137.950455:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858800000 00000100:00100000:1.0:1746143137.950722:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12760 00000100:00100000:1.0:1746143137.950730:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31124:x1830962858800000:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143137.950747:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143137.950768:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b04 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.950799:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 22 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.950808:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.950810:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.950813:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3653632->4194303] (req 3653632->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 22 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.950848:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 22 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.950861:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 22 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.950872:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861314048:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143137.950938:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.951636:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.951653:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143137.951727:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7111:1830962861313920:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143137.951745:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.951769:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858799616:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 14764us (14946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.951778:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858800256 00000100:00100000:1.0:1746143137.951778:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6769 00000100:00100000:2.0:1746143137.951782:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858800256 00000100:00100000:1.0:1746143137.951803:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858800512 00000100:00100000:1.0:1746143137.951806:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858800512 00000100:00100000:2.0:1746143137.951817:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8240 00000100:00100000:2.0:1746143137.951822:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31130:x1830962858800256:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.951836:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.951848:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b0b expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143137.951937:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1732608->1736703) req@ffff88008e190a80 x1830962858800512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746143137.951942:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00002000:00100000:1.0:1746143137.951947:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190a80 with x1830962858800512 ext(1732608->1736703) 00002000:00010000:1.0:1746143137.951951:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e190a80 00010000:00010000:2.0:1746143137.951953:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.951963:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:1.0:1746143137.951965:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6223 00000100:00100000:1.0:1746143137.951970:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858800512:12345-192.168.201.28@tcp:3:multiop.0 00010000:00010000:2.0:1746143137.951975:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.951980:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.951984:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952103:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391800/0x25aee876ca70e07c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952111:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391800/0x25aee876ca70e07c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952117:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391800/0x25aee876ca70e07c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143137.952126:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143137.952210:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952217:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952223:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952227:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fb0400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.952230:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952235:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952244:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143137.952246:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143137.952249:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952254:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb0400/0x25aee876ca70e06e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952261:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952265:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952273:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952276:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f391200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143137.952278:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952281:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952286:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449a00) 00010000:00010000:2.0:1746143137.952287:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143137.952288:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952292:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391200/0x25aee876ca70e075 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143137.952320:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fb1200/0x25aee876ca70e067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b0b expref: 19 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.952328:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391800/0x25aee876ca70e07c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b0b expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.952332:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143137.952334:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143137.952336:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f391800, rc 0) 00000100:00100000:2.0:1746143137.952537:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31130:x1830962858800256:12345-192.168.201.28@tcp:101:cat.0 Request processed in 715us (886us total) trans 8589942458 rc 0/0 00000100:00100000:1.0:1746143137.952540:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858800512:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 568us (904us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143137.952542:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8240 00000100:00100000:1.0:1746143137.952551:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6223 00002000:00100000:1.0:1746143137.952556:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x303:0x0] (1732608->1736703) req@ffff88008e190a80 x1830962858800512/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143137.952563:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e190a80 with x1830962858800512 ext(1732608->1736703) 00002000:00010000:1.0:1746143137.952566:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e190a80 00000100:00100000:0.0:1746143137.964183:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.964230:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.964259:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.964311:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.964369:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861314048:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143137.964402:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3653632->4194303] (req 3653632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 21 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.964420:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5741000, rc 0) 00000100:00100000:0.0:1746143137.964469:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31124:x1830962858800000:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 13740us (14692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143137.964478:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12760 00000100:00100000:0.0:1746143137.964508:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858800640 00000100:00100000:0.0:1746143137.964513:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858800640 00000100:00100000:0.0:1746143137.964542:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858801152 00000100:00100000:0.0:1746143137.964544:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858801152 00000100:00100000:0.0:1746143137.964557:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12761 00000100:00100000:0.0:1746143137.964563:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858800640:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143137.964579:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.964593:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c28200/0x25aee876ca70e08a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b12 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143137.964612:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.964623:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c28200/0x25aee876ca70e08a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b12 expref: 13 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.964632:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c28200/0x25aee876ca70e08a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b12 expref: 13 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.964645:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c28200, rc 0) 00000100:00100000:0.0:1746143137.964661:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858800640:12345-192.168.201.28@tcp:101:cat.0 Request processed in 98us (489us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143137.964666:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12761 00000100:00100000:0.0:1746143137.964677:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12762 00000100:00100000:0.0:1746143137.964682:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31127:x1830962858801152:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143137.964688:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143137.964695:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b19 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.965059:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858801024 00000100:00100000:1.0:1746143137.965064:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858801024 00000100:00100000:1.0:1746143137.965094:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 617 00000100:00100000:1.0:1746143137.965099:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858801024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.965108:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.965126:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f391800/0x25aee876ca70e07c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b0b expref: 18 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.965151:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143137.965155:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.965172:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858801024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 73us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.965178:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 617 00000100:00100000:2.0:1746143137.965263:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858800896 00000100:00100000:2.0:1746143137.965267:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858800896 00000100:00100000:2.0:1746143137.965293:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3490 00000100:00100000:2.0:1746143137.965297:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31091:x1830962858800896:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143137.965470:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31091:x1830962858800896:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 172us (1239us total) trans 8589942459 rc 0/0 00000100:00100000:2.0:1746143137.965474:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3490 00010000:00010000:0.0:1746143137.969198:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.969220:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.969228:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 5 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143137.969235:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.969238:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143137.969243:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 12 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.969530:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 5 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143137.969544:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 5 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.969558:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861314176:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.969653:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 20 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143137.969662:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 20 pid: 20836 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.969669:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861314304:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.969693:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 12 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143137.969701:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 12 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.969709:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861314432:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143137.969724:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143137.969835:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.969889:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.969972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.970073:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858801280 00000100:00100000:2.0:1746143137.970079:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858801280 00000100:00100000:2.0:1746143137.970113:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858801408 00000100:00100000:2.0:1746143137.970115:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858801408 00000100:00100000:2.0:1746143137.970129:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12763 00000100:00100000:2.0:1746143137.970136:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858801280:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.970160:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.970174:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70e098 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b20 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.970210:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861314560:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143137.970241:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.970257:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12764 00000100:00100000:2.0:1746143137.970263:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858801408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.970269:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.970276:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fb1200/0x25aee876ca70e09f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b27 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143137.970286:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143137.970294:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fb1200/0x25aee876ca70e09f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b27 expref: 24 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.970303:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fb1200/0x25aee876ca70e09f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b27 expref: 24 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.970312:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fb1200, rc 0) 00000100:00100000:2.0:1746143137.970331:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858801408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 68us (441us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143137.970336:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12764 00000100:00100000:1.0:1746143137.970515:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858801536 00000100:00100000:1.0:1746143137.970519:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858801536 00010000:00010000:1.0:1746143137.970535:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 23 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:1.0:1746143137.970564:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6770 00000100:00100000:1.0:1746143137.970569:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858801536:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.970578:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.970600:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 23 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.970613:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 23 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.970629:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f390c00/0x25aee876ca70e052 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650af6 expref: 23 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:1.0:1746143137.970638:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.970640:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.970647:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 22 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.970654:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 22 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.970675:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 22 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.970684:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861314688:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143137.970708:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143137.971359:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861314176:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143137.971418:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861314560:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.971435:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70e098 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b20 expref: 22 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.971444:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f390200/0x25aee876ca70e098 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b20 expref: 22 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.971451:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f390200, rc 0) 00000100:00100000:2.0:1746143137.971484:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1970:x1830962858801280:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1348us (1650us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143137.971491:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12763 00000100:00100000:0.0:1746143137.973458:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.973485:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.973509:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.978626:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.978652:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143137.978674:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858802304 00000100:00100000:0.0:1746143137.978683:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858802304 00002000:00100000:0.0:1746143137.978731:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880093b8b800 x1830962858802304/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143137.978742:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8b800 with x1830962858802304 ext(0->1048575) 00002000:00010000:0.0:1746143137.978748:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b8b800 00000100:00100000:2.0:1746143137.979184:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858801664 00000100:00100000:1.0:1746143137.979184:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858801792 00000100:00100000:2.0:1746143137.979189:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858801664 00000100:00100000:1.0:1746143137.979189:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858801792 00010000:00010000:2.0:1746143137.979215:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 6 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.979215:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 21 pid: 20836 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.979236:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858801920 00000100:00100000:1.0:1746143137.979240:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858801920 00010000:00010000:1.0:1746143137.979249:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 13 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:0.0:1746143137.980697:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858802432 00000100:00100000:0.0:1746143137.980704:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858802432 00002000:00100000:0.0:1746143137.980731:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1732607) req@ffff880093b89880 x1830962858802432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143137.980741:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b89880 with x1830962858802432 ext(1048576->1732607) 00002000:00010000:0.0:1746143137.980746:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b89880 00000100:00100000:0.0:1746143137.980760:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6224 00000100:00100000:0.0:1746143137.980768:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858802304:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143137.982656:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6225 00000100:00100000:0.0:1746143137.982666:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858802432:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143137.983092:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6771 00000100:00100000:1.0:1746143137.983101:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858801792:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.983114:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.983138:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 21 pid: 20836 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.983161:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 21 pid: 20836 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.983188:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.983217:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858801792:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 119us (9732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.983223:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6771 00000100:00100000:1.0:1746143137.983241:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6772 00000100:00100000:1.0:1746143137.983246:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858801664:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.983253:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.983260:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 6 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.983268:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 6 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.983279:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b115200/0x25aee876ca70ddf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650983 expref: 6 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.983290:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.983302:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858801664:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 57us (9852us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.983306:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6772 00000100:00100000:1.0:1746143137.983317:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6773 00000100:00100000:1.0:1746143137.983321:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1970:x1830962858801920:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143137.983328:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143137.983334:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 14 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.983342:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 14 pid: 754 timeout: 1019 lvb_type: 1 00010000:00010000:1.0:1746143137.983353:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.983355:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143137.983361:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.983375:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.983406:0:16965:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143137.983419:0:16965:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb21500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861314816:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143137.983473:0:16965:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143137.984498:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.984533:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143137.984550:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858802560 00000100:00100000:3.0:1746143137.984556:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858802560 00000100:00100000:2.0:1746143137.984568:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858802688 00000100:00100000:2.0:1746143137.984572:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858802688 00000100:00100000:3.0:1746143137.984585:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12765 00000100:00100000:2.0:1746143137.984590:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12766 00000100:00100000:3.0:1746143137.984591:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858802560:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:2.0:1746143137.984595:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858802688:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143137.984621:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143137.984636:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fb0200/0x25aee876ca70e0a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b35 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143137.984675:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861314944:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143137.984710:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143137.984741:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861314688:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143137.984759:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143137.984776:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858801536:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 14207us (14803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143137.984783:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6770 00010000:00010000:3.0:1746143137.984860:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143137.984868:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8800/0x25aee876ca70e0ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b2e expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143137.984892:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861315072:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143137.985131:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143137.985203:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143137.985877:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858802944 00000100:00100000:2.0:1746143137.985881:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858802944 00002000:00100000:2.0:1746143137.985911:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3653632->3657727) req@ffff880092a79180 x1830962858802944/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/0 e 0 to 0 dl 1746143148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.985921:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79180 with x1830962858802944 ext(3653632->3657727) 00002000:00010000:2.0:1746143137.985926:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a79180 00000100:00100000:2.0:1746143137.985939:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6226 00000100:00100000:2.0:1746143137.985945:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858802944:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143137.986096:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858802944:12345-192.168.201.28@tcp:3:cat.0 Request processed in 151us (892us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143137.986102:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6226 00002000:00100000:2.0:1746143137.986108:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (3653632->3657727) req@ffff880092a79180 x1830962858802944/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.986116:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a79180 with x1830962858802944 ext(3653632->3657727) 00002000:00010000:2.0:1746143137.986118:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a79180 00010000:00010000:1.0:1746143137.986330:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b5dc200/0x25aee876ca70de92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509e5 expref: 23 pid: 20836 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.986345:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861314304:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.986383:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d929e00/0x25aee876ca70ddb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650952 expref: 15 pid: 754 timeout: 1019 lvb_type: 1 00000100:00100000:1.0:1746143137.986394:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861314432:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143137.986420:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 14 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143137.986432:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c28800, rc 0) 00000100:00100000:1.0:1746143137.986455:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31127:x1830962858801152:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 21772us (22143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.986461:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12762 00000100:00100000:1.0:1746143137.992613:0:16965:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb21500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16965:1830962861314816:192.168.201.28@tcp:105: 00002000:00010000:2.0:1746143137.992696:0:22204:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime: 1746143135 -> 1746143136 00002000:00010000:2.0:1746143137.992700:0:22204:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143134 -> 1746143136 00002000:00010000:2.0:1746143137.992702:0:22204:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime: 1746143135 -> 1746143136 00000100:00100000:2.0:1746143137.992723:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861314944:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143137.992751:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fb0200/0x25aee876ca70e0a6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b35 expref: 22 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.992764:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fb0200/0x25aee876ca70e0a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b35 expref: 22 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143137.992774:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fb0200, rc 0) 00000100:00100000:2.0:1746143137.992819:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1971:x1830962858802688:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8222us (8284us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143137.992828:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12766 00010000:00010000:1.0:1746143137.992891:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143137.992930:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858801920:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9607us (19419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143137.992938:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6773 00000100:00100000:3.0:1746143137.993692:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861315072:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143137.993728:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8800/0x25aee876ca70e0ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b2e expref: 20 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.993741:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8800/0x25aee876ca70e0ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b2e expref: 20 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143137.993770:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8800, rc 0) 00000100:00100000:3.0:1746143137.993819:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858802560:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9226us (9323us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143137.993829:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12765 00000100:00100000:2.0:1746143137.998426:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858802304:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17644us (19797us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143137.998437:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6224 00002000:00100000:2.0:1746143137.998450:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880093b8b800 x1830962858802304/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143137.998462:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8b800 with x1830962858802304 ext(0->1048575) 00002000:00010000:2.0:1746143137.998468:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b8b800 00000100:00100000:1.0:1746143138.000180:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858802432:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17511us (21520us total) trans 0 rc 684032/684032 00000100:00100000:1.0:1746143138.000195:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6225 00002000:00100000:1.0:1746143138.000203:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->1732607) req@ffff880093b89880 x1830962858802432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:288/0 lens 488/440 e 0 to 0 dl 1746143148 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.000211:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b89880 with x1830962858802432 ext(1048576->1732607) 00002000:00010000:1.0:1746143138.000216:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b89880 00000100:00100000:0.0:1746143138.004934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.005062:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858803200 00000100:00100000:1.0:1746143138.005072:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858803200 00002000:00100000:1.0:1746143138.005118:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1433600->1437695) req@ffff880093b89f80 x1830962858803200/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.005129:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b89f80 with x1830962858803200 ext(1433600->1437695) 00002000:00010000:1.0:1746143138.005134:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b89f80 00000100:00100000:1.0:1746143138.005176:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6227 00000100:00100000:1.0:1746143138.005184:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858803200:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143138.005606:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858803200:12345-192.168.201.28@tcp:3:cat.0 Request processed in 422us (682us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143138.005614:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6227 00002000:00100000:1.0:1746143138.005621:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1433600->1437695) req@ffff880093b89f80 x1830962858803200/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.005628:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b89f80 with x1830962858803200 ext(1433600->1437695) 00002000:00010000:1.0:1746143138.005631:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b89f80 00000100:00100000:0.0:1746143138.006118:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.006235:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858803456 00000100:00100000:2.0:1746143138.006240:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858803456 00000100:00100000:2.0:1746143138.006285:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3491 00000100:00100000:2.0:1746143138.006290:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:31122:x1830962858803456:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:2.0:1746143138.006461:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31122:x1830962858803456:12345-192.168.201.28@tcp:35:cat.0 Request processed in 170us (344us total) trans 8589942460 rc 0/0 00000100:00100000:2.0:1746143138.006467:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3491 00000100:00100000:0.0:1746143138.008757:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.008874:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858803584 00000100:00100000:3.0:1746143138.008881:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858803584 00000100:00100000:3.0:1746143138.008925:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12767 00000100:00100000:3.0:1746143138.008932:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:31124:x1830962858803584:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143138.008949:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.008967:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b3c expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.008995:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 10 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.009003:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.009009:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.009011:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.009015:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4694015] (req 4194304->4694015) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.009065:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.009078:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143138.009090:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861315200:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.009183:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 10 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.009192:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 10 pid: 26949 timeout: 1019 lvb_type: 0 00000100:00100000:3.0:1746143138.009200:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861315328:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.009220:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532be40 going to sleep for 11 seconds 00000100:00080000:0.0:1746143138.009261:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143138.011133:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.011231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.011328:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858804096 00000100:00100000:1.0:1746143138.011336:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858804096 00002000:00100000:1.0:1746143138.011378:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1437696->2097151) req@ffff880093b8ad80 x1830962858804096/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.011388:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8ad80 with x1830962858804096 ext(1437696->2097151) 00002000:00010000:1.0:1746143138.011394:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b8ad80 00000100:00100000:3.0:1746143138.011521:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858803840 00000100:00100000:3.0:1746143138.011531:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858803840 00000100:00100000:2.0:1746143138.012239:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3492 00000100:00100000:2.0:1746143138.012262:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31127:x1830962858803840:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:1.0:1746143138.012520:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6228 00000100:00100000:1.0:1746143138.012530:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858804096:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.014388:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31127:x1830962858803840:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 2120us (3251us total) trans 8589942461 rc 0/0 00000100:00100000:2.0:1746143138.014399:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3492 00000100:00100000:3.0:1746143138.016547:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861315200:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.016555:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861315328:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.016584:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4694015] (req 4194304->4694015) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.016600:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf9800, rc 0) 00000100:00100000:3.0:1746143138.016634:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:31124:x1830962858803584:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7703us (7884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.016640:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12767 00000100:00100000:0.0:1746143138.025298:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.025334:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.025416:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858804224 00000100:00100000:3.0:1746143138.025426:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858804224 00010000:00010000:3.0:1746143138.025463:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143138.025978:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858804352 00000100:00100000:3.0:1746143138.025981:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858804352 00010000:00010000:3.0:1746143138.025996:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 11 pid: 26949 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143138.026060:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6774 00000100:00100000:0.0:1746143138.026070:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1970:x1830962858804224:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143138.026085:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.026110:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143138.026120:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6775 00010000:00010000:0.0:1746143138.026122:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 1019 lvb_type: 1 00000100:00100000:3.0:1746143138.026126:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858804352:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.026132:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.026159:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 11 pid: 26949 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143138.026169:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 11 pid: 26949 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143138.026182:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe82a00/0x25aee876ca70dfaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650aa2 expref: 11 pid: 26949 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143138.026205:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.026207:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.026298:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.026306:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.026336:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.026347:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861315456:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143138.026410:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532be40 going to sleep for 11 seconds 00010000:00010000:0.0:1746143138.026723:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a7ce00/0x25aee876ca70dfe2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650abe expref: 17 pid: 8449 timeout: 1019 lvb_type: 1 00010000:00010000:0.0:1746143138.026740:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.026773:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858804224:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 705us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.026784:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6774 00000100:00100000:1.0:1746143138.028452:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858804096:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15916us (17212us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143138.028463:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6228 00002000:00100000:1.0:1746143138.028473:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1437696->2097151) req@ffff880093b8ad80 x1830962858804096/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.028482:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8ad80 with x1830962858804096 ext(1437696->2097151) 00002000:00010000:1.0:1746143138.028488:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b8ad80 00000100:00100000:0.0:1746143138.029307:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861315456:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143138.029325:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.029573:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858804352:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3446us (4237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.029589:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6775 00000100:00100000:1.0:1746143138.036218:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.036259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.036286:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858804608 00000100:00100000:2.0:1746143138.036295:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858804608 00002000:00100000:2.0:1746143138.036346:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4689920->4694015) req@ffff88008eb21500 x1830962858804608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.036356:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21500 with x1830962858804608 ext(4689920->4694015) 00002000:00010000:2.0:1746143138.036363:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21500 00000100:00100000:2.0:1746143138.036393:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6229 00000100:00100000:2.0:1746143138.036401:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858804608:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.036641:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858804736 00000100:00100000:2.0:1746143138.036641:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858804608:12345-192.168.201.28@tcp:3:cat.0 Request processed in 240us (438us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143138.036645:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858804736 00000100:00100000:2.0:1746143138.036648:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6229 00002000:00100000:2.0:1746143138.036654:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (4689920->4694015) req@ffff88008eb21500 x1830962858804608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.036662:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21500 with x1830962858804608 ext(4689920->4694015) 00002000:00010000:2.0:1746143138.036665:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb21500 00000100:00100000:3.0:1746143138.036669:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12768 00000100:00100000:3.0:1746143138.036674:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858804736:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.036683:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.036701:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8400/0x25aee876ca70e0bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b43 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.036744:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861315584:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143138.037172:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.037178:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.037244:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858804864 00000100:00100000:2.0:1746143138.037247:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858804864 00000100:00100000:2.0:1746143138.037276:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12769 00000100:00100000:2.0:1746143138.037281:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858804864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.037289:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.037300:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f391e00/0x25aee876ca70e0c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b4a expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.037328:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861315712:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143138.037359:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.039074:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861315584:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143138.039106:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8400/0x25aee876ca70e0bb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b43 expref: 11 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.039120:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8400/0x25aee876ca70e0bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b43 expref: 11 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.039133:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8400, rc 0) 00000100:00100000:3.0:1746143138.039198:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858804736:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2522us (2937us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143138.039206:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12768 00000100:00100000:2.0:1746143138.039301:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861315712:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143138.039318:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f391e00/0x25aee876ca70e0c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b4a expref: 12 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.039327:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f391e00/0x25aee876ca70e0c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b4a expref: 12 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.039337:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f391e00, rc 0) 00000100:00100000:2.0:1746143138.039353:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858804864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2072us (2182us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143138.039358:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12769 00000100:00100000:1.0:1746143138.039874:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.040156:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858805120 00000100:00100000:2.0:1746143138.040162:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858805120 00000100:00100000:2.0:1746143138.040242:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3493 00000100:00100000:2.0:1746143138.040249:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31124:x1830962858805120:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143138.040727:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:31124:x1830962858805120:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 477us (853us total) trans 8589942462 rc 0/0 00000100:00100000:2.0:1746143138.040735:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3493 00000100:00100000:0.0:1746143138.041045:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.041164:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858805248 00000100:00100000:2.0:1746143138.041168:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858805248 00000100:00100000:2.0:1746143138.041195:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12770 00000100:00100000:2.0:1746143138.041200:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31130:x1830962858805248:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.041209:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.041220:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b51 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.041239:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.041246:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.041248:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.041250:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.041273:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 15 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.041284:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 15 pid: 26949 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143138.041300:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861315840:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.041358:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.045084:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861315840:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.045110:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 11 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.045125:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f391200, rc 0) 00000100:00100000:2.0:1746143138.045178:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31130:x1830962858805248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3976us (4149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.045186:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12770 00000100:00100000:0.0:1746143138.046527:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.046643:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858805376 00000100:00100000:2.0:1746143138.046650:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858805376 00002000:00100000:2.0:1746143138.046687:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4694015) req@ffff880093b88380 x1830962858805376/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.046696:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b88380 with x1830962858805376 ext(4194304->4694015) 00010000:00010000:2.0:1746143138.046703:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 16 pid: 26949 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143138.046714:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 16 pid: 26949 timeout: 1019 lvb_type: 0 00002000:00010000:2.0:1746143138.046720:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093b88380 00000100:00100000:2.0:1746143138.046735:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2031 00000100:00100000:2.0:1746143138.046742:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858805376:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143138.057842:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858805376:12345-192.168.201.28@tcp:4:cat.0 Request processed in 11087us (11304us total) trans 21474840110 rc 0/0 00000100:00100000:2.0:1746143138.057856:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2031 00002000:00100000:2.0:1746143138.057869:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4694015) req@ffff880093b88380 x1830962858805376/t21474840110(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.057880:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b88380 with x1830962858805376 ext(4194304->4694015) 00010000:00010000:2.0:1746143138.057891:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 18 pid: 26949 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143138.057908:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 18 pid: 26949 timeout: 1019 lvb_type: 0 00002000:00010000:2.0:1746143138.057915:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093b88380 00000100:00100000:0.0:1746143138.062262:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.062354:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858805504 00000100:00100000:2.0:1746143138.062366:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858805504 00010000:00010000:2.0:1746143138.062410:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 18 pid: 26949 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143138.062649:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6776 00000100:00100000:2.0:1746143138.062657:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858805504:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.062672:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.062697:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 18 pid: 26949 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143138.062709:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 18 pid: 26949 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143138.062733:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9800/0x25aee876ca70e0b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4694015) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b3c expref: 18 pid: 26949 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143138.062764:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.062767:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.062774:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.062782:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.062818:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.062831:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861315968:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143138.062935:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.066691:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7113:1830962861315968:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143138.066713:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.066852:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1970:x1830962858805504:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4193us (4594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.066862:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6776 00000100:00100000:0.0:1746143138.068087:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.068168:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858805760 00000100:00100000:2.0:1746143138.068175:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858805760 00002000:00100000:2.0:1746143138.068217:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880136be8000 x1830962858805760/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.068233:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be8000 with x1830962858805760 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.068239:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136be8000 00000100:00100000:2.0:1746143138.068266:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6230 00000100:00100000:2.0:1746143138.068273:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858805760:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.077612:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858805760:12345-192.168.201.28@tcp:3:cat.0 Request processed in 9321us (9512us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.077625:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6230 00002000:00100000:2.0:1746143138.077638:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880136be8000 x1830962858805760/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.077648:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be8000 with x1830962858805760 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.077654:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136be8000 00000100:00100000:0.0:1746143138.084385:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.084678:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858805888 00000100:00100000:2.0:1746143138.084690:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858805888 00000100:00100000:3.0:1746143138.085293:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12771 00000100:00100000:3.0:1746143138.085304:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31130:x1830962858805888:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.085323:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.085342:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b58 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.085374:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.085381:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.085383:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.085386:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 12 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.085413:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 18 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.085424:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 18 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:3.0:1746143138.085434:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861316096:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.085910:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.091442:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.091521:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.091618:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858806016 00000100:00100000:2.0:1746143138.091629:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858806016 00000100:00100000:2.0:1746143138.091688:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8241 00000100:00100000:2.0:1746143138.091695:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31135:x1830962858806016:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143138.091720:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.091737:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094577e00/0x25aee876ca70e0d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b5f expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.091798:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.091810:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.091821:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.091834:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.091838:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.091843:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143138.092312:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861316096:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.092335:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 12 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.092351:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf9800, rc 0) 00000100:00100000:3.0:1746143138.092416:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31130:x1830962858805888:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7113us (8037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.092423:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12771 00010000:00010000:2.0:1746143138.093551:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.093566:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.093574:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143138.093622:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858806144 00000100:00100000:3.0:1746143138.093627:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858806144 00002000:00100000:3.0:1746143138.093678:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3653632->4194303) req@ffff880136be8a80 x1830962858806144/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.093688:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be8a80 with x1830962858806144 ext(3653632->4194303) 00000100:00080000:0.0:1746143138.093692:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746143138.093696:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 19 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143138.093708:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 19 pid: 21048 timeout: 1019 lvb_type: 0 00002000:00010000:3.0:1746143138.093719:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136be8a80 00000100:00100000:3.0:1746143138.093737:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2032 00000100:00100000:3.0:1746143138.093744:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858806144:12345-192.168.201.28@tcp:4:cat.0 00000004:00200000:2.0:1746143138.094703:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143138.094708:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143138.094728:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094740:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094749:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094755:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094766:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094777:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094576200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143138.094780:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094786:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094798:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143138.094800:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143138.094803:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094808:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094576200/0x25aee876ca70e0de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094821:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094826:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094830:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094834:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094576000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143138.094836:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094840:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094849:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449e00) 00010000:00010000:2.0:1746143138.094851:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143138.094853:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094857:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094576000/0x25aee876ca70e0e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.094975:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094577e00/0x25aee876ca70e0d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.094986:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.094992:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.094994:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143138.094996:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094577400, rc 0) 00000100:00100000:2.0:1746143138.095049:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31135:x1830962858806016:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 3353us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.095055:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8241 00000100:00100000:0.0:1746143138.101624:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.101653:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.101667:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.103344:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.103878:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858806272 00000100:00100000:1.0:1746143138.103889:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858806528 00000100:00100000:2.0:1746143138.103896:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858806784 00000100:00100000:1.0:1746143138.103897:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858806528 00000100:00100000:2.0:1746143138.103901:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858806784 00000100:00100000:3.0:1746143138.103928:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858806272 00000100:00100000:2.0:1746143138.103941:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858806400 00000100:00100000:2.0:1746143138.103944:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858806400 00000100:00100000:3.0:1746143138.103953:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12772 00000100:00100000:3.0:1746143138.103960:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858806784:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143138.103977:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.103992:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70e0f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b82 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.104055:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861316224:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143138.104200:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12773 00000100:00100000:2.0:1746143138.104207:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858806528:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143138.104207:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12774 00000100:00100000:1.0:1746143138.104213:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858806400:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143138.104214:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.104220:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.104222:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094577c00/0x25aee876ca70e0fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b74 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.104226:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef5e400/0x25aee876ca70e101 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b6d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.104238:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.104248:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861316352:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143138.104249:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861316480:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143138.104270:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12775 00000100:00100000:1.0:1746143138.104270:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.104275:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858806272:12345-192.168.201.28@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143138.104275:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143138.104283:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.104290:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b66 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.104302:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.104304:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.104311:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 7 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143138.104313:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.104328:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858806656 00010000:00010000:3.0:1746143138.104329:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 7 pid: 754 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143138.104331:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858806656 00010000:00010000:3.0:1746143138.104337:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8600, rc 0) 00000100:00100000:2.0:1746143138.104353:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12776 00000100:00100000:2.0:1746143138.104359:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858806656:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143138.104365:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.104372:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b7b expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.104382:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.104384:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.104388:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 9 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.104397:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 9 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.104405:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094576400, rc 0) 00000100:00100000:2.0:1746143138.104424:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858806656:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.104430:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12776 00000100:00100000:3.0:1746143138.104448:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858806272:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 173us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.104453:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12775 00000100:00100000:3.0:1746143138.110356:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858806144:12345-192.168.201.28@tcp:4:cat.0 Request processed in 16604us (18825us total) trans 17179872844 rc 0/0 00000100:00100000:3.0:1746143138.110369:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2032 00002000:00100000:3.0:1746143138.110380:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3653632->4194303) req@ffff880136be8a80 x1830962858806144/t17179872844(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.110389:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be8a80 with x1830962858806144 ext(3653632->4194303) 00010000:00010000:3.0:1746143138.110398:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143138.110412:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00002000:00010000:3.0:1746143138.110420:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136be8a80 00000100:00100000:2.0:1746143138.111294:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22204:1830962861316480:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143138.111313:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861316352:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143138.111321:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094577c00/0x25aee876ca70e0fa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b74 expref: 10 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.111332:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef5e400/0x25aee876ca70e101 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b6d expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.111335:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094577c00/0x25aee876ca70e0fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b74 expref: 10 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.111342:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef5e400/0x25aee876ca70e101 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b6d expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.111348:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094577c00, rc 0) 00010000:00010000:1.0:1746143138.111356:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef5e400, rc 0) 00000100:00100000:2.0:1746143138.111372:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858806528:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 7165us (9717us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143138.111376:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858806400:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 7163us (8035us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143138.111379:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12773 00000100:00100000:1.0:1746143138.111383:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12774 00000100:00100000:3.0:1746143138.111471:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861316224:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143138.111486:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70e0f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b82 expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.111494:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8a00/0x25aee876ca70e0f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b82 expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.111533:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8a00, rc 0) 00000100:00100000:3.0:1746143138.111553:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1968:x1830962858806784:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 7594us (9885us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143138.111558:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12772 00000100:00100000:0.0:1746143138.114635:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.114692:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858806912 00000100:00100000:2.0:1746143138.114701:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858806912 00010000:00010000:2.0:1746143138.114734:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143138.114763:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6777 00000100:00100000:2.0:1746143138.114769:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858806912:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.114780:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.114797:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143138.114807:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143138.114825:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5741000/0x25aee876ca70e060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b04 expref: 21 pid: 21048 timeout: 1019 lvb_type: 0 00010000:00010000:2.0:1746143138.114836:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.114838:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.114844:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 11 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.114850:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 11 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.114879:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 11 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.114889:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861316608:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143138.116754:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.118282:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.118549:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858807168 00000100:00100000:2.0:1746143138.118559:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858807168 00000100:00100000:2.0:1746143138.118643:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8242 00000100:00100000:2.0:1746143138.118653:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31135:x1830962858807168:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143138.118674:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.118697:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094577e00/0x25aee876ca70e116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b89 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.118802:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.118818:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 207 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.118826:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 17 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.118837:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.118843:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.118878:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.118891:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 10 pid: 14794 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143138.118902:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861316736:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.119500:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 17 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.119513:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 17 pid: 14795 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143138.119523:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861316864:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.119546:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861316608:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.119563:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143138.119578:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 207 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.119586:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 207 pid: 20619 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143138.119595:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861316992:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.119615:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.119679:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858806912:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4908us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.119689:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6777 00000100:00100000:0.0:1746143138.120799:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.121072:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861316736:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.121082:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861316864:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.121168:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858807296 00000100:00100000:3.0:1746143138.121173:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858807296 00010000:00010000:3.0:1746143138.121199:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 11 pid: 14794 timeout: 1019 lvb_type: 0 00000100:00100000:3.0:1746143138.121239:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6778 00000100:00100000:3.0:1746143138.121246:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858807296:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.121259:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.121263:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 11 pid: 14794 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143138.121272:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 11 pid: 14794 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143138.121291:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094577400/0x25aee876ca70e0ec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b5f expref: 11 pid: 14794 timeout: 1019 lvb_type: 0 00010000:00010000:3.0:1746143138.121316:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143138.121320:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143138.121331:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143138.121336:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.121941:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858807296:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 694us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.121948:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6778 00000100:00100000:0.0:1746143138.122764:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.122783:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858807424 00000100:00100000:0.0:1746143138.122787:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858807424 00010000:00010000:0.0:1746143138.122804:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 18 pid: 14795 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143138.122820:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6779 00000100:00100000:0.0:1746143138.122825:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858807424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143138.122833:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.122836:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 18 pid: 14795 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143138.122850:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 18 pid: 14795 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143138.122875:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82200/0x25aee876ca70df95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650a86 expref: 18 pid: 14795 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143138.122888:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143138.122892:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143138.122899:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143138.122903:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.122921:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858807424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 96us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.122927:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6779 00000100:00100000:0.0:1746143138.123016:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.123026:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858807552 00000100:00100000:0.0:1746143138.123029:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858807552 00010000:00010000:0.0:1746143138.123057:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 208 pid: 20619 timeout: 1019 lvb_type: 0 00000100:00100000:0.0:1746143138.123072:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6780 00000100:00100000:0.0:1746143138.123077:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:1968:x1830962858807552:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143138.123083:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.123086:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 208 pid: 20619 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143138.123095:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 208 pid: 20619 timeout: 1019 lvb_type: 0 00010000:00010000:0.0:1746143138.123106:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143138.123109:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143138.123116:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143138.123123:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143138.123148:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.123166:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:1968:x1830962858807552:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 88us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.123171:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6780 00010000:00010000:2.0:1746143138.123695:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b2c00/0x25aee876ca70de6f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509c2 expref: 207 pid: 20619 timeout: 1019 lvb_type: 0 00000100:00100000:2.0:1746143138.124189:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861316992:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.124216:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.124225:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.124230:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143138.124254:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143138.124615:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094577e00/0x25aee876ca70e116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b89 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.124629:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b89 expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.124633:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.124635:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143138.124637:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094577800, rc 0) 00000100:00100000:2.0:1746143138.124665:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:31135:x1830962858807168:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 6014us (6393us total) trans 8589942463 rc 0/0 00000100:00100000:2.0:1746143138.124675:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8242 00000100:00100000:0.0:1746143138.127324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.127359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.127397:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.127472:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858807808 00000100:00100000:3.0:1746143138.127480:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858807808 00000100:00100000:1.0:1746143138.127503:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858808064 00000100:00100000:1.0:1746143138.127508:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858808064 00002000:00100000:3.0:1746143138.127522:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880136bebb80 x1830962858807808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.127528:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880136be9180 x1830962858808064/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.127532:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136bebb80 with x1830962858807808 ext(2097152->3145727) 00002000:00100000:1.0:1746143138.127536:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9180 with x1830962858808064 ext(3145728->4194303) 00002000:00010000:3.0:1746143138.127538:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136bebb80 00002000:00010000:1.0:1746143138.127539:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136be9180 00000100:00100000:1.0:1746143138.127564:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858808320 00000100:00100000:1.0:1746143138.127567:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858808320 00002000:00100000:1.0:1746143138.127579:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880136be9c00 x1830962858808320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.127586:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9c00 with x1830962858808320 ext(3145728->4194303) 00002000:00010000:1.0:1746143138.127589:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136be9c00 00000100:00100000:2.0:1746143138.127594:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6231 00000100:00100000:2.0:1746143138.127604:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858807808:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143138.127608:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6232 00000100:00100000:1.0:1746143138.127614:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858808064:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143138.127669:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6233 00000100:00100000:1.0:1746143138.127674:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858808320:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.131990:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.133227:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858808576 00000100:00100000:3.0:1746143138.133237:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858808576 00000100:00100000:3.0:1746143138.133293:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8243 00000100:00100000:3.0:1746143138.133301:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:31135:x1830962858808576:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143138.133328:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.133331:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143138.133361:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094577800/0x25aee876ca70e11d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b89 expref: 10 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.133390:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143138.133394:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143138.133408:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009499fa00/0x25aee876ca70e12b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b90 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.134276:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143138.134289:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143138.134299:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:3.0:1746143138.134998:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143138.135171:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499fa00/0x25aee876ca70e12b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.135189:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.135196:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143138.135200:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143138.135203:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009499f000, rc 0) 00000100:00100000:3.0:1746143138.135256:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:31135:x1830962858808576:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 1954us (3276us total) trans 8589942464 rc 0/0 00000100:00100000:3.0:1746143138.135264:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8243 00000100:00100000:2.0:1746143138.146787:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858808064:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19162us (19416us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.146798:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6232 00002000:00100000:2.0:1746143138.146808:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880136be9180 x1830962858808064/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.146818:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9180 with x1830962858808064 ext(3145728->4194303) 00002000:00010000:2.0:1746143138.146823:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136be9180 00000100:00100000:2.0:1746143138.160551:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858807808:12345-192.168.201.28@tcp:3:cat.0 Request processed in 32941us (33227us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.160562:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6231 00002000:00100000:2.0:1746143138.160572:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880136bebb80 x1830962858807808/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.160581:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136bebb80 with x1830962858807808 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.160586:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136bebb80 00000100:00100000:0.0:1746143138.160973:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.161058:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858808704 00000100:00100000:2.0:1746143138.161065:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858808704 00000100:00100000:2.0:1746143138.162090:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8244 00000100:00100000:2.0:1746143138.162098:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:31135:x1830962858808704:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143138.162114:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.162131:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806200/0x25aee876ca70e140 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b97 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.162192:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806200/0x25aee876ca70e140 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b97 expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.162206:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806200/0x25aee876ca70e140 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b97 expref: 12 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.162221:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.162224:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143138.162227:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b806200, rc 0) 00000100:00100000:2.0:1746143138.162253:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:31135:x1830962858808704:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 156us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.162259:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8244 00000100:00100000:1.0:1746143138.163181:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858808320:12345-192.168.201.28@tcp:3:cat.0 Request processed in 35504us (35782us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143138.163189:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6233 00002000:00100000:1.0:1746143138.163196:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880136be9c00 x1830962858808320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.163203:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136be9c00 with x1830962858808320 ext(3145728->4194303) 00002000:00010000:1.0:1746143138.163207:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136be9c00 00000100:00100000:0.0:1746143138.167767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.167806:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.167828:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.167852:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.168101:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.168127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.168202:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858808832 00000100:00100000:3.0:1746143138.168209:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858808832 00000100:00100000:3.0:1746143138.168238:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858809088 00000100:00100000:3.0:1746143138.168239:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858809088 00000100:00100000:3.0:1746143138.168245:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858809344 00000100:00100000:3.0:1746143138.168246:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858809344 00000100:00100000:3.0:1746143138.168251:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858808960 00000100:00100000:3.0:1746143138.168252:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858808960 00000100:00100000:3.0:1746143138.168258:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858809216 00000100:00100000:3.0:1746143138.168259:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858809216 00000100:00100000:3.0:1746143138.168263:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858809472 00000100:00100000:3.0:1746143138.168264:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858809472 00000100:00100000:3.0:1746143138.168273:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12777 00000100:00100000:3.0:1746143138.168278:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858808832:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143138.168310:0:8449:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168322:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168328:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 10 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.168332:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.168337:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.168338:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.168340:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168360:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 10 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.168367:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 10 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.168377:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861317120:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.168439:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 10 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.168444:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 10 pid: 754 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.168449:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861317248:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.168462:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168466:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.168474:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861317376:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.168483:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.168497:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12778 00000100:00100000:3.0:1746143138.168501:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858809088:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143138.168512:0:754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168520:0:754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 11 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168523:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.168524:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.168525:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168534:0:754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 11 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168538:0:754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 11 pid: 21048 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.168544:0:754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861317504:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.168555:0:754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.168565:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12779 00000100:00100000:3.0:1746143138.168568:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858809344:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143138.168577:0:4756:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168583:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168587:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 10 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.168590:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.168591:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.168592:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168599:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 10 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.168603:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 10 pid: 8169 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.168607:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861317632:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.168620:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168624:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.168631:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861317760:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.168639:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.168648:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12780 00000100:00100000:3.0:1746143138.168651:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858808960:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143138.168660:0:26949:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168666:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 11 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168670:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.168670:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.168672:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168679:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 11 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.168683:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 11 pid: 21048 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.168687:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861317888:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.168697:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.168821:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12781 00000100:00100000:1.0:1746143138.168826:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858809216:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143138.168838:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.168844:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 10 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.168848:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 16 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.168853:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.168856:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.168857:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.168858:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.168871:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 10 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.168875:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 10 pid: 4756 timeout: 1020 lvb_type: 1 00000100:00100000:1.0:1746143138.168880:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861318016:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143138.168900:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 16 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.168905:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 16 pid: 20836 timeout: 1020 lvb_type: 1 00000100:00100000:1.0:1746143138.168909:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861318144:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143138.168925:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 10 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.168931:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 10 pid: 754 timeout: 1020 lvb_type: 1 00000100:00100000:1.0:1746143138.168939:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861318272:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143138.168953:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.168965:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12782 00000100:00100000:1.0:1746143138.168970:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858809472:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143138.168983:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.168992:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 11 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.168997:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.168998:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.168999:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.169009:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 11 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.169013:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 11 pid: 26949 timeout: 1020 lvb_type: 0 00000100:00100000:1.0:1746143138.169018:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a531a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861318400:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143138.169056:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.170429:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.171234:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858809728 00000100:00100000:2.0:1746143138.171242:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858809728 00000100:00100000:2.0:1746143138.171745:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8245 00000100:00100000:2.0:1746143138.171965:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31140:x1830962858809728:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.171982:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.171995:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806400/0x25aee876ca70e171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650b9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.172091:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172101:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172110:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172121:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172126:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172131:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172228:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172235:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172240:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:2.0:1746143138.172247:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143138.172307:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172313:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172318:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172322:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b807a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143138.172325:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172331:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172340:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.172342:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143138.172345:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.172350:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807a00/0x25aee876ca70e186 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174059:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174067:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174072:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174076:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b806000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143138.174079:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174084:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174091:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143138.174093:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143138.174096:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174100:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806000/0x25aee876ca70e178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174109:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174114:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174118:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174122:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b807400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143138.174124:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174128:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174132:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449800) 00010000:00010000:2.0:1746143138.174134:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143138.174147:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174151:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807400/0x25aee876ca70e17f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.174185:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806400/0x25aee876ca70e171 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b9e expref: 209 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.174192:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806400/0x25aee876ca70e171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b9e expref: 209 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.174198:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b806400, rc 0) 00000100:00100000:2.0:1746143138.174251:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:31140:x1830962858809728:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2287us (3825us total) trans 8589942465 rc 301/301 00000100:00100000:2.0:1746143138.174261:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8245 00000100:00100000:1.0:1746143138.183754:0:754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:754:1830962861317504:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143138.183776:0:754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.183836:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.183855:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.183875:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858810368 00000100:00100000:1.0:1746143138.183880:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858810368 00002000:00100000:1.0:1746143138.183916:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1732608->2097151) req@ffff8800a531b800 x1830962858810368/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.183925:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b800 with x1830962858810368 ext(1732608->2097151) 00010000:00010000:1.0:1746143138.183932:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 12 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:1.0:1746143138.183943:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 12 pid: 21048 timeout: 1020 lvb_type: 0 00002000:00010000:1.0:1746143138.183949:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a531b800 00000100:00100000:1.0:1746143138.183967:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2033 00000100:00100000:1.0:1746143138.183974:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858810368:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143138.184329:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.184405:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.184450:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861317120:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.184461:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861317248:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.184467:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861317376:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.184481:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.184501:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861317888:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.184509:0:26949:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.184564:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861317632:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.184572:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861317760:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.184582:0:4756:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143138.184849:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861318016:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143138.184857:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861318144:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143138.184863:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eb23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861318272:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143138.184880:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143138.184919:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.186518:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a531a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861318400:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143138.186534:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.186563:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.187097:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.187112:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858810624 00000100:00100000:1.0:1746143138.187118:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858810624 00002000:00100000:1.0:1746143138.187161:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1437695) req@ffff8800a531a300 x1830962858810624/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.187169:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531a300 with x1830962858810624 ext(1048576->1437695) 00010000:00010000:1.0:1746143138.187176:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 14 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:1.0:1746143138.187186:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 14 pid: 21048 timeout: 1020 lvb_type: 0 00002000:00010000:1.0:1746143138.187191:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a531a300 00000100:00100000:1.0:1746143138.187209:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2034 00000100:00100000:1.0:1746143138.187217:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858810624:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143138.187600:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.187851:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858810112 00000100:00100000:3.0:1746143138.187856:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858810112 00010000:00010000:3.0:1746143138.187874:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 11 pid: 8169 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.187891:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858809984 00000100:00100000:3.0:1746143138.187893:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858809984 00010000:00010000:3.0:1746143138.187902:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 11 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.187913:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858810240 00000100:00100000:3.0:1746143138.187915:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858810240 00010000:00010000:3.0:1746143138.187923:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 12 pid: 4756 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.187931:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858810496 00000100:00100000:3.0:1746143138.187933:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858810496 00010000:00010000:3.0:1746143138.187941:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 17 pid: 20836 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.187951:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6781 00000100:00100000:3.0:1746143138.187956:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858810112:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.187964:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.187979:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 12 pid: 8169 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.187988:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 12 pid: 8169 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188007:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094576400/0x25aee876ca70e10f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b7b expref: 12 pid: 8169 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188019:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.188054:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858810112:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 96us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.188060:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6781 00000100:00100000:3.0:1746143138.188076:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6782 00000100:00100000:3.0:1746143138.188080:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858809984:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.188086:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.188095:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 11 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188103:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 11 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188118:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090014400/0x25aee876ca70e021 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ae1 expref: 11 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188126:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.188155:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858809984:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 74us (3825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.188159:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6782 00000100:00100000:3.0:1746143138.188174:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6783 00000100:00100000:3.0:1746143138.188179:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1971:x1830962858810240:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.188186:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.188194:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 10 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188201:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 10 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188212:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132f7b400/0x25aee876ca70dde3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165098a expref: 10 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188222:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.188235:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1971:x1830962858810240:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 56us (3831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.188240:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6783 00000100:00100000:3.0:1746143138.188250:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6784 00000100:00100000:3.0:1746143138.188254:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1970:x1830962858810496:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.188262:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.188269:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 17 pid: 20836 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188277:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 17 pid: 20836 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188287:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b5dd200/0x25aee876ca70de99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ec expref: 17 pid: 20836 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143138.188295:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.188307:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1970:x1830962858810496:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 54us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.188312:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6784 00000100:00100000:2.0:1746143138.189003:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858811392 00000100:00100000:2.0:1746143138.189008:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858811392 00000100:00100000:2.0:1746143138.189058:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8246 00000100:00100000:2.0:1746143138.189065:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:31138:x1830962858811392:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143138.189079:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.189092:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70e194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bb3 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.189178:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.189190:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.189197:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.189207:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.189212:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.189220:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.189304:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.189312:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.189318:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.189346:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.189356:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 11 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.189367:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861318528:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.189611:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.190045:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.190068:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.190084:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.190107:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.190166:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.190197:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.190245:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858809856 00000100:00100000:0.0:1746143138.190250:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858809856 00010000:00010000:0.0:1746143138.190266:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 9 pid: 754 timeout: 1020 lvb_type: 1 00000100:00100000:0.0:1746143138.190279:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858810880 00000100:00100000:0.0:1746143138.190281:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858810880 00010000:00010000:0.0:1746143138.190287:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143138.190294:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858810752 00000100:00100000:0.0:1746143138.190295:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858810752 00010000:00010000:0.0:1746143138.190301:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 10 pid: 754 timeout: 1020 lvb_type: 1 00000100:00100000:0.0:1746143138.190308:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858811520 00000100:00100000:0.0:1746143138.190309:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858811520 00010000:00010000:0.0:1746143138.190316:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 16 pid: 26949 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143138.190323:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858811648 00000100:00100000:0.0:1746143138.190324:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858811648 00010000:00010000:0.0:1746143138.190331:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 11 pid: 22204 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143138.190339:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6785 00000100:00100000:0.0:1746143138.190343:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858809856:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143138.190349:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.190359:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 9 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.190368:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 9 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.190379:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8600/0x25aee876ca70e108 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b66 expref: 9 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.190393:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.190414:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858809856:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 70us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.190420:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6785 00000100:00100000:0.0:1746143138.190452:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6786 00000100:00100000:0.0:1746143138.190458:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858810880:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143138.190463:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.190471:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190478:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190489:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a7c200/0x25aee876ca70dff0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650acc expref: 16 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190497:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190499:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190502:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190508:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190521:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.190536:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858810880:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 79us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.190541:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6786 00000100:00100000:0.0:1746143138.190550:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6787 00000100:00100000:0.0:1746143138.190554:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858810752:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143138.190560:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.190567:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 11 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.190575:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 11 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.190585:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d929400/0x25aee876ca70ddc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650959 expref: 11 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.190597:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190598:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190601:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190606:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190617:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143138.190629:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190636:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190651:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190658:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190665:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190671:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e96000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143138.190674:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190685:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190693:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190699:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e96000/0x25aee876ca70e163 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143138.190732:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858809216:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 21906us (22630us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.190739:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12781 00000100:00100000:0.0:1746143138.190750:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858811008 00000100:00100000:0.0:1746143138.190753:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858811008 00000100:00100000:0.0:1746143138.190767:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12783 00000100:00100000:0.0:1746143138.190771:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31130:x1830962858811008:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143138.190780:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143138.190787:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ba5 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190797:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190800:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190805:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143138.190808:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190816:0:4758:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190824:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190832:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aeb3a00, rc 0) 00000100:00100000:0.0:1746143138.190844:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31130:x1830962858811008:12345-192.168.201.28@tcp:101:cat.0 Request processed in 72us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.190848:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12783 00000100:00100000:0.0:1746143138.190862:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6788 00000100:00100000:0.0:1746143138.190866:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858811520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143138.190871:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.190881:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 17 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190888:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 17 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190899:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf9800/0x25aee876ca70e0d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b58 expref: 17 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190905:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190906:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190908:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190915:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190925:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.190935:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858811520:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 69us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.190939:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6788 00000100:00100000:0.0:1746143138.190947:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6789 00000100:00100000:0.0:1746143138.190951:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858811648:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143138.190955:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.190962:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190969:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190977:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f391200/0x25aee876ca70e0c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b51 expref: 10 pid: 22204 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.190983:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190984:0:16965:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.190987:0:16965:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.190992:0:16965:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.191006:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.191015:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1968:x1830962858811648:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 64us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.191020:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6789 00000100:00100000:0.0:1746143138.191061:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1969:x1830962858810752:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 507us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.191066:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6787 00000100:00100000:3.0:1746143138.191174:0:1037:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858811136 00000100:00100000:3.0:1746143138.191177:0:1037:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858811136 00000100:00100000:3.0:1746143138.191197:0:1037:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8247 00000100:00100000:3.0:1746143138.191201:0:1037:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:31140:x1830962858811136:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.191209:0:1037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.191215:0:1037:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d70600/0x25aee876ca70e1b7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bac expref: -99 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191257:0:1037:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143138.191266:0:1037:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143138.191276:0:1037:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00000004:00200000:3.0:1746143138.191291:0:1037:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143138.191294:0:1037:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143138.191303:0:1037:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1037 initiator: MDT0 00010000:00010000:3.0:1746143138.191318:0:1037:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d70600/0x25aee876ca70e1b7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 212 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191330:0:1037:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 211 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191335:0:1037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143138.191338:0:1037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143138.191340:0:1037:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d71000, rc 0) 00000100:00100000:3.0:1746143138.191355:0:1037:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:31140:x1830962858811136:12345-192.168.201.28@tcp:101:cat.0 Request processed in 153us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.191359:0:1037:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8247 00010000:00010000:3.0:1746143138.191384:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191390:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191401:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191411:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191417:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191422:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094577400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143138.191424:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191429:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191437:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.191442:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094577400/0x25aee876ca70e147 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.191463:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858808832:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 23185us (23706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.191468:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12777 00010000:00010000:1.0:1746143138.191529:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191536:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191547:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191552:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191562:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191567:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e96a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143138.191569:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191574:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191581:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.191582:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.191586:0:8450:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191592:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.191612:0:8450:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.191621:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b598e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861318656:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143138.192056:0:4756:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.192063:0:4756:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.192076:0:4756:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.192086:0:4756:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.192091:0:4756:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.192096:0:4756:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094eaac00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143138.192098:0:4756:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.192103:0:4756:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.192111:0:4756:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.192116:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094eaac00/0x25aee876ca70e155 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.192156:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1970:x1830962858809344:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 23586us (24327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.192161:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12779 00000100:00100000:1.0:1746143138.192207:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.193077:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861318528:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.193093:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:2.0:1746143138.202708:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858810368:12345-192.168.201.28@tcp:4:cat.0 Request processed in 18722us (18839us total) trans 17179872845 rc 0/0 00000100:00100000:2.0:1746143138.202720:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2033 00002000:00100000:2.0:1746143138.202734:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1732608->2097151) req@ffff8800a531b800 x1830962858810368/t17179872845(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.202743:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531b800 with x1830962858810368 ext(1732608->2097151) 00010000:00010000:2.0:1746143138.202753:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 16 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.202764:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 16 pid: 21048 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143138.202770:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a531b800 00000100:00100000:1.0:1746143138.203870:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.205431:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a531a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858810624:12345-192.168.201.28@tcp:4:cat.0 Request processed in 18213us (18332us total) trans 17179872846 rc 0/0 00000100:00100000:0.0:1746143138.205440:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2034 00002000:00100000:0.0:1746143138.205449:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1437695) req@ffff8800a531a300 x1830962858810624/t17179872846(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.205458:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a531a300 with x1830962858810624 ext(1048576->1437695) 00010000:00010000:0.0:1746143138.205466:0:31430:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 16 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.205475:0:31430:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 16 pid: 21048 timeout: 1020 lvb_type: 0 00002000:00010000:0.0:1746143138.205482:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a531a300 00000100:00100000:1.0:1746143138.206898:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.207175:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858811776 00000100:00100000:2.0:1746143138.207182:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858811776 00010000:00010000:2.0:1746143138.207209:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 12 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.208671:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6790 00000100:00100000:2.0:1746143138.208681:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858811776:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.208694:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.208701:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 12 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.208711:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 12 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.208728:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009499f000/0x25aee876ca70e132 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b90 expref: 12 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.208741:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.208745:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.208753:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.208758:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.208777:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.208802:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1969:x1830962858811776:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 124us (4936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.208807:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6790 00010000:00010000:3.0:1746143138.209024:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.209041:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:3.0:1746143138.209054:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143138.209130:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.209146:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.209152:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.209157:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b807800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143138.209160:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.209165:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.209172:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143138.209174:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143138.209177:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00000100:00100000:2.0:1746143138.209648:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858811904 00000100:00100000:2.0:1746143138.209653:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858811904 00000100:00100000:2.0:1746143138.209674:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12784 00000100:00100000:2.0:1746143138.209679:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858811904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.209691:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.209702:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bba expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143138.209720:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x681407a0, atime: 0x681407a0, ctime: 0x681407a0, blocks: 0x7cf 00010000:00010000:2.0:1746143138.209733:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.209734:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.209741:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 16 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.209973:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 16 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.209987:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3df600, rc 0) 00000100:00100000:2.0:1746143138.210008:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858811904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 329us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.210013:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12784 00000100:00100000:1.0:1746143138.210105:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.210120:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.210134:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.210159:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.210172:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.210231:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b598e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861318656:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143138.210248:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.210254:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e96a00/0x25aee876ca70e16a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.210289:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1970:x1830962858809472:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 41318us (42161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143138.210294:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12782 00000100:00100000:1.0:1746143138.210307:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858812032 00000100:00100000:1.0:1746143138.210309:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858812032 00000100:00100000:1.0:1746143138.210323:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858812160 00000100:00100000:1.0:1746143138.210325:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858812160 00000100:00100000:1.0:1746143138.210332:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858812288 00000100:00100000:1.0:1746143138.210334:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858812288 00000100:00100000:1.0:1746143138.210342:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858812416 00000100:00100000:1.0:1746143138.210343:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858812416 00000100:00100000:1.0:1746143138.210349:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858812544 00000100:00100000:1.0:1746143138.210350:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858812544 00000100:00100000:1.0:1746143138.210359:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12785 00000100:00100000:1.0:1746143138.210364:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858812032:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.210370:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.210377:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5e00/0x25aee876ca70e1d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bc1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.210410:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861318784:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143138.210447:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.210461:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12786 00000100:00100000:1.0:1746143138.210467:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858812160:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.210472:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.210477:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4400/0x25aee876ca70e1da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bc8 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.210494:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861318912:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143138.210509:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.210522:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12787 00000100:00100000:1.0:1746143138.210527:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858812288:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.210532:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.210539:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bcf expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143138.210551:0:22204:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x6814079e, atime: 0x6814079e, ctime: 0x6814079e, blocks: 0x81d 00010000:00010000:1.0:1746143138.210558:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.210559:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.210564:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.210574:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.210586:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df5a00, rc 0) 00000100:00100000:1.0:1746143138.210598:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858812288:12345-192.168.201.28@tcp:101:cat.0 Request processed in 72us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143138.210603:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12787 00000100:00100000:1.0:1746143138.210612:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12788 00000100:00100000:1.0:1746143138.210616:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858812416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.210621:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.210627:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bd6 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143138.210636:0:22204:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x681407a0, atime: 0x681407a0, ctime: 0x681407a0, blocks: 0x1807 00010000:00010000:1.0:1746143138.210643:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.210645:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.210648:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.210656:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.210662:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df4c00, rc 0) 00000100:00100000:1.0:1746143138.210674:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858812416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 58us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143138.210678:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12788 00000100:00100000:1.0:1746143138.210687:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12789 00000100:00100000:1.0:1746143138.210691:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858812544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.210696:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.211328:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807800/0x25aee876ca70e1a9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211348:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211357:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211361:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211366:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b806e00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143138.211368:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211372:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211381:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143138.211383:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143138.211385:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211389:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806e00/0x25aee876ca70e19b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211397:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211401:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211406:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211409:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b807c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143138.211411:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211419:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211424:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449800) 00010000:00010000:3.0:1746143138.211426:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143138.211428:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211432:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b807c00/0x25aee876ca70e1a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143138.211477:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70e194 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bb3 expref: 211 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.211483:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806c00/0x25aee876ca70e194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bb3 expref: 211 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.211490:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b806c00, rc 0) 00000100:00100000:3.0:1746143138.211509:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:31138:x1830962858811392:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 22446us (26591us total) trans 8589942466 rc 301/301 00000100:00100000:3.0:1746143138.211515:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8246 00010000:00010000:1.0:1746143138.211955:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bdd expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.211968:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.211969:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.211974:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 25 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.211984:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 25 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.211991:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df4a00, rc 0) 00000100:00100000:1.0:1746143138.212018:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858812544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1326us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143138.212023:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12789 00000100:00100000:3.0:1746143138.212465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.212485:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858812800 00000100:00100000:3.0:1746143138.212490:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858812800 00002000:00100000:3.0:1746143138.212514:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094425180 x1830962858812800/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.212522:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425180 with x1830962858812800 ext(3145728->4194303) 00002000:00010000:3.0:1746143138.212526:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094425180 00000100:00100000:3.0:1746143138.212547:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6234 00000100:00100000:3.0:1746143138.212552:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858812800:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.217697:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.217724:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858812928 00000100:00100000:2.0:1746143138.217731:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858812928 00010000:00010000:2.0:1746143138.217763:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 18 pid: 21048 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.217819:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6791 00000100:00100000:2.0:1746143138.217843:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858812928:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.217855:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.217874:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 18 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.217885:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 18 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.217905:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.217907:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.217910:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.217918:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.217937:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.217965:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858812928:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 124us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.217971:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6791 00000100:00100000:2.0:1746143138.218024:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.218036:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858813056 00000100:00100000:2.0:1746143138.218039:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858813056 00010000:00010000:2.0:1746143138.218066:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 18 pid: 21048 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.218082:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6792 00000100:00100000:2.0:1746143138.218088:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858813056:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.218095:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.218104:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 18 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.218112:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 18 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.218123:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.218125:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.218127:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.218134:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.218165:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.218180:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858813056:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 92us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.218186:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6792 00010000:00010000:1.0:1746143138.218502:0:754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.218510:0:754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.218527:0:754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.218533:0:754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.218545:0:754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.218550:0:754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecf8200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143138.218554:0:754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.218560:0:754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.218570:0:754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.218576:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecf8200/0x25aee876ca70e14e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.218622:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1970:x1830962858809088:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 50119us (50814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143138.218628:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12778 00010000:00010000:3.0:1746143138.218881:0:26949:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.218888:0:26949:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.218900:0:26949:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.218905:0:26949:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.218911:0:26949:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.218916:0:26949:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800953fd600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143138.218918:0:26949:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.218923:0:26949:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.218931:0:26949:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.218941:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800953fd600/0x25aee876ca70e15c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.220000:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1970:x1830962858808960:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 51343us (52143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.220007:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12780 00000100:00100000:3.0:1746143138.236336:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858812800:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23775us (23863us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.236346:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6234 00002000:00100000:3.0:1746143138.236357:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880094425180 x1830962858812800/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.236365:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094425180 with x1830962858812800 ext(3145728->4194303) 00002000:00010000:3.0:1746143138.236370:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094425180 00010000:00010000:1.0:1746143138.236820:0:8450:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.201.28@tcp) returned -22 from glimpse AST (req@ffff880092aece00 x1830962861318784) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 15 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:1.0:1746143138.236843:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f390000/0x25aee876ca70e059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650afd expref: 15 pid: 21048 timeout: 1020 lvb_type: 0 00000100:00100000:1.0:1746143138.236862:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861318784:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143138.236887:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5e00/0x25aee876ca70e1d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bc1 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.236896:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5e00/0x25aee876ca70e1d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bc1 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.236904:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df5e00, rc 0) 00000100:00100000:1.0:1746143138.236920:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858812032:12345-192.168.201.28@tcp:101:cat.0 Request processed in 26557us (26817us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143138.236925:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12785 00010000:00010000:1.0:1746143138.237276:0:8448:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.201.28@tcp) returned -22 from glimpse AST (req@ffff880092aec380 x1830962861318912) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 14 pid: 21048 timeout: 1020 lvb_type: 0 00010000:00010000:1.0:1746143138.237292:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c28800/0x25aee876ca70e091 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b19 expref: 14 pid: 21048 timeout: 1020 lvb_type: 0 00000100:00100000:1.0:1746143138.237301:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861318912:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143138.237460:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4400/0x25aee876ca70e1da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bc8 expref: 22 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.237470:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4400/0x25aee876ca70e1da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bc8 expref: 22 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.237485:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df4400, rc 0) 00000100:00100000:1.0:1746143138.237516:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858812160:12345-192.168.201.28@tcp:101:cat.0 Request processed in 27049us (27393us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143138.237522:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12786 00000100:00100000:0.0:1746143138.240936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.245654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.245685:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.245706:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.246072:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858813184 00000100:00100000:2.0:1746143138.246083:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858813184 00000100:00100000:1.0:1746143138.246083:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858813312 00000100:00100000:1.0:1746143138.246090:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858813312 00000100:00100000:0.0:1746143138.246103:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.246119:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858813568 00000100:00100000:0.0:1746143138.246122:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858813568 00000100:00100000:1.0:1746143138.246129:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858813440 00000100:00100000:1.0:1746143138.246131:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858813440 00000100:00100000:0.0:1746143138.246154:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858813696 00000100:00100000:0.0:1746143138.246157:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858813696 00000100:00100000:1.0:1746143138.246169:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12790 00000100:00100000:0.0:1746143138.246175:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12791 00000100:00100000:1.0:1746143138.246177:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858813312:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:0.0:1746143138.246181:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858813568:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143138.246192:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12792 00010000:00010000:1.0:1746143138.246194:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143138.246194:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143138.246205:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858813440:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.246211:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650beb expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.246211:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bf9 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.246220:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143138.246233:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746143138.246235:0:754:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x681407a0, atime: 0x681407a0, ctime: 0x681407a0, blocks: 0x821 00010000:00010000:0.0:1746143138.246235:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.246238:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650bf2 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.246243:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 11 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.246246:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.246247:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.246252:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143138.246259:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 11 pid: 21048 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143138.246260:0:26949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x681407a0, atime: 0x681407a0, ctime: 0x681407a0, blocks: 0x81f 00010000:00010000:1.0:1746143138.246262:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143138.246268:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf8200, rc 0) 00010000:00010000:1.0:1746143138.246269:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5df5800, rc 0) 00010000:00010000:3.0:1746143138.246276:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.246278:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.246285:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143138.246309:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858813568:12345-192.168.201.28@tcp:101:cat.0 Request processed in 128us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.246315:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12791 00000100:00100000:0.0:1746143138.246331:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12793 00000100:00100000:0.0:1746143138.246336:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1968:x1830962858813696:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143138.246342:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143138.246348:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c00 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.246361:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143138.246363:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143138.246364:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12794 00010000:00010000:0.0:1746143138.246367:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 11 pid: 21048 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143138.246371:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858813184:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143138.246376:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 11 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.246379:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143138.246382:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecf9c00, rc 0) 00010000:00010000:2.0:1746143138.246387:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650be4 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.246398:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.246400:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.246405:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.246429:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.246440:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d532c00, rc 0) 00000100:00100000:1.0:1746143138.246500:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858813312:12345-192.168.201.28@tcp:101:cat.0 Request processed in 323us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.246503:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858813696:12345-192.168.201.28@tcp:101:cat.0 Request processed in 167us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143138.246509:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12790 00000100:00100000:0.0:1746143138.246513:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12793 00010000:00010000:2.0:1746143138.246573:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.246580:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3dea00, rc 0) 00000100:00100000:2.0:1746143138.246609:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858813184:12345-192.168.201.28@tcp:101:cat.0 Request processed in 238us (5684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.246615:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12794 00000100:00100000:3.0:1746143138.246685:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858813440:12345-192.168.201.28@tcp:101:cat.0 Request processed in 484us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.246690:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12792 00000100:00100000:0.0:1746143138.246954:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.247002:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858813952 00000100:00100000:3.0:1746143138.247006:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858813952 00000100:00100000:3.0:1746143138.247052:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8248 00000100:00100000:3.0:1746143138.247059:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:31135:x1830962858813952:12345-192.168.201.28@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143138.247089:0:14795:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.247106:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b806200/0x25aee876ca70e140 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650b97 expref: 11 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.247131:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143138.247144:0:14795:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.247176:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:31135:x1830962858813952:12345-192.168.201.28@tcp:36:mirror_io.0 Request processed in 118us (389us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746143138.247180:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8248 00000100:00100000:0.0:1746143138.255565:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.255831:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858814208 00000100:00100000:3.0:1746143138.255840:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858814208 00002000:00100000:3.0:1746143138.255884:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800a5318a80 x1830962858814208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.255892:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5318a80 with x1830962858814208 ext(0->1048575) 00002000:00010000:3.0:1746143138.255897:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5318a80 00000100:00100000:3.0:1746143138.255918:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6235 00000100:00100000:3.0:1746143138.255925:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858814208:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143138.256876:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.256955:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858814464 00000100:00100000:2.0:1746143138.256962:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858814464 00000100:00100000:2.0:1746143138.257005:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3494 00000100:00100000:2.0:1746143138.257012:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c04d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:31135:x1830962858814464:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143138.257264:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c04d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:31135:x1830962858814464:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 252us (392us total) trans 8589942467 rc 0/0 00000100:00100000:2.0:1746143138.257271:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3494 00000100:00100000:0.0:1746143138.271143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.271246:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858814720 00000100:00100000:2.0:1746143138.271258:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858814720 00000100:00100000:2.0:1746143138.271323:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8249 00000100:00100000:2.0:1746143138.271331:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31142:x1830962858814720:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143138.271354:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.271371:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfa00/0x25aee876ca70e219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c07 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.271695:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271708:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271719:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271733:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271738:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271743:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271849:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271857:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271862:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143138.271872:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143138.271952:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271958:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271964:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271970:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3de200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143138.271973:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271979:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271989:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143138.271992:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143138.271995:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.271999:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3de200/0x25aee876ca70e220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.272056:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.272062:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.272066:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.272070:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3dfc00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143138.272072:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.272077:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.272083:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449a00) 00010000:00010000:2.0:1746143138.272085:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143138.272087:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.272091:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfc00/0x25aee876ca70e227 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.272126:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3dfa00/0x25aee876ca70e219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 20 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.272149:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 19 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.272155:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.272158:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143138.272160:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e96a00, rc 0) 00000100:00100000:2.0:1746143138.272232:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31142:x1830962858814720:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 902us (1106us total) trans 8589942468 rc 0/0 00000100:00100000:2.0:1746143138.272239:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8249 00000100:00100000:0.0:1746143138.274527:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.274593:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858814976 00000100:00100000:2.0:1746143138.274604:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858814976 00002000:00100000:2.0:1746143138.274644:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88012d3d6680 x1830962858814976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.274653:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d6680 with x1830962858814976 ext(4194304->5210111) 00002000:00010000:2.0:1746143138.274658:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3d6680 00000100:00100000:2.0:1746143138.274686:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6236 00000100:00100000:2.0:1746143138.274693:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858814976:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.276170:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858814208:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20239us (20610us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.276180:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6235 00002000:00100000:3.0:1746143138.276191:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800a5318a80 x1830962858814208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.276201:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5318a80 with x1830962858814208 ext(0->1048575) 00002000:00010000:3.0:1746143138.276206:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5318a80 00000100:00100000:0.0:1746143138.277066:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.277084:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858815232 00000100:00100000:0.0:1746143138.277090:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858815232 00000100:00100000:3.0:1746143138.277693:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3495 00000100:00100000:3.0:1746143138.277703:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:31135:x1830962858815232:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143138.277867:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:31135:x1830962858815232:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 166us (801us total) trans 8589942469 rc 0/0 00000100:00100000:3.0:1746143138.277874:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3495 00000100:00100000:0.0:1746143138.300539:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.300620:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858815360 00000100:00100000:3.0:1746143138.300631:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858815360 00000100:00100000:3.0:1746143138.301010:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12795 00000100:00100000:3.0:1746143138.301019:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31140:x1830962858815360:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.301071:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.301089:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c0e expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.301114:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.301116:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.301123:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.301146:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.301156:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094577a00, rc 0) 00000100:00100000:3.0:1746143138.301219:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31140:x1830962858815360:12345-192.168.201.28@tcp:101:cat.0 Request processed in 200us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.301225:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12795 00000100:00100000:3.0:1746143138.304592:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858814976:12345-192.168.201.28@tcp:3:cat.0 Request processed in 29890us (30061us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143138.304603:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6236 00002000:00100000:3.0:1746143138.304615:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88012d3d6680 x1830962858814976/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.304624:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3d6680 with x1830962858814976 ext(4194304->5210111) 00002000:00010000:3.0:1746143138.304629:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3d6680 00000100:00100000:0.0:1746143138.305077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.305253:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858815488 00000100:00100000:3.0:1746143138.305260:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858815488 00000100:00100000:3.0:1746143138.305290:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12796 00000100:00100000:3.0:1746143138.305297:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31142:x1830962858815488:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143138.305311:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.305325:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c15 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.305347:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.305355:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.305357:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.305360:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1695744->2052095] (req 1695744->2052095) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.305386:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.305397:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.305408:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861319040:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.305492:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.312803:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.312889:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858815744 00000100:00100000:3.0:1746143138.312897:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858815744 00002000:00100000:3.0:1746143138.312934:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb21c00 x1830962858815744/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.312943:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21c00 with x1830962858815744 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.312948:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb21c00 00000100:00100000:3.0:1746143138.313298:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6237 00000100:00100000:3.0:1746143138.313306:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858815744:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143138.317161:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.317195:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861319040:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.317221:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1695744->2052095] (req 1695744->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.317236:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094576200, rc 0) 00000100:00100000:2.0:1746143138.317286:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31142:x1830962858815488:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11989us (12210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.317294:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12796 00000100:00100000:2.0:1746143138.317334:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858815872 00000100:00100000:2.0:1746143138.317339:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858815872 00010000:00010000:2.0:1746143138.317362:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143138.317385:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6793 00000100:00100000:2.0:1746143138.317391:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858815872:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.317401:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.317416:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.317425:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.317443:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d532c00/0x25aee876ca70e204 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf2 expref: 17 pid: 26949 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.317456:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.317458:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.317463:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.317470:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.317494:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.317504:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861319168:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143138.317556:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.327781:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.327905:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861319168:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.327925:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.327981:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1968:x1830962858815872:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10588us (10826us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.327991:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6793 00000100:00100000:2.0:1746143138.328174:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858816128 00000100:00100000:2.0:1746143138.328181:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858816128 00000100:00100000:2.0:1746143138.328219:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3496 00000100:00100000:0.0:1746143138.328219:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.328225:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31130:x1830962858816128:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143138.328238:0:31430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858816384 00000100:00100000:0.0:1746143138.328241:0:31430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858816384 00002000:00100000:0.0:1746143138.328259:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1695744->1699839) req@ffff880093b5a300 x1830962858816384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.328268:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5a300 with x1830962858816384 ext(1695744->1699839) 00002000:00010000:0.0:1746143138.328271:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5a300 00000100:00100000:0.0:1746143138.328283:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6238 00000100:00100000:0.0:1746143138.328287:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858816384:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.328363:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31130:x1830962858816128:12345-192.168.201.28@tcp:35:cat.0 Request processed in 138us (589us total) trans 8589942470 rc 0/0 00000100:00100000:2.0:1746143138.328368:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3496 00000100:00100000:0.0:1746143138.328390:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858816384:12345-192.168.201.28@tcp:3:cat.0 Request processed in 102us (172us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143138.328396:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6238 00002000:00100000:0.0:1746143138.328400:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x304:0x0] (1695744->1699839) req@ffff880093b5a300 x1830962858816384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.328407:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5a300 with x1830962858816384 ext(1695744->1699839) 00002000:00010000:0.0:1746143138.328410:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5a300 00000100:00100000:3.0:1746143138.330419:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858815744:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17108us (17617us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.330427:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6237 00002000:00100000:3.0:1746143138.330435:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008eb21c00 x1830962858815744/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.330444:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb21c00 with x1830962858815744 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.330448:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008eb21c00 00000100:00100000:0.0:1746143138.336597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.336666:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858816640 00000100:00100000:3.0:1746143138.336676:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858816640 00002000:00100000:3.0:1746143138.336753:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (2048000->2052095) req@ffff880093b5b800 x1830962858816640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.336763:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5b800 with x1830962858816640 ext(2048000->2052095) 00002000:00010000:3.0:1746143138.336767:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5b800 00000100:00100000:3.0:1746143138.336797:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6239 00000100:00100000:3.0:1746143138.336805:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858816640:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.336976:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858816640:12345-192.168.201.28@tcp:3:cat.0 Request processed in 170us (385us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143138.336983:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6239 00002000:00100000:3.0:1746143138.336989:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (2048000->2052095) req@ffff880093b5b800 x1830962858816640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.336997:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5b800 with x1830962858816640 ext(2048000->2052095) 00002000:00010000:3.0:1746143138.336999:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b5b800 00000100:00100000:0.0:1746143138.341354:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.341430:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858816768 00000100:00100000:2.0:1746143138.341439:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858816768 00000100:00100000:2.0:1746143138.341492:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12797 00000100:00100000:2.0:1746143138.341500:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31140:x1830962858816768:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.341515:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.341529:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c1c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.341554:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.341681:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.341683:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.341687:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.341717:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 15 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.341729:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 15 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.341746:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861319296:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.341879:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.348328:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.348397:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858817024 00000100:00100000:3.0:1746143138.348406:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858817024 00000100:00100000:3.0:1746143138.348638:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3497 00000100:00100000:3.0:1746143138.348646:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31142:x1830962858817024:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143138.349251:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31142:x1830962858817024:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 604us (929us total) trans 8589942471 rc 0/0 00000100:00100000:3.0:1746143138.349258:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3497 00000100:00100000:1.0:1746143138.349755:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.349825:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861319296:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.349849:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.349864:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3de800, rc 0) 00000100:00100000:0.0:1746143138.350102:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858817152 00000100:00100000:0.0:1746143138.350106:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858817152 00002000:00100000:0.0:1746143138.350130:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x304:0x0] (1695744->2052095) req@ffff880092aec380 x1830962858817152/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.350150:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec380 with x1830962858817152 ext(1695744->2052095) 00010000:00010000:0.0:1746143138.350156:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 16 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.350172:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 16 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00010000:0.0:1746143138.350178:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aec380 00000100:00100000:3.0:1746143138.350336:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:31140:x1830962858816768:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8836us (8988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.350343:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12797 00000100:00100000:0.0:1746143138.350692:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2035 00000100:00100000:0.0:1746143138.350699:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858817152:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143138.362059:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858817152:12345-192.168.201.28@tcp:4:cat.0 Request processed in 11334us (12278us total) trans 17179872847 rc 0/0 00000100:00100000:3.0:1746143138.362071:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2035 00002000:00100000:3.0:1746143138.362082:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x304:0x0] (1695744->2052095) req@ffff880092aec380 x1830962858817152/t17179872847(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.362092:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec380 with x1830962858817152 ext(1695744->2052095) 00010000:00010000:3.0:1746143138.362101:0:31431:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 18 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.362115:0:31431:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 18 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00010000:3.0:1746143138.362123:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aec380 00000100:00100000:0.0:1746143138.370244:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.371201:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858817280 00000100:00100000:3.0:1746143138.371212:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858817280 00010000:00010000:3.0:1746143138.371253:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 18 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.371295:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6794 00000100:00100000:3.0:1746143138.371303:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858817280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.371319:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143138.371340:0:7113:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143136 -> 1746143137 00002000:00010000:3.0:1746143138.371343:0:7113:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143136 -> 1746143137 00010000:00010000:3.0:1746143138.371350:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 18 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.371363:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 18 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.371387:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094576200/0x25aee876ca70e243 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2052095) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c15 expref: 18 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.371406:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.371409:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.371416:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.371425:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.371458:0:7113:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.371470:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861319424:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143138.371558:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.380298:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7113:1830962861319424:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.380323:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.380726:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858817280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9420us (10490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.380737:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6794 00000100:00100000:0.0:1746143138.380882:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.381165:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.381361:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858817664 00000100:00100000:3.0:1746143138.381368:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858817664 00002000:00100000:3.0:1746143138.381403:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800919dca80 x1830962858817664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.381414:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dca80 with x1830962858817664 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.381419:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dca80 00000100:00100000:3.0:1746143138.381432:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858817792 00000100:00100000:3.0:1746143138.381434:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858817792 00002000:00100000:3.0:1746143138.381446:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800919dd500 x1830962858817792/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.381453:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dd500 with x1830962858817792 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.381456:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dd500 00000100:00100000:2.0:1746143138.381545:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6240 00000100:00100000:2.0:1746143138.381557:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858817664:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.382250:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6241 00000100:00100000:3.0:1746143138.382256:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858817792:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.410481:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858817664:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28911us (29583us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.410496:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6240 00002000:00100000:2.0:1746143138.410513:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800919dca80 x1830962858817664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.410524:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dca80 with x1830962858817664 ext(1048576->2097151) 00002000:00010000:2.0:1746143138.410531:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dca80 00000100:00100000:3.0:1746143138.417213:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858817792:12345-192.168.201.28@tcp:3:cat.0 Request processed in 34939us (36030us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.417229:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6241 00002000:00100000:3.0:1746143138.417246:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800919dd500 x1830962858817792/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.417257:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dd500 with x1830962858817792 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.417264:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dd500 00000100:00100000:0.0:1746143138.433956:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.433997:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.434025:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.434026:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858818048 00000100:00100000:3.0:1746143138.434061:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858818048 00000100:00100000:0.0:1746143138.434080:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:3.0:1746143138.434111:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800919ded80 x1830962858818048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143138.434118:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858818304 00000100:00100000:0.0:1746143138.434121:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858818304 00002000:00100000:3.0:1746143138.434122:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919ded80 with x1830962858818048 ext(2097152->3145727) 00002000:00010000:3.0:1746143138.434128:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919ded80 00002000:00100000:0.0:1746143138.434146:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800919dfb80 x1830962858818304/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.434154:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dfb80 with x1830962858818304 ext(3145728->4194303) 00002000:00010000:0.0:1746143138.434156:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dfb80 00000100:00100000:0.0:1746143138.434167:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858818560 00000100:00100000:0.0:1746143138.434169:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858818560 00000100:00100000:3.0:1746143138.434171:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858818816 00000100:00100000:3.0:1746143138.434173:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858818816 00002000:00100000:3.0:1746143138.434185:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800919dce00 x1830962858818816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.434185:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800919dc700 x1830962858818560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.434192:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dce00 with x1830962858818816 ext(3145728->4194303) 00002000:00100000:0.0:1746143138.434192:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dc700 with x1830962858818560 ext(2097152->3145727) 00002000:00010000:3.0:1746143138.434195:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dce00 00002000:00010000:0.0:1746143138.434195:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dc700 00000100:00100000:0.0:1746143138.434208:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6242 00000100:00100000:0.0:1746143138.434215:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858818048:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.434725:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6243 00000100:00100000:3.0:1746143138.434732:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858818304:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143138.434794:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6244 00000100:00100000:0.0:1746143138.434800:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858818560:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.436973:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6245 00000100:00100000:3.0:1746143138.436984:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858818816:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.459898:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858818304:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25156us (25889us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.459910:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6243 00002000:00100000:3.0:1746143138.459922:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff8800919dfb80 x1830962858818304/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.459932:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dfb80 with x1830962858818304 ext(3145728->4194303) 00002000:00010000:3.0:1746143138.459939:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919dfb80 00000100:00100000:2.0:1746143138.468729:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858818048:12345-192.168.201.28@tcp:3:cat.0 Request processed in 34502us (34773us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.468742:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6242 00002000:00100000:2.0:1746143138.468755:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800919ded80 x1830962858818048/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.468765:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919ded80 with x1830962858818048 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.468772:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919ded80 00000100:00100000:3.0:1746143138.479018:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858818816:12345-192.168.201.28@tcp:3:cat.0 Request processed in 42021us (44922us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.479062:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6245 00002000:00100000:3.0:1746143138.479076:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff8800919dce00 x1830962858818816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.479086:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dce00 with x1830962858818816 ext(3145728->4194303) 00002000:00010000:3.0:1746143138.479093:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dce00 00000100:00100000:0.0:1746143138.482202:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.482614:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858819072 00000100:00100000:2.0:1746143138.482624:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858819072 00000100:00100000:2.0:1746143138.482686:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8250 00000100:00100000:2.0:1746143138.482694:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31148:x1830962858819072:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.482718:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.482742:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523d200/0x25aee876ca70e251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c23 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.482837:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.482851:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143138.482861:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143138.482872:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143138.482986:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523d200/0x25aee876ca70e251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 24 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.483024:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 23 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.483052:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.483056:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143138.483059:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a523c000, rc 0) 00000100:00100000:2.0:1746143138.483117:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31148:x1830962858819072:12345-192.168.201.28@tcp:101:cat.0 Request processed in 423us (927us total) trans 8589942472 rc 0/0 00000100:00100000:2.0:1746143138.483123:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8250 00000100:00100000:0.0:1746143138.487323:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.487430:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858819200 00000100:00100000:3.0:1746143138.487439:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858819200 00000100:00100000:3.0:1746143138.487480:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12798 00000100:00100000:3.0:1746143138.487486:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858819200:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.487504:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.487522:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c2a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.487548:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.487550:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.487558:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 18 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.487573:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 18 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.487584:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b716c00, rc 0) 00000100:00100000:3.0:1746143138.487633:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858819200:12345-192.168.201.28@tcp:101:cat.0 Request processed in 147us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.487638:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12798 00000100:00100000:2.0:1746143138.489498:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858818560:12345-192.168.201.28@tcp:3:cat.0 Request processed in 54692us (55466us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.489511:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6244 00002000:00100000:2.0:1746143138.489521:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff8800919dc700 x1830962858818560/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.489530:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919dc700 with x1830962858818560 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.489536:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919dc700 00000100:00100000:0.0:1746143138.489667:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.489965:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858819328 00000100:00100000:2.0:1746143138.489972:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858819328 00000100:00100000:2.0:1746143138.490388:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12799 00000100:00100000:2.0:1746143138.490396:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:31138:x1830962858819328:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143138.490411:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.490428:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c31 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.490454:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 17 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.490463:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.490469:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.490471:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.490475:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1376256->2097151] (req 1376256->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.490505:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.490518:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 24 pid: 26949 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.490530:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861319552:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.491054:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 17 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.491064:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 17 pid: 754 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143138.491073:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861319680:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.492855:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.498205:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861319552:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143138.498313:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.500329:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861319680:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.500369:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1376256->2097151] (req 1376256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.500388:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475e00, rc 0) 00000100:00100000:2.0:1746143138.500459:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:31138:x1830962858819328:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10062us (10791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.500469:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12799 00000100:00100000:1.0:1746143138.500709:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.501213:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858819456 00000100:00100000:3.0:1746143138.501221:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858819456 00010000:00010000:3.0:1746143138.501250:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 24 pid: 26949 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.501273:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858819584 00000100:00100000:3.0:1746143138.501275:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858819584 00010000:00010000:3.0:1746143138.501285:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 18 pid: 754 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.501301:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6795 00000100:00100000:3.0:1746143138.501307:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858819456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.501319:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.501342:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 24 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.501353:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 24 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.501381:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094577a00/0x25aee876ca70e23c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c0e expref: 24 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.501408:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.501435:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858819456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 127us (3125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.501441:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6795 00000100:00100000:1.0:1746143138.501674:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6796 00000100:00100000:1.0:1746143138.501681:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858819584:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143138.501688:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143138.501699:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 18 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:1.0:1746143138.501708:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 18 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:1.0:1746143138.501720:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5df5800/0x25aee876ca70e1f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650beb expref: 18 pid: 754 timeout: 1020 lvb_type: 1 00010000:00010000:1.0:1746143138.501732:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.501735:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.501741:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.501749:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.501777:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 22 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.501794:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861319808:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143138.502047:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.503682:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.504201:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.504296:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858819968 00000100:00100000:3.0:1746143138.504302:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858819968 00002000:00100000:3.0:1746143138.504337:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009b59b100 x1830962858819968/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.504347:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b100 with x1830962858819968 ext(0->1048575) 00002000:00010000:3.0:1746143138.504353:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b59b100 00000100:00100000:3.0:1746143138.504367:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6246 00000100:00100000:3.0:1746143138.504373:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858819968:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.504634:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858819712 00000100:00100000:2.0:1746143138.504640:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858819712 00000100:00100000:2.0:1746143138.504678:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12800 00000100:00100000:2.0:1746143138.504685:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858819712:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.504695:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.504710:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70e274 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c38 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.504752:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861319936:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143138.506081:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.512994:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861319808:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143138.513018:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143138.513070:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.513086:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858819584:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11405us (12377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.513098:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6796 00000100:00100000:0.0:1746143138.514421:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858820224 00000100:00100000:0.0:1746143138.514430:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858820224 00002000:00100000:0.0:1746143138.514664:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1376256->1380351) req@ffff88009b598e00 x1830962858820224/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.514675:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598e00 with x1830962858820224 ext(1376256->1380351) 00002000:00010000:0.0:1746143138.514681:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598e00 00000100:00100000:0.0:1746143138.514711:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6247 00000100:00100000:0.0:1746143138.514720:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858820224:12345-192.168.201.28@tcp:3:multiop.0 00002000:00010000:2.0:1746143138.515456:0:26949:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime: 1746143136 -> 1746143137 00002000:00010000:2.0:1746143138.515460:0:26949:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime: 1746143136 -> 1746143137 00002000:00010000:2.0:1746143138.515463:0:26949:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime: 1746143136 -> 1746143137 00000100:00100000:2.0:1746143138.515474:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861319936:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143138.515504:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70e274 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c38 expref: 25 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.515517:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70e274 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c38 expref: 25 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.515545:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475400, rc 0) 00000100:00100000:2.0:1746143138.515576:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858819712:12345-192.168.201.28@tcp:101:cat.0 Request processed in 10892us (11897us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143138.515584:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12800 00000100:00100000:0.0:1746143138.517218:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858820224:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 2493us (4144us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143138.517229:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6247 00002000:00100000:0.0:1746143138.517236:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1376256->1380351) req@ffff88009b598e00 x1830962858820224/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.517245:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b598e00 with x1830962858820224 ext(1376256->1380351) 00002000:00010000:0.0:1746143138.517250:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b598e00 00000100:00100000:3.0:1746143138.523882:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858819968:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19497us (19669us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.523894:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6246 00002000:00100000:3.0:1746143138.523907:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009b59b100 x1830962858819968/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.523917:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59b100 with x1830962858819968 ext(0->1048575) 00002000:00010000:3.0:1746143138.523924:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b59b100 00000100:00100000:0.0:1746143138.525903:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.529585:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858820480 00000100:00100000:3.0:1746143138.529599:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858820480 00002000:00100000:3.0:1746143138.529648:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094514000 x1830962858820480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.529659:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514000 with x1830962858820480 ext(4194304->5210111) 00002000:00010000:3.0:1746143138.529665:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094514000 00000100:00100000:3.0:1746143138.529684:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6248 00000100:00100000:3.0:1746143138.529690:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858820480:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143138.539670:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.539740:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858820608 00000100:00100000:0.0:1746143138.539745:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.539750:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858820608 00000100:00100000:1.0:1746143138.541621:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858820736 00000100:00100000:1.0:1746143138.541631:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858820736 00000100:00100000:1.0:1746143138.541671:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12801 00000100:00100000:1.0:1746143138.541681:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:31138:x1830962858820608:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143138.541687:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143138.541698:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12802 00010000:00010000:1.0:1746143138.541699:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143138.541706:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31148:x1830962858820736:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.541715:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.541715:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c3f expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.541723:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c46 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.541744:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.541744:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.541751:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.541753:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143138.541754:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 18 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.541757:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 18 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.541760:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.541761:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143138.541764:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.541786:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 24 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.541786:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 18 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.541798:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 24 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:1.0:1746143138.541799:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 18 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:1.0:1746143138.541810:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861320192:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.541815:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861320064:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.543413:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858820480:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13714us (17510us total) trans 0 rc 1015808/1015808 00010000:00010000:1.0:1746143138.543418:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.543425:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6248 00010000:00010000:1.0:1746143138.543429:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 24 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00100000:3.0:1746143138.543435:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094514000 x1830962858820480/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143138.543439:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861320320:192.168.201.28@tcp:104: 00002000:00100000:3.0:1746143138.543445:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514000 with x1830962858820480 ext(4194304->5210111) 00002000:00010000:3.0:1746143138.543449:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094514000 00000100:00100000:1.0:1746143138.543663:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.544099:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.549503:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.549542:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.549573:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.549741:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861320192:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143138.549752:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861320320:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.550017:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861320064:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143138.550181:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858820864 00000100:00100000:0.0:1746143138.550188:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858820864 00010000:00010000:0.0:1746143138.550224:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 19 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:0.0:1746143138.550257:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858820992 00000100:00100000:0.0:1746143138.550260:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858820992 00010000:00010000:0.0:1746143138.550271:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 25 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143138.550287:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6797 00000100:00100000:0.0:1746143138.550362:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858820864:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143138.550376:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6798 00010000:00010000:0.0:1746143138.550376:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143138.550608:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 19 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.550619:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 19 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.550642:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b716c00/0x25aee876ca70e266 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c2a expref: 19 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143138.550667:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.550669:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858820992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.550677:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.550686:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 25 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.550694:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 25 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.550706:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3de800/0x25aee876ca70e24a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c1c expref: 25 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143138.550706:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858820864:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 412us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143138.550714:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6797 00010000:00010000:3.0:1746143138.550725:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.550727:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.550733:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.550741:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143138.550757:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.550778:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858821248 00000100:00100000:0.0:1746143138.550781:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858821248 00000100:00100000:0.0:1746143138.550800:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12803 00000100:00100000:0.0:1746143138.550804:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858821248:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143138.550819:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143138.550831:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b201e00/0x25aee876ca70e289 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c4d expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143138.550869:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861320448:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143138.550913:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093e40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.551018:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143138.551139:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 17 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.551155:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475800, rc 0) 00000100:00100000:2.0:1746143138.551189:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858821376 00000100:00100000:2.0:1746143138.551193:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858821376 00000100:00100000:2.0:1746143138.551214:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12804 00000100:00100000:2.0:1746143138.551219:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858821376:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.551225:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.551232:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70e290 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c54 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.551255:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861320576:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143138.551286:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.551312:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31148:x1830962858820736:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9608us (11567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.551318:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12802 00000100:00100000:2.0:1746143138.551360:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858821120 00000100:00100000:2.0:1746143138.551364:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858821120 00002000:00100000:2.0:1746143138.551390:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1376256->2097151) req@ffff880094514700 x1830962858821120/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.551399:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514700 with x1830962858821120 ext(1376256->2097151) 00010000:00010000:2.0:1746143138.551405:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 29 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.551417:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 29 pid: 26949 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143138.551657:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094514700 00000100:00100000:2.0:1746143138.551681:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2036 00000100:00100000:2.0:1746143138.551688:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858821120:12345-192.168.201.28@tcp:4:cat.0 00010000:00010000:3.0:1746143138.552879:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 30 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.552879:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 30 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.552888:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1a00, rc 0) 00000100:00100000:3.0:1746143138.552890:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861320704:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143138.552908:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:31138:x1830962858820608:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11230us (13251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143138.552914:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12801 00000100:00100000:3.0:1746143138.552923:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.557992:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861320448:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143138.558117:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b201e00/0x25aee876ca70e289 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c4d expref: 29 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.558147:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b201e00/0x25aee876ca70e289 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c4d expref: 29 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.558176:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b201e00, rc 0) 00000100:00100000:2.0:1746143138.558225:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858821248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7417us (7466us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143138.558234:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12803 00002000:00010000:3.0:1746143138.560547:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime: 1746143136 -> 1746143137 00000100:00100000:3.0:1746143138.560576:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861320576:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143138.560597:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861320704:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.560603:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70e290 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c54 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.560609:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143138.560615:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c475400/0x25aee876ca70e290 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c54 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.560626:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c475400, rc 0) 00000100:00100000:2.0:1746143138.560642:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858820992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 10259us (11067us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.560643:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858821376:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9425us (9626us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143138.560651:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12804 00000100:00100000:2.0:1746143138.560651:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6798 00000100:00100000:0.0:1746143138.562733:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.562791:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858821632 00000100:00100000:3.0:1746143138.562799:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858821632 00000100:00100000:3.0:1746143138.562848:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3498 00000100:00100000:3.0:1746143138.562857:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:31138:x1830962858821632:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143138.563138:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:31138:x1830962858821632:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 273us (403us total) trans 8589942473 rc 0/0 00000100:00100000:3.0:1746143138.563145:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3498 00000100:00100000:0.0:1746143138.569073:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.569169:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858821760 00000100:00100000:3.0:1746143138.569179:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858821760 00000100:00100000:3.0:1746143138.569222:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12805 00000100:00100000:3.0:1746143138.569230:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858821760:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.569246:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.569263:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e297 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c5b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.569316:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861320832:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143138.569708:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.570972:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858821120:12345-192.168.201.28@tcp:4:cat.0 Request processed in 19281us (21425us total) trans 17179872848 rc 0/0 00000100:00100000:2.0:1746143138.570983:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2036 00002000:00100000:2.0:1746143138.570992:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1376256->2097151) req@ffff880094514700 x1830962858821120/t17179872848(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.571003:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514700 with x1830962858821120 ext(1376256->2097151) 00010000:00010000:2.0:1746143138.571012:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 27 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.571026:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 27 pid: 26949 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143138.571051:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094514700 00000100:00100000:3.0:1746143138.575152:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861320832:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143138.575194:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e297 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c5b expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.575210:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e297 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c5b expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.575226:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b717c00, rc 0) 00000100:00100000:3.0:1746143138.575286:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858821760:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6056us (6223us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143138.575296:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12805 00000100:00100000:0.0:1746143138.582089:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.582202:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.582241:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.582322:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858822144 00000100:00100000:2.0:1746143138.582331:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858822144 00000100:00100000:2.0:1746143138.582379:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8251 00000100:00100000:2.0:1746143138.582387:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31151:x1830962858822144:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143138.582411:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.582428:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093245600/0x25aee876ca70e29e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c62 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.582538:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.582551:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 210 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.582558:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 24 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.582565:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.582598:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 24 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.582609:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 24 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.582621:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861320960:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.582697:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 210 pid: 1037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.582705:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 210 pid: 1037 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.582713:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861321088:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.582731:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.582748:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858822400 00000100:00100000:2.0:1746143138.582752:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858822400 00000100:00100000:2.0:1746143138.582774:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3499 00000100:00100000:2.0:1746143138.582794:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:31140:x1830962858822400:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:2.0:1746143138.582938:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:31140:x1830962858822400:12345-192.168.201.28@tcp:35:cat.0 Request processed in 143us (695us total) trans 8589942474 rc 0/0 00000100:00100000:2.0:1746143138.582945:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3499 00000100:00100000:3.0:1746143138.583276:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858821888 00000100:00100000:3.0:1746143138.583280:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858821888 00010000:00010000:3.0:1746143138.583304:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 25 pid: 26949 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.583325:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6799 00000100:00100000:3.0:1746143138.583330:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858821888:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.583340:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.583359:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 25 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.583369:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 25 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.583388:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c475e00/0x25aee876ca70e26d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c31 expref: 25 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.583404:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.583412:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.583420:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.584086:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.584112:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 16 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.584122:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861321216:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143138.584185:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.589749:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.589776:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858822656 00000100:00100000:2.0:1746143138.589783:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858822656 00010000:00010000:2.0:1746143138.589818:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 212 pid: 1037 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.590071:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6800 00000100:00100000:2.0:1746143138.590080:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+212:1970:x1830962858822656:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.590094:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.590100:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 212 pid: 1037 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.590111:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 212 pid: 1037 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.590146:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.590151:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.590160:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.590165:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143138.590642:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861320960:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143138.590654:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d71000/0x25aee876ca70e1be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bac expref: 212 pid: 1037 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143138.590681:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861321088:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143138.590703:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:2.0:1746143138.590743:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:1970:x1830962858822656:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 664us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.590750:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6800 00000100:00100000:2.0:1746143138.590857:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.590872:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858822528 00000100:00100000:2.0:1746143138.590875:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858822528 00010000:00010000:2.0:1746143138.590888:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 25 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.590902:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6801 00000100:00100000:2.0:1746143138.590908:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858822528:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.590915:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.590918:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 25 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.590928:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 25 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.590939:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e22e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c07 expref: 25 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.591112:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861321216:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.591123:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.591153:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858821888:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7822us (9075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.591160:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6799 00010000:00010000:2.0:1746143138.591263:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.591267:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.591274:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.591281:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143138.591297:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.591313:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858822528:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 404us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.591318:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6801 00010000:00010000:0.0:1746143138.591506:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:0.0:1746143138.591513:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:0.0:1746143138.591534:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143138.591684:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093245600/0x25aee876ca70e29e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 25 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.591697:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 24 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143138.591703:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143138.591706:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143138.591708:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093455c00, rc 0) 00000100:00100000:0.0:1746143138.591734:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31151:x1830962858822144:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 9348us (9532us total) trans 8589942475 rc 0/0 00000100:00100000:0.0:1746143138.591739:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8251 00000100:00100000:0.0:1746143138.596553:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.597316:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858822912 00000100:00100000:3.0:1746143138.597326:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858822912 00002000:00100000:3.0:1746143138.597373:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008fe79880 x1830962858822912/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.597383:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe79880 with x1830962858822912 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.597390:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe79880 00000100:00100000:3.0:1746143138.597425:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6249 00000100:00100000:3.0:1746143138.597433:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858822912:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143138.600933:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.600980:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858823040 00000100:00100000:3.0:1746143138.600987:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858823040 00000100:00100000:3.0:1746143138.601052:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12806 00000100:00100000:3.0:1746143138.601060:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31151:x1830962858823040:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143138.601077:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.601093:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c69 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.601127:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 17 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.601146:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 12 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.601152:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.601154:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.601158:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.601186:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 12 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.601200:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 12 pid: 21048 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.601216:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861321344:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.601561:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 17 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.601570:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 17 pid: 22204 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143138.601579:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861321472:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.601602:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.608404:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861321344:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143138.608405:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.608417:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861321472:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.608453:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.608479:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b717c00, rc 0) 00000100:00100000:3.0:1746143138.608538:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31151:x1830962858823040:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7477us (7614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.608548:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12806 00000100:00100000:2.0:1746143138.609154:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858823168 00000100:00100000:2.0:1746143138.609162:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858823168 00010000:00010000:2.0:1746143138.609193:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 12 pid: 21048 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143138.609243:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6802 00000100:00100000:2.0:1746143138.609251:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858823168:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.609264:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.609289:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 12 pid: 21048 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.609299:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 12 pid: 21048 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.609322:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf9c00/0x25aee876ca70e20b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c00 expref: 12 pid: 21048 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.609352:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.609451:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858823168:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 200us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.609458:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6802 00000100:00100000:0.0:1746143138.611569:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.611714:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858823296 00000100:00100000:2.0:1746143138.611725:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858823296 00010000:00010000:2.0:1746143138.611755:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 18 pid: 22204 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143138.611789:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6803 00000100:00100000:2.0:1746143138.611797:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858823296:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.611811:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.611831:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 18 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.611843:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 18 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.611863:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df4c00/0x25aee876ca70e1e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bd6 expref: 18 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.611877:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.611879:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.611886:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.611895:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.611929:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.611940:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861321600:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143138.612023:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.614120:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858822912:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16679us (17569us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.614141:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6249 00002000:00100000:3.0:1746143138.614152:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88008fe79880 x1830962858822912/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.614162:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe79880 with x1830962858822912 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.614167:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe79880 00000100:00100000:2.0:1746143138.614628:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861321600:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143138.614645:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.614670:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1971:x1830962858823296:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2874us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.614679:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6803 00000100:00100000:0.0:1746143138.616177:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.616839:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858823552 00000100:00100000:3.0:1746143138.616845:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858823552 00002000:00100000:3.0:1746143138.616879:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3055616->3059711) req@ffff88008fe78a80 x1830962858823552/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.616888:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78a80 with x1830962858823552 ext(3055616->3059711) 00002000:00010000:3.0:1746143138.616892:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe78a80 00000100:00100000:3.0:1746143138.616914:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6250 00000100:00100000:3.0:1746143138.616921:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858823552:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143138.617111:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858823552:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 189us (937us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143138.617118:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6250 00002000:00100000:3.0:1746143138.617124:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3055616->3059711) req@ffff88008fe78a80 x1830962858823552/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.617141:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78a80 with x1830962858823552 ext(3055616->3059711) 00002000:00010000:3.0:1746143138.617144:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe78a80 00000100:00100000:0.0:1746143138.619952:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.620075:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858823680 00000100:00100000:3.0:1746143138.620084:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858823680 00000100:00100000:3.0:1746143138.620123:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12807 00000100:00100000:3.0:1746143138.620139:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31148:x1830962858823680:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.620157:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.620177:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c70 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.620208:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.620216:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.620218:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.620222:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 4/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.620634:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.620664:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 23 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.620683:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861321728:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.620875:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.622441:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.622497:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858823808 00000100:00100000:2.0:1746143138.622503:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858823808 00000100:00100000:2.0:1746143138.622983:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12808 00000100:00100000:2.0:1746143138.622991:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31151:x1830962858823808:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143138.623007:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143138.623077:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1830962861321728:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.623102:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.623122:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529e600, rc 0) 00000100:00100000:3.0:1746143138.623163:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31148:x1830962858823680:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3033us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.623170:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12807 00010000:00010000:2.0:1746143138.623400:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c77 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.623423:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.623615:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 23 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.623621:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.623623:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.623626:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->2215935] (req 2097152->2215935) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.623651:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 23 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.623662:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 23 pid: 22204 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143138.623673:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861321856:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.623840:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.623849:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 19 pid: 4758 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.623858:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861321984:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.623878:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.624216:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.624529:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858823936 00000100:00100000:2.0:1746143138.624533:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858823936 00002000:00100000:2.0:1746143138.624565:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1286143) req@ffff8800942c4380 x1830962858823936/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.624574:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4380 with x1830962858823936 ext(1048576->1286143) 00010000:00010000:2.0:1746143138.624580:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 24 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.624590:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 24 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143138.624596:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c4380 00000100:00100000:2.0:1746143138.624624:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2037 00000100:00100000:2.0:1746143138.624631:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858823936:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143138.625623:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861321856:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.626067:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4756:1830962861321984:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.626088:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->2215935] (req 2097152->2215935) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.626106:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81dc00, rc 0) 00000100:00100000:2.0:1746143138.626147:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31151:x1830962858823808:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3157us (3711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.626156:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12808 00000100:00100000:0.0:1746143138.628395:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.630187:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858823936:12345-192.168.201.28@tcp:4:cat.0 Request processed in 5550us (5965us total) trans 17179872849 rc 0/0 00000100:00100000:2.0:1746143138.630199:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2037 00002000:00100000:2.0:1746143138.630212:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x304:0x0] (1048576->1286143) req@ffff8800942c4380 x1830962858823936/t17179872849(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.630222:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4380 with x1830962858823936 ext(1048576->1286143) 00010000:00010000:2.0:1746143138.630233:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 26 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.630245:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 26 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143138.630253:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c4380 00000100:00100000:3.0:1746143138.630866:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858824064 00000100:00100000:3.0:1746143138.630874:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858824064 00010000:00010000:3.0:1746143138.630901:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 19 pid: 4758 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.630929:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6804 00000100:00100000:3.0:1746143138.630934:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858824064:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.630947:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.630966:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 19 pid: 4758 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.630979:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 19 pid: 4758 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.631002:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aeb3a00/0x25aee876ca70e1b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ba5 expref: 19 pid: 4758 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.631023:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.631060:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858824064:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 119us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.631068:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6804 00000100:00100000:1.0:1746143138.631421:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.631439:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858824192 00000100:00100000:2.0:1746143138.631442:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858824192 00010000:00010000:2.0:1746143138.631456:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 26 pid: 22204 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143138.631472:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6805 00000100:00100000:2.0:1746143138.631477:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858824192:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.631486:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.631495:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 26 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.631503:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 26 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.631515:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5df4a00/0x25aee876ca70e1ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bdd expref: 26 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143138.631538:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.631540:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.631547:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 17 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.631555:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 17 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.631586:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 17 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.631598:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861322112:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143138.631649:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.633398:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.633448:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858824320 00000100:00100000:3.0:1746143138.633453:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858824320 00010000:00010000:3.0:1746143138.633473:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 26 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.633502:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6806 00000100:00100000:3.0:1746143138.633887:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858824320:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.633898:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.633915:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 26 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.633926:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 26 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.633944:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132dc1a00/0x25aee876ca70e27b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c3f expref: 26 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.633958:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.633960:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.633965:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.633973:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.634011:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.634022:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861322240:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143138.634114:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53fdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.634296:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861322112:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143138.634310:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.634334:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858824192:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2857us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.634342:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6805 00000100:00100000:0.0:1746143138.635757:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.635862:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858824576 00000100:00100000:2.0:1746143138.635871:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858824576 00002000:00100000:2.0:1746143138.635908:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2211840->2215935) req@ffff88008fe7b480 x1830962858824576/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.635918:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b480 with x1830962858824576 ext(2211840->2215935) 00002000:00010000:2.0:1746143138.635922:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7b480 00000100:00100000:2.0:1746143138.635949:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6251 00000100:00100000:2.0:1746143138.635954:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858824576:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143138.636155:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858824576:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 200us (401us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143138.636160:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6251 00002000:00100000:2.0:1746143138.636165:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2211840->2215935) req@ffff88008fe7b480 x1830962858824576/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.636172:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b480 with x1830962858824576 ext(2211840->2215935) 00002000:00010000:2.0:1746143138.636176:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7b480 00000100:00100000:3.0:1746143138.636239:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094425880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861322240:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.636251:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.636272:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1968:x1830962858824320:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2765us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.636279:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6806 00000100:00100000:0.0:1746143138.640658:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.640811:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858824832 00000100:00100000:2.0:1746143138.640820:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858824832 00000100:00100000:0.0:1746143138.640945:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143138.641026:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008fe7b800 x1830962858824832/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.641056:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b800 with x1830962858824832 ext(1048576->2097151) 00002000:00010000:2.0:1746143138.641062:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7b800 00000100:00100000:2.0:1746143138.641233:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858825088 00000100:00100000:2.0:1746143138.641236:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858825088 00002000:00100000:2.0:1746143138.641251:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008fe78700 x1830962858825088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143138.641255:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6252 00002000:00100000:2.0:1746143138.641259:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78700 with x1830962858825088 ext(1048576->2097151) 00002000:00010000:2.0:1746143138.641263:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe78700 00000100:00100000:3.0:1746143138.641264:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858824832:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143138.641280:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6253 00000100:00100000:2.0:1746143138.641284:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858825088:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143138.656999:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858824832:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 15722us (16336us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.657013:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6252 00002000:00100000:3.0:1746143138.657025:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88008fe7b800 x1830962858824832/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.657067:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7b800 with x1830962858824832 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.657073:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7b800 00000100:00100000:2.0:1746143138.659446:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858825088:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 18152us (18492us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.659457:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6253 00002000:00100000:2.0:1746143138.659466:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88008fe78700 x1830962858825088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.659475:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78700 with x1830962858825088 ext(1048576->2097151) 00002000:00010000:2.0:1746143138.659481:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe78700 00000100:00100000:0.0:1746143138.675398:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.675442:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.675468:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.675498:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.675537:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858825472 00000100:00100000:0.0:1746143138.675546:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858825472 00002000:00100000:0.0:1746143138.675593:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3235839) req@ffff88008fe78000 x1830962858825472/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 504/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.675602:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78000 with x1830962858825472 ext(2097152->3235839) 00002000:00010000:0.0:1746143138.675608:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe78000 00000100:00100000:0.0:1746143138.675623:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858825600 00000100:00100000:0.0:1746143138.675625:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858825600 00002000:00100000:0.0:1746143138.675633:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3235840->4194303) req@ffff880094e95f80 x1830962858825600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.675639:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95f80 with x1830962858825600 ext(3235840->4194303) 00002000:00010000:0.0:1746143138.675641:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e95f80 00000100:00100000:0.0:1746143138.675661:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858825984 00000100:00100000:0.0:1746143138.675663:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858825984 00002000:00100000:0.0:1746143138.675673:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3264512->4194303) req@ffff880094e94000 x1830962858825984/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.675684:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e94000 with x1830962858825984 ext(3264512->4194303) 00002000:00010000:0.0:1746143138.675687:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e94000 00000100:00100000:0.0:1746143138.675695:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858825856 00000100:00100000:0.0:1746143138.675696:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858825856 00002000:00100000:0.0:1746143138.675704:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2215936->3264511) req@ffff880094e94e00 x1830962858825856/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.675709:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e94e00 with x1830962858825856 ext(2215936->3264511) 00002000:00010000:0.0:1746143138.675711:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e94e00 00000100:00100000:0.0:1746143138.675722:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6254 00000100:00100000:0.0:1746143138.675729:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858825472:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.675851:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6255 00000100:00100000:1.0:1746143138.677229:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6256 00000100:00100000:1.0:1746143138.677239:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858825984:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.679041:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6257 00000100:00100000:3.0:1746143138.679053:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858825856:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143138.680024:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858825600:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.702385:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858825856:12345-192.168.201.28@tcp:3:cat.0 Request processed in 23323us (26874us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.702398:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6257 00002000:00100000:3.0:1746143138.702411:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2215936->3264511) req@ffff880094e94e00 x1830962858825856/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.702421:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e94e00 with x1830962858825856 ext(2215936->3264511) 00002000:00010000:3.0:1746143138.702429:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e94e00 00000100:00100000:1.0:1746143138.716412:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858825984:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39164us (40930us total) trans 0 rc 929792/929792 00000100:00100000:1.0:1746143138.716425:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6256 00002000:00100000:1.0:1746143138.716440:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x305:0x0] (3264512->4194303) req@ffff880094e94000 x1830962858825984/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 929792/929792 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143138.716661:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e94000 with x1830962858825984 ext(3264512->4194303) 00002000:00010000:1.0:1746143138.716668:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e94000 00000100:00100000:3.0:1746143138.719713:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858825600:12345-192.168.201.28@tcp:3:cat.0 Request processed in 43344us (44262us total) trans 0 rc 958464/958464 00000100:00100000:3.0:1746143138.719725:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6255 00002000:00100000:3.0:1746143138.719734:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3235840->4194303) req@ffff880094e95f80 x1830962858825600/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.719742:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95f80 with x1830962858825600 ext(3235840->4194303) 00002000:00010000:3.0:1746143138.719749:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e95f80 00000100:00100000:2.0:1746143138.725107:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858825472:12345-192.168.201.28@tcp:3:cat.0 Request processed in 49365us (49709us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.725120:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6254 00002000:00100000:2.0:1746143138.725145:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3235839) req@ffff88008fe78000 x1830962858825472/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 504/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.725155:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe78000 with x1830962858825472 ext(2097152->3235839) 00002000:00010000:2.0:1746143138.725163:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe78000 00000100:00100000:0.0:1746143138.737332:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.737614:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.737676:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858826624 00000100:00100000:1.0:1746143138.737685:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858826624 00000100:00100000:1.0:1746143138.737737:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8252 00000100:00100000:1.0:1746143138.737745:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+211:31157:x1830962858826624:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.737770:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.737789:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880137757400/0x25aee876ca70e2c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c7e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.738095:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858826368 00000100:00100000:3.0:1746143138.738100:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858826368 00010000:00010000:1.0:1746143138.738114:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738137:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00002000:00100000:3.0:1746143138.738148:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094e97b80 x1830962858826368/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143138.738149:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00002000:00100000:3.0:1746143138.738158:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97b80 with x1830962858826368 ext(4194304->5210111) 00010000:00010000:1.0:1746143138.738162:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00002000:00010000:3.0:1746143138.738164:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e97b80 00010000:00010000:1.0:1746143138.738171:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738176:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:3.0:1746143138.738193:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6258 00000100:00100000:3.0:1746143138.738200:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858826368:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:1.0:1746143138.738287:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738295:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738302:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143138.738310:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143138.738397:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738404:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738409:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738415:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136034c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143138.738418:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738424:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738433:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143138.738436:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143138.738440:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738445:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136034c00/0x25aee876ca70e2cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738463:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738468:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738472:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738476:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136035400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143138.738479:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738483:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738490:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92800) 00010000:00010000:1.0:1746143138.738492:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143138.738494:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738497:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e2d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.738531:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880137757400/0x25aee876ca70e2c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 214 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.738546:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 213 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.738552:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143138.738554:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143138.738557:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136034600, rc 0) 00000100:00100000:1.0:1746143138.738602:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:31157:x1830962858826624:12345-192.168.201.28@tcp:101:cat.0 Request processed in 857us (986us total) trans 8589942476 rc 0/0 00000100:00100000:1.0:1746143138.738608:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8252 00000100:00100000:1.0:1746143138.742148:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.743115:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.743150:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858826752 00000100:00100000:3.0:1746143138.743157:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858826752 00000100:00100000:3.0:1746143138.743188:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858826880 00000100:00100000:3.0:1746143138.743190:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858826880 00000100:00100000:3.0:1746143138.743209:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12809 00000100:00100000:3.0:1746143138.743215:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858826752:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.743233:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.743248:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c85 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.743271:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.743273:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.743282:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.743297:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.743308:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529f600, rc 0) 00000100:00100000:3.0:1746143138.743337:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858826752:12345-192.168.201.28@tcp:101:cat.0 Request processed in 121us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.743343:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12809 00000100:00100000:3.0:1746143138.743355:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12810 00000100:00100000:3.0:1746143138.743360:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858826880:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.743365:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.743370:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c8c expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.743379:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.743380:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.743383:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.743391:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.743398:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529f800, rc 0) 00000100:00100000:3.0:1746143138.743409:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858826880:12345-192.168.201.28@tcp:101:cat.0 Request processed in 48us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.743413:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12810 00000100:00100000:3.0:1746143138.743578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.743588:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858827008 00000100:00100000:3.0:1746143138.743591:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858827008 00000100:00100000:3.0:1746143138.743604:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12811 00000100:00100000:3.0:1746143138.743608:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858827008:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.743615:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.743623:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a529fa00/0x25aee876ca70e2f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c93 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.743649:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.743660:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858827136 00000100:00100000:3.0:1746143138.743661:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861322368:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143138.743663:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858827136 00000100:00100000:1.0:1746143138.743680:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12812 00000100:00100000:1.0:1746143138.743684:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858827136:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.743691:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.743698:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70e300 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650c9a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.743720:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861322496:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143138.743786:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5263000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.743800:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143138.750570:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143136 -> 1746143137 00002000:00010000:3.0:1746143138.750573:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143136 -> 1746143137 00002000:00010000:3.0:1746143138.750578:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143136 -> 1746143137 00002000:00010000:1.0:1746143138.750578:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143136 -> 1746143137 00002000:00010000:3.0:1746143138.750580:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143136 -> 1746143137 00002000:00010000:1.0:1746143138.750580:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143136 -> 1746143137 00000100:00100000:3.0:1746143138.750601:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861322368:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143138.750604:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861322496:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143138.750631:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a529fa00/0x25aee876ca70e2f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c93 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.750631:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70e300 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c9a expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.750645:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a529fa00/0x25aee876ca70e2f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c93 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.750645:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cf8000/0x25aee876ca70e300 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c9a expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143138.750670:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cf8000, rc 0) 00000100:00100000:1.0:1746143138.750718:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858827136:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7031us (7068us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143138.750726:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12812 00010000:00010000:3.0:1746143138.750869:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529fa00, rc 0) 00000100:00100000:3.0:1746143138.750898:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1968:x1830962858827008:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7288us (7320us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143138.750904:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12811 00000100:00100000:3.0:1746143138.753837:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1970:x1830962858826368:12345-192.168.201.28@tcp:3:cat.0 Request processed in 15630us (16507us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143138.753849:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6258 00002000:00100000:3.0:1746143138.753860:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880094e97b80 x1830962858826368/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.753871:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e97b80 with x1830962858826368 ext(4194304->5210111) 00002000:00010000:3.0:1746143138.753877:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e97b80 00000100:00100000:0.0:1746143138.770704:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.771693:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858827392 00000100:00100000:3.0:1746143138.771702:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858827392 00002000:00100000:3.0:1746143138.771750:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094e95880 x1830962858827392/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.771760:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95880 with x1830962858827392 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.771765:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e95880 00000100:00100000:3.0:1746143138.771799:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6259 00000100:00100000:3.0:1746143138.771806:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858827392:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143138.773841:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.774481:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858827648 00000100:00100000:2.0:1746143138.774490:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858827648 00002000:00100000:2.0:1746143138.774528:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009310f800 x1830962858827648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.774538:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310f800 with x1830962858827648 ext(1048576->2097151) 00002000:00010000:2.0:1746143138.774544:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310f800 00000100:00100000:2.0:1746143138.776315:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6260 00000100:00100000:2.0:1746143138.776329:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858827648:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.790999:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858827392:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19182us (20294us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.791009:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6259 00002000:00100000:3.0:1746143138.791021:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880094e95880 x1830962858827392/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.791057:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e95880 with x1830962858827392 ext(1048576->2097151) 00002000:00010000:3.0:1746143138.791064:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e95880 00000100:00100000:2.0:1746143138.796092:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858827648:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19758us (22248us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.796104:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6260 00002000:00100000:2.0:1746143138.796115:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88009310f800 x1830962858827648/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.796136:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310f800 with x1830962858827648 ext(1048576->2097151) 00002000:00010000:2.0:1746143138.796142:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009310f800 00000100:00100000:0.0:1746143138.804942:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.805064:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858827904 00000100:00100000:1.0:1746143138.805072:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858827904 00000100:00100000:1.0:1746143138.805107:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8253 00000100:00100000:1.0:1746143138.805113:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+213:31160:x1830962858827904:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143138.805144:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.805159:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e307 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ca1 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.805244:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805256:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805265:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805276:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805286:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805291:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805379:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e31c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805387:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e31c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805573:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e31c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143138.805582:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143138.805652:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805658:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805663:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805668:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904ae800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143138.805671:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805676:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805685:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143138.805689:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143138.805692:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805696:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e30e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.805724:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00000100:00100000:0.0:1746143138.805919:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.807553:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143138.807628:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.807637:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.807641:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904af400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143138.807644:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.807648:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.807657:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92a00) 00010000:00010000:1.0:1746143138.807658:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143138.807660:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.807663:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e315 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.807703:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e307 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ca1 expref: 216 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.807714:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e31c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ca1 expref: 215 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.807718:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143138.807719:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143138.807720:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4aa9a00, rc 0) 00000100:00100000:1.0:1746143138.807764:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:31160:x1830962858827904:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 2651us (2829us total) trans 8589942477 rc 0/0 00000100:00100000:1.0:1746143138.807769:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8253 00000100:00100000:2.0:1746143138.808494:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858828032 00000100:00100000:2.0:1746143138.808502:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858828032 00000100:00100000:2.0:1746143138.808734:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858828160 00000100:00100000:2.0:1746143138.808737:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858828160 00000100:00100000:2.0:1746143138.809116:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12813 00000100:00100000:2.0:1746143138.809138:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858828032:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.809152:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.809165:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136034c00/0x25aee876ca70e32a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ca8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.809219:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12814 00000100:00100000:2.0:1746143138.809221:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861322624:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143138.809227:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858828160:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.809236:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.809245:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e331 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650caf expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143138.809270:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861322752:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143138.809287:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.809293:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.812195:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861322624:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143138.812219:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136034c00/0x25aee876ca70e32a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ca8 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.812232:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136034c00/0x25aee876ca70e32a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ca8 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.812246:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136034c00, rc 0) 00000100:00100000:2.0:1746143138.812281:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858828032:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3156us (6361us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143138.812288:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12813 00000100:00100000:0.0:1746143138.813141:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.813229:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858828288 00000100:00100000:2.0:1746143138.813234:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861322752:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143138.813239:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858828288 00010000:00010000:2.0:1746143138.813254:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e331 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650caf expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.813265:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e331 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650caf expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.813274:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4aa9000, rc 0) 00000100:00100000:2.0:1746143138.813298:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858828160:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4072us (5920us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143138.813303:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12814 00000100:00100000:3.0:1746143138.814213:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 618 00000100:00100000:3.0:1746143138.814222:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:1971:x1830962858828288:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.814236:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.814260:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e31c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ca1 expref: 215 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.814279:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143138.814283:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.814332:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:1971:x1830962858828288:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 112us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.814339:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 618 00000100:00100000:0.0:1746143138.815710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.815956:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858828416 00000100:00100000:2.0:1746143138.815964:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858828416 00000100:00100000:2.0:1746143138.815997:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12815 00000100:00100000:2.0:1746143138.816003:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:31157:x1830962858828416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.816019:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.816054:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650cb6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.816079:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.816086:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.816088:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.816090:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.816117:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.816138:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 10 pid: 8450 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.816151:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861322880:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.816227:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.819064:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861322880:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.819089:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 18 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.819104:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5266800, rc 0) 00000100:00100000:2.0:1746143138.819157:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:31157:x1830962858828416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3151us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.819165:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12815 00000100:00100000:1.0:1746143138.825447:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.825735:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858828544 00000100:00100000:2.0:1746143138.825743:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858828544 00002000:00100000:2.0:1746143138.826321:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3055616->3145727) req@ffff8800942c7480 x1830962858828544/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.826331:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7480 with x1830962858828544 ext(3055616->3145727) 00010000:00010000:2.0:1746143138.826340:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 11 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.826528:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 11 pid: 8450 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143138.826535:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c7480 00000100:00100000:2.0:1746143138.827137:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2038 00000100:00100000:2.0:1746143138.827147:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1968:x1830962858828544:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143138.833375:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858828544:12345-192.168.201.28@tcp:4:cat.0 Request processed in 6221us (7926us total) trans 21474840111 rc 0/0 00000100:00100000:2.0:1746143138.833387:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2038 00002000:00100000:2.0:1746143138.833398:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3055616->3145727) req@ffff8800942c7480 x1830962858828544/t21474840111(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.833408:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7480 with x1830962858828544 ext(3055616->3145727) 00010000:00010000:2.0:1746143138.833417:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 13 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.833436:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 13 pid: 8450 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143138.833443:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942c7480 00000100:00100000:0.0:1746143138.839489:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.839575:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858828672 00000100:00100000:2.0:1746143138.839586:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858828672 00010000:00010000:2.0:1746143138.839623:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 13 pid: 8450 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.840202:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6807 00000100:00100000:2.0:1746143138.840212:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858828672:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.840224:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.840245:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 13 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.840258:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 13 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.840278:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b717c00/0x25aee876ca70e2b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c69 expref: 13 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.840306:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.840309:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.840315:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.840329:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.840361:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 17 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.840374:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861323008:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143138.840634:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.844464:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861323008:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143138.844486:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.844524:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858828672:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4314us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.844534:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6807 00000100:00100000:0.0:1746143138.848248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.848413:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858828928 00000100:00100000:2.0:1746143138.848421:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858828928 00002000:00100000:2.0:1746143138.848462:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880092aec000 x1830962858828928/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.848472:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec000 with x1830962858828928 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.848477:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aec000 00000100:00100000:2.0:1746143138.848511:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6261 00000100:00100000:2.0:1746143138.848518:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858828928:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143138.857192:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.857599:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858829184 00000100:00100000:1.0:1746143138.857608:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858829184 00000100:00100000:1.0:1746143138.857655:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8254 00000100:00100000:1.0:1746143138.857662:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31163:x1830962858829184:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143138.857684:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.857700:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e33f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650cbd expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.857796:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.857809:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.857818:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.857829:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.857836:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.857841:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.857926:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.857934:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.857939:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143138.857946:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143138.858019:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858026:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858061:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858067:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904af000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143138.858070:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858077:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858086:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143138.858089:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143138.858092:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858097:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858111:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858116:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858121:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858140:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904ae000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143138.858142:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858147:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858158:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92a00) 00010000:00010000:1.0:1746143138.858160:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143138.858162:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.858167:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e34d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.859189:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e33f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 27 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.859204:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 26 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.859211:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143138.859213:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143138.859216:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136035400, rc 0) 00000100:00100000:1.0:1746143138.859260:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:31163:x1830962858829184:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1599us (2077us total) trans 8589942478 rc 0/0 00000100:00100000:1.0:1746143138.859267:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8254 00000100:00100000:0.0:1746143138.865416:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.865774:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858828928:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 17253us (17531us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.865785:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6261 00002000:00100000:3.0:1746143138.865795:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880092aec000 x1830962858828928/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.865803:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aec000 with x1830962858828928 ext(2097152->3145727) 00002000:00010000:3.0:1746143138.865808:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092aec000 00000100:00100000:2.0:1746143138.865880:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858829440 00000100:00100000:2.0:1746143138.865887:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858829440 00000100:00100000:2.0:1746143138.865917:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3500 00000100:00100000:2.0:1746143138.865923:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c04c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:31163:x1830962858829440:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143138.866098:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c04c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:31163:x1830962858829440:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 174us (688us total) trans 8589942479 rc 0/0 00000100:00100000:2.0:1746143138.866104:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3500 00000100:00100000:0.0:1746143138.870342:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.870389:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.870671:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858829568 00000100:00100000:2.0:1746143138.870680:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858829568 00000100:00100000:2.0:1746143138.870727:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858829696 00000100:00100000:2.0:1746143138.870729:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858829696 00000100:00100000:2.0:1746143138.870746:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12816 00000100:00100000:2.0:1746143138.870752:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:31157:x1830962858829568:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.870768:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.870782:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650cc4 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.870808:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 17 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.870815:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.870816:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143138.870819:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.870848:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 17 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.870860:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 17 pid: 4756 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.870878:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861323136:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.870951:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143138.870982:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12817 00000100:00100000:2.0:1746143138.870989:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:31160:x1830962858829696:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143138.870997:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.871007:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ccb expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.871023:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.871050:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.871052:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.871055:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3264512->3780607] (req 3264512->3780607) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.871072:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.871080:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 19 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143138.871089:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861323264:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143138.871135:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.875447:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.875512:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861323264:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.875544:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3264512->3780607] (req 3264512->3780607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.875560:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c28200, rc 0) 00000100:00100000:3.0:1746143138.875640:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:31160:x1830962858829696:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4650us (5249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.875647:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12817 00000100:00100000:3.0:1746143138.875683:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858829824 00000100:00100000:3.0:1746143138.875689:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858829824 00002000:00100000:3.0:1746143138.875720:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2215935) req@ffff880092aeca80 x1830962858829824/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.875729:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aeca80 with x1830962858829824 ext(2097152->2215935) 00010000:00010000:3.0:1746143138.875735:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 18 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.875744:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 18 pid: 4756 timeout: 1020 lvb_type: 0 00002000:00010000:3.0:1746143138.875754:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aeca80 00000100:00100000:3.0:1746143138.875767:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2039 00000100:00100000:3.0:1746143138.875773:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858829824:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:0.0:1746143138.877025:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.877142:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861323136:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143138.877160:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.877170:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c29a00, rc 0) 00000100:00100000:2.0:1746143138.877202:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:31157:x1830962858829568:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6449us (6866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.877209:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12816 00000100:00100000:3.0:1746143138.877272:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858829952 00000100:00100000:3.0:1746143138.877276:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858829952 00010000:00010000:3.0:1746143138.877294:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 19 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.877312:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6808 00000100:00100000:3.0:1746143138.877317:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858829952:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.877327:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.877342:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 19 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.877352:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 19 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.877371:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5266800/0x25aee876ca70e338 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cb6 expref: 19 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.877385:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.877387:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.877392:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.877405:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.877429:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 18 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.877438:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861323392:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143138.877483:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5263000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.879873:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858829824:12345-192.168.201.28@tcp:4:cat.0 Request processed in 4088us (4423us total) trans 17179872850 rc 0/0 00000100:00100000:3.0:1746143138.879887:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2039 00002000:00100000:3.0:1746143138.879903:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2215935) req@ffff880092aeca80 x1830962858829824/t17179872850(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.879914:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aeca80 with x1830962858829824 ext(2097152->2215935) 00010000:00010000:3.0:1746143138.879924:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.879938:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00002000:00010000:3.0:1746143138.879945:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aeca80 00000100:00100000:0.0:1746143138.882910:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.882921:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861323392:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.882945:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.882996:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858829952:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5677us (5972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.883007:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6808 00000100:00100000:2.0:1746143138.883094:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858830208 00000100:00100000:2.0:1746143138.883106:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858830208 00002000:00100000:2.0:1746143138.883158:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3264512->3268607) req@ffff880093916300 x1830962858830208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.883271:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093916300 with x1830962858830208 ext(3264512->3268607) 00002000:00010000:2.0:1746143138.883276:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093916300 00000100:00100000:2.0:1746143138.883302:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6262 00000100:00100000:2.0:1746143138.883310:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858830208:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143138.883496:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858830208:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 186us (595us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143138.883502:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6262 00002000:00100000:2.0:1746143138.883508:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3264512->3268607) req@ffff880093916300 x1830962858830208/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.883520:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093916300 with x1830962858830208 ext(3264512->3268607) 00002000:00010000:2.0:1746143138.883523:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093916300 00000100:00100000:0.0:1746143138.891110:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.891268:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.891392:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858830336 00000100:00100000:3.0:1746143138.891401:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858830336 00010000:00010000:3.0:1746143138.891436:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.891474:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6809 00000100:00100000:3.0:1746143138.891481:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858830336:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.891495:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.891517:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.891528:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.891549:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e81dc00/0x25aee876ca70e2c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c77 expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.891567:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.891569:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.891577:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.891585:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.891622:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.891633:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861323520:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143138.891711:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a207d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143138.891860:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858830592 00000100:00100000:1.0:1746143138.891864:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858830592 00000100:00100000:1.0:1746143138.891897:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8255 00000100:00100000:1.0:1746143138.891902:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:31166:x1830962858830592:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143138.891921:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143138.891940:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650cd2 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.892062:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892072:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892080:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892091:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892096:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892101:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892205:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e385 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892213:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e385 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892218:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e385 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143138.892225:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143138.892306:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892313:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892323:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892328:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904ae000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143138.892331:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892338:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892346:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143138.892349:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143138.892352:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892356:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae000/0x25aee876ca70e377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892383:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892387:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892391:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892395:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904af000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143138.892397:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892401:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892410:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92a00) 00010000:00010000:1.0:1746143138.892412:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143138.892414:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892418:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af000/0x25aee876ca70e37e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143138.892447:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ae800/0x25aee876ca70e370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cd2 expref: 30 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.892461:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e385 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cd2 expref: 29 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143138.892467:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143138.892469:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143138.892471:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904af400, rc 0) 00000100:00100000:1.0:1746143138.892497:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:31166:x1830962858830592:12345-192.168.201.28@tcp:101:cat.0 Request processed in 595us (1237us total) trans 8589942480 rc 0/0 00000100:00100000:1.0:1746143138.892503:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8255 00000100:00100000:3.0:1746143138.894824:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861323520:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.894845:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143138.894886:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858830336:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3404us (3785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.894895:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6809 00000100:00100000:0.0:1746143138.895346:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.895409:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858830720 00000100:00100000:3.0:1746143138.895414:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858830720 00000100:00100000:2.0:1746143138.895604:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 619 00000100:00100000:2.0:1746143138.895618:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858830720:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143138.895629:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143138.895650:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800904af400/0x25aee876ca70e385 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cd2 expref: 29 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.895677:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143138.895681:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.895700:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858830720:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.895705:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 619 00000100:00100000:0.0:1746143138.898156:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.898384:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858830976 00000100:00100000:3.0:1746143138.898393:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858830976 00000100:00100000:3.0:1746143138.898440:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3501 00000100:00100000:3.0:1746143138.898448:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:31166:x1830962858830976:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143138.899027:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.899139:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858831232 00000100:00100000:2.0:1746143138.899147:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858831232 00002000:00100000:2.0:1746143138.899187:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3776512->3780607) req@ffff880090f23480 x1830962858831232/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.899197:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23480 with x1830962858831232 ext(3776512->3780607) 00002000:00010000:2.0:1746143138.899203:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f23480 00000100:00100000:2.0:1746143138.899221:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6263 00000100:00100000:2.0:1746143138.899228:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858831232:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143138.899518:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:31166:x1830962858830976:12345-192.168.201.28@tcp:35:cat.0 Request processed in 1069us (2283us total) trans 8589942481 rc 0/0 00000100:00100000:3.0:1746143138.899527:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3501 00000100:00100000:2.0:1746143138.899613:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858831232:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 383us (1363us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143138.899620:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6263 00002000:00100000:2.0:1746143138.899627:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3776512->3780607) req@ffff880090f23480 x1830962858831232/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.899635:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f23480 with x1830962858831232 ext(3776512->3780607) 00002000:00010000:2.0:1746143138.899638:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f23480 00000100:00100000:0.0:1746143138.902347:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.902380:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.902416:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143138.902427:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858831488 00000100:00100000:1.0:1746143138.902435:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858831488 00002000:00100000:1.0:1746143138.902472:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880090f21880 x1830962858831488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143138.902478:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858831744 00000100:00100000:2.0:1746143138.902482:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858831744 00002000:00100000:1.0:1746143138.902482:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21880 with x1830962858831488 ext(2097152->3145727) 00002000:00010000:1.0:1746143138.902487:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f21880 00002000:00100000:2.0:1746143138.902502:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3264511) req@ffff880090f21f80 x1830962858831744/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143138.902504:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6264 00000100:00100000:1.0:1746143138.902510:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858831488:12345-192.168.201.28@tcp:3:multiop.0 00002000:00100000:2.0:1746143138.902511:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21f80 with x1830962858831744 ext(3145728->3264511) 00002000:00010000:2.0:1746143138.902515:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21f80 00000100:00100000:2.0:1746143138.902527:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6265 00000100:00100000:2.0:1746143138.902532:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858831744:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143138.902731:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858832000 00000100:00100000:3.0:1746143138.902741:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858832000 00000100:00100000:3.0:1746143138.902787:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3502 00000100:00100000:3.0:1746143138.902794:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+214:31160:x1830962858832000:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143138.902978:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:31160:x1830962858832000:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 183us (560us total) trans 8589942482 rc 0/0 00000100:00100000:3.0:1746143138.902985:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3502 00000100:00100000:0.0:1746143138.905105:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.905145:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858832128 00000100:00100000:2.0:1746143138.905151:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858832128 00000100:00100000:2.0:1746143138.905754:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12818 00000100:00100000:2.0:1746143138.905766:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858832128:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.905783:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.905801:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e57fc00/0x25aee876ca70e393 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650cd9 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143138.905845:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861323648:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143138.905924:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.906417:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.906503:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858832256 00000100:00100000:3.0:1746143138.906508:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858832256 00000100:00100000:3.0:1746143138.906541:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12819 00000100:00100000:3.0:1746143138.906547:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858832256:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.906555:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.906564:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ce0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.906576:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.906577:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.906584:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.906596:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 20 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.906605:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529fe00, rc 0) 00000100:00100000:3.0:1746143138.906646:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858832256:12345-192.168.201.28@tcp:101:cat.0 Request processed in 99us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.906653:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12819 00000100:00100000:2.0:1746143138.909064:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861323648:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143138.909099:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e57fc00/0x25aee876ca70e393 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cd9 expref: 13 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.909114:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e57fc00/0x25aee876ca70e393 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cd9 expref: 13 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143138.909147:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e57fc00, rc 0) 00000100:00100000:2.0:1746143138.909185:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1968:x1830962858832128:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3423us (4085us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143138.909194:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12818 00000100:00100000:3.0:1746143138.912053:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1970:x1830962858831744:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 9491us (9643us total) trans 0 rc 118784/118784 00000100:00100000:3.0:1746143138.912064:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6265 00002000:00100000:3.0:1746143138.912076:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3264511) req@ffff880090f21f80 x1830962858831744/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 118784/118784 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.912093:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21f80 with x1830962858831744 ext(3145728->3264511) 00002000:00010000:3.0:1746143138.912100:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090f21f80 00000100:00100000:2.0:1746143138.922817:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858831488:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 20293us (20464us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.922831:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6264 00002000:00100000:2.0:1746143138.922845:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880090f21880 x1830962858831488/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.922856:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21880 with x1830962858831488 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.922863:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090f21880 00000100:00100000:2.0:1746143138.930083:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.930677:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858832512 00000100:00100000:0.0:1746143138.930687:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858832512 00002000:00100000:0.0:1746143138.930733:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3780608->4194303) req@ffff88009ad59880 x1830962858832512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.930743:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59880 with x1830962858832512 ext(3780608->4194303) 00002000:00010000:0.0:1746143138.930749:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad59880 00000100:00100000:0.0:1746143138.930781:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6266 00000100:00100000:0.0:1746143138.930790:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858832512:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143138.931770:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.932294:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858832768 00000100:00100000:2.0:1746143138.932300:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858832768 00002000:00100000:2.0:1746143138.932325:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a70700 x1830962858832768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.932333:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70700 with x1830962858832768 ext(3145728->4194303) 00002000:00010000:2.0:1746143138.932338:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a70700 00000100:00100000:2.0:1746143138.932350:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6267 00000100:00100000:2.0:1746143138.932355:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858832768:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143138.935304:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.935622:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858832896 00000100:00100000:3.0:1746143138.935630:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858832896 00000100:00100000:3.0:1746143138.935670:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12820 00000100:00100000:3.0:1746143138.935677:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31166:x1830962858832896:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.935695:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.935712:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ce7 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.935742:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.935750:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.935752:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143138.935755:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 13 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.935785:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 19 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.935797:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 19 pid: 4756 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.935810:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861323776:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143138.936067:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a207d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.936408:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858832512:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 5618us (6334us total) trans 0 rc 413696/413696 00000100:00100000:0.0:1746143138.936418:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6266 00002000:00100000:0.0:1746143138.936429:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3780608->4194303) req@ffff88009ad59880 x1830962858832512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 413696/413696 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143138.936444:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59880 with x1830962858832512 ext(3780608->4194303) 00010000:00010000:0.0:1746143138.936450:0:31432:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 18 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143138.936461:0:31432:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 18 pid: 4756 timeout: 1020 lvb_type: 0 00002000:00010000:0.0:1746143138.936466:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad59880 00000100:00100000:3.0:1746143138.944643:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861323776:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143138.944680:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 13 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.944700:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529f000, rc 0) 00000100:00100000:3.0:1746143138.944963:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31166:x1830962858832896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9284us (9667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.944972:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12820 00000100:00100000:2.0:1746143138.945459:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858832768:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 13102us (13689us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143138.945467:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6267 00002000:00100000:2.0:1746143138.945477:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880092a70700 x1830962858832768/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.945487:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70700 with x1830962858832768 ext(3145728->4194303) 00002000:00010000:2.0:1746143138.945492:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a70700 00000100:00100000:0.0:1746143138.946316:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.946520:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858833024 00000100:00100000:2.0:1746143138.946527:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858833024 00002000:00100000:2.0:1746143138.946559:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3264512->3780607) req@ffff880092a71500 x1830962858833024/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.946569:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71500 with x1830962858833024 ext(3264512->3780607) 00010000:00010000:2.0:1746143138.946577:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 18 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143138.946590:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 18 pid: 4756 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143138.946598:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a71500 00000100:00100000:2.0:1746143138.946613:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2040 00000100:00100000:2.0:1746143138.946619:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858833024:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143138.951412:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.951515:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858833152 00000100:00100000:3.0:1746143138.951524:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858833152 00000100:00100000:3.0:1746143138.951569:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12821 00000100:00100000:3.0:1746143138.951577:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858833152:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143138.951597:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143138.951616:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5266c00/0x25aee876ca70e3a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650cee expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.951673:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861323904:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143138.952441:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a207d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143138.958270:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858833024:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 11639us (11944us total) trans 21474840112 rc 0/0 00000100:00100000:3.0:1746143138.958284:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2040 00002000:00100000:3.0:1746143138.958297:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3264512->3780607) req@ffff880092a71500 x1830962858833024/t21474840112(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/448 e 0 to 0 dl 1746143149 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.958307:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71500 with x1830962858833024 ext(3264512->3780607) 00010000:00010000:3.0:1746143138.958318:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 22 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.958335:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 22 pid: 4756 timeout: 1020 lvb_type: 0 00002000:00010000:3.0:1746143138.958342:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a71500 00000100:00100000:3.0:1746143138.959752:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861323904:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143138.959785:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5266c00/0x25aee876ca70e3a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cee expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.959797:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5266c00/0x25aee876ca70e3a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cee expref: 21 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143138.959819:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5266c00, rc 0) 00000100:00100000:3.0:1746143138.960025:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858833152:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8448us (8627us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143138.960051:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12821 00000100:00100000:0.0:1746143138.962335:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.962408:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858833280 00000100:00100000:2.0:1746143138.962416:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858833280 00010000:00010000:2.0:1746143138.962680:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143138.963071:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6810 00000100:00100000:3.0:1746143138.963080:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858833280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143138.963095:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143138.963113:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.963164:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.963194:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c28200/0x25aee876ca70e369 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3780607) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ccb expref: 20 pid: 4756 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143138.963210:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.963213:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143138.963220:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.963228:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143138.963261:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143138.963274:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861324032:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143138.963392:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a207d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143138.964916:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.964948:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861324032:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143138.964963:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143138.964983:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858833408 00000100:00100000:2.0:1746143138.964988:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858833408 00000100:00100000:3.0:1746143138.964991:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858833280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1912us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143138.965000:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6810 00000100:00100000:2.0:1746143138.965137:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12822 00000100:00100000:2.0:1746143138.965145:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:31157:x1830962858833408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143138.965160:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143138.965173:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650cf5 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.965191:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.965192:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143138.965198:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.965211:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143138.965220:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6799a00, rc 0) 00000100:00100000:2.0:1746143138.965247:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:31157:x1830962858833408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 102us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143138.965252:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12822 00000100:00100000:0.0:1746143138.968737:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143138.968990:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858833664 00000100:00100000:3.0:1746143138.968997:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858833664 00002000:00100000:3.0:1746143138.969063:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880092a73800 x1830962858833664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.969085:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73800 with x1830962858833664 ext(4194304->5210111) 00002000:00010000:3.0:1746143138.969092:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a73800 00000100:00100000:3.0:1746143138.969111:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6268 00000100:00100000:3.0:1746143138.969119:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858833664:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143138.981255:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.981294:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143138.981318:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.981331:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858834560 00000100:00100000:0.0:1746143138.981334:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143138.981341:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858834560 00002000:00100000:2.0:1746143138.981387:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880130766a00 x1830962858834560/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.981398:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766a00 with x1830962858834560 ext(3145728->4194303) 00002000:00010000:2.0:1746143138.981405:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130766a00 00000100:00100000:2.0:1746143138.981424:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858833920 00000100:00100000:2.0:1746143138.981427:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858833920 00002000:00100000:2.0:1746143138.981442:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880130767480 x1830962858833920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.981455:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767480 with x1830962858833920 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.981459:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130767480 00000100:00100000:2.0:1746143138.981470:0:31432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858834176 00000100:00100000:2.0:1746143138.981472:0:31432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858834176 00002000:00100000:2.0:1746143138.981484:0:31432:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009535d500 x1830962858834176/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.981491:0:31432:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535d500 with x1830962858834176 ext(3145728->4194303) 00002000:00010000:2.0:1746143138.981493:0:31432:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535d500 00000100:00100000:2.0:1746143138.981509:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858834432 00000100:00100000:2.0:1746143138.981512:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858834432 00002000:00100000:2.0:1746143138.981526:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009535ca80 x1830962858834432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/0 e 0 to 0 dl 1746143149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143138.981533:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ca80 with x1830962858834432 ext(2097152->3145727) 00002000:00010000:2.0:1746143138.981535:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009535ca80 00000100:00100000:2.0:1746143138.981549:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6269 00000100:00100000:2.0:1746143138.981556:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858834560:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143138.981802:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6270 00000100:00100000:1.0:1746143138.981811:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1969:x1830962858833920:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.983349:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6271 00000100:00100000:3.0:1746143138.983360:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858834176:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143138.983773:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6272 00000100:00100000:0.0:1746143138.983782:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858834432:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143138.986674:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858833664:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17544us (17931us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143138.986687:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6268 00002000:00100000:3.0:1746143138.986699:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff880092a73800 x1830962858833664/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.986710:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73800 with x1830962858833664 ext(4194304->5210111) 00002000:00010000:3.0:1746143138.986716:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a73800 00000100:00100000:3.0:1746143138.999256:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858834560:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17687us (17997us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143138.999270:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6269 00002000:00100000:3.0:1746143138.999282:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff880130766a00 x1830962858834560/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143138.999292:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130766a00 with x1830962858834560 ext(3145728->4194303) 00002000:00010000:3.0:1746143138.999298:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130766a00 00000100:00100000:2.0:1746143139.008188:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.009412:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858834176:12345-192.168.201.28@tcp:3:cat.0 Request processed in 26049us (28086us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143139.009427:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6271 00002000:00100000:3.0:1746143139.009439:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009535d500 x1830962858834176/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143139.009449:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535d500 with x1830962858834176 ext(3145728->4194303) 00002000:00010000:3.0:1746143139.009455:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535d500 00000100:00100000:0.0:1746143139.009730:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858834944 00000100:00100000:0.0:1746143139.009738:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858834944 00000100:00080000:2.0:1746143139.009784:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143139.009794:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3503 00000100:00100000:0.0:1746143139.009801:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:31157:x1830962858834944:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:0.0:1746143139.009997:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:31157:x1830962858834944:12345-192.168.201.28@tcp:35:cat.0 Request processed in 197us (1821us total) trans 8589942483 rc 0/0 00000100:00100000:0.0:1746143139.010007:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3503 00000100:00100000:1.0:1746143139.012724:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858833920:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30906us (31420us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143139.012736:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6270 00002000:00100000:1.0:1746143139.012745:0:31430:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880130767480 x1830962858833920/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143139.012754:0:31430:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767480 with x1830962858833920 ext(2097152->3145727) 00002000:00010000:1.0:1746143139.012759:0:31430:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130767480 00000100:00100000:0.0:1746143139.016227:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.016320:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858835072 00000100:00100000:3.0:1746143139.016330:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858835072 00000100:00100000:3.0:1746143139.016388:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12823 00000100:00100000:3.0:1746143139.016397:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:31163:x1830962858835072:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143139.016414:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143139.016434:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650cfc expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.016465:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.016473:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 23 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.016478:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.016480:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.016483:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [4050944->4194303] (req 4050944->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.016510:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 23 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.016528:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 23 pid: 4756 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143139.016538:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861324160:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143139.016621:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.016629:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 26 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.016636:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861324288:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143139.016653:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a207d80 going to sleep for 11 seconds 00000100:00080000:2.0:1746143139.017060:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143139.017512:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858834432:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33729us (36174us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143139.017520:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6272 00002000:00100000:1.0:1746143139.017530:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009535ca80 x1830962858834432/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:289/0 lens 488/440 e 0 to 0 dl 1746143149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143139.017539:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535ca80 with x1830962858834432 ext(2097152->3145727) 00010000:00010000:1.0:1746143139.017545:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 22 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:1.0:1746143139.017555:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 22 pid: 4756 timeout: 1020 lvb_type: 1 00002000:00010000:1.0:1746143139.017561:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009535ca80 00000100:00100000:0.0:1746143139.018721:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.019051:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858835328 00000100:00100000:1.0:1746143139.019058:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858835328 00002000:00100000:1.0:1746143139.019115:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009535e680 x1830962858835328/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/0 e 0 to 0 dl 1746143150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143139.019134:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535e680 with x1830962858835328 ext(4194304->5210111) 00002000:00010000:1.0:1746143139.019138:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535e680 00000100:00100000:1.0:1746143139.019154:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6273 00000100:00100000:1.0:1746143139.019161:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858835328:12345-192.168.201.28@tcp:3:multiop.0 00000100:00080000:2.0:1746143139.019423:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143139.019458:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861324160:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143139.019686:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861324288:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143139.021429:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [4050944->4194303] (req 4050944->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.021448:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6798000, rc 0) 00000100:00100000:3.0:1746143139.021697:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31163:x1830962858835072:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5301us (5480us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.021706:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12823 00000100:00100000:0.0:1746143139.023708:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.023856:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.024997:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858835584 00000100:00100000:3.0:1746143139.025007:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858835584 00000100:00100000:3.0:1746143139.025053:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12824 00000100:00100000:3.0:1746143139.025059:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:31166:x1830962858835584:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143139.025075:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143139.025090:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d03 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.025114:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.025119:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [4050944->4194303] (req 4050944->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.025136:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143139.025141:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.025180:0:8449:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [4050944->4194303] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.025193:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.025204:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81d600, rc 0) 00000100:00100000:3.0:1746143139.025247:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:31166:x1830962858835584:12345-192.168.201.28@tcp:101:cat.0 Request processed in 187us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.025253:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12824 00000100:00100000:2.0:1746143139.025782:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858835456 00000100:00100000:2.0:1746143139.025793:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858835456 00010000:00010000:2.0:1746143139.025816:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 27 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.025844:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6811 00000100:00100000:2.0:1746143139.025850:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858835456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.025860:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143139.025882:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 27 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.025893:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 27 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.025924:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c29a00/0x25aee876ca70e362 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cc4 expref: 27 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.025942:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143139.026403:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858835456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 552us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.026410:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6811 00000100:00100000:1.0:1746143139.026435:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.026531:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858835712 00000100:00100000:2.0:1746143139.026534:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858835712 00010000:00010000:2.0:1746143139.026544:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 22 pid: 4756 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143139.026569:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6812 00000100:00100000:2.0:1746143139.026574:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962858835712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.026580:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143139.026589:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 22 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.026597:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 22 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.026608:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e39a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce0 expref: 22 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.026617:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.026618:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.026624:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.026632:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.026655:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.026666:0:7112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.026676:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861324544:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143139.026720:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143139.027392:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858835328:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 8230us (8672us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746143139.027399:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6273 00002000:00100000:1.0:1746143139.027406:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009535e680 x1830962858835328/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/440 e 0 to 0 dl 1746143150 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143139.027412:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535e680 with x1830962858835328 ext(4194304->5210111) 00002000:00010000:1.0:1746143139.027416:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009535e680 00000100:00100000:3.0:1746143139.027724:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861324544:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143139.027736:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143139.027756:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858835712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1182us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.027974:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6812 00000100:00100000:0.0:1746143139.028543:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.028611:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858835968 00000100:00100000:1.0:1746143139.028615:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858835968 00002000:00100000:1.0:1746143139.028644:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (4050944->4055039) req@ffff88009535d180 x1830962858835968/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/0 e 0 to 0 dl 1746143150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143139.028653:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535d180 with x1830962858835968 ext(4050944->4055039) 00010000:00010000:1.0:1746143139.028659:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:1.0:1746143139.028671:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00010000:1.0:1746143139.028683:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009535d180 00000100:00100000:1.0:1746143139.028696:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2041 00000100:00100000:1.0:1746143139.028702:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858835968:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143139.029024:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858835968:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 322us (482us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143139.029048:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2041 00002000:00100000:1.0:1746143139.029053:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (4050944->4055039) req@ffff88009535d180 x1830962858835968/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/4536 e 0 to 0 dl 1746143150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143139.029061:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009535d180 with x1830962858835968 ext(4050944->4055039) 00010000:00010000:1.0:1746143139.029066:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:1.0:1746143139.029075:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00010000:1.0:1746143139.029081:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009535d180 00000100:00100000:0.0:1746143139.031224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.031283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.031349:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858836352 00000100:00100000:2.0:1746143139.031354:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858836352 00002000:00100000:2.0:1746143139.031377:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (4050944->4194303) req@ffff88008e80d180 x1830962858836352/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/0 e 0 to 0 dl 1746143150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143139.031386:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d180 with x1830962858836352 ext(4050944->4194303) 00000100:00100000:1.0:1746143139.031623:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858836224 00000100:00100000:1.0:1746143139.031627:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858836224 00000100:00100000:1.0:1746143139.031659:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12825 00000100:00100000:1.0:1746143139.031665:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31163:x1830962858836224:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143139.031677:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143139.031691:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d0a expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.031719:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 14 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.031727:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.031732:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143139.031733:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143139.031736:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4788223] (req 4194304->4788223) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 14 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.031760:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.031768:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 19 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:1.0:1746143139.031777:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861324672:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143139.031839:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 14 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.031847:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 14 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:1.0:1746143139.031856:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861324800:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.031876:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143139.033285:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861324672:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.033300:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861324800:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143139.033322:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [4194304->4788223] (req 4194304->4788223) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 14 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.033333:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef5ea00, rc 0) 00010000:00010000:2.0:1746143139.033436:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.033447:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143139.033454:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e80d180 00000100:00100000:1.0:1746143139.033534:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31163:x1830962858836224:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1867us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143139.033541:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12825 00000100:00100000:2.0:1746143139.033584:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2042 00000100:00100000:2.0:1746143139.033593:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858836352:12345-192.168.201.28@tcp:4:multiop.0 00000100:00100000:0.0:1746143139.038992:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.039315:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858836480 00000100:00100000:3.0:1746143139.039325:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858836480 00010000:00010000:3.0:1746143139.039366:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 14 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.039406:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6813 00000100:00100000:3.0:1746143139.039413:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858836480:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.039986:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.040020:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 14 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.040063:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 14 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.040084:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e3a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ce7 expref: 14 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.040108:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143139.040163:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1968:x1830962858836480:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 749us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.040172:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6813 00000100:00100000:0.0:1746143139.041057:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.041274:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858836608 00000100:00100000:3.0:1746143139.041279:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858836608 00010000:00010000:3.0:1746143139.041301:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 20 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.041325:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6814 00000100:00100000:3.0:1746143139.041331:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858836608:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.041341:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.041356:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 20 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.041367:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 20 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.041385:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6799a00/0x25aee876ca70e3af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cf5 expref: 20 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.041398:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.041400:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.041407:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 12 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.041415:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 12 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.041445:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 12 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143139.041680:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861324928:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143139.042549:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858836352:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 8956us (11262us total) trans 17179872851 rc 0/0 00000100:00100000:2.0:1746143139.042559:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2042 00002000:00100000:2.0:1746143139.042569:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (4050944->4194303) req@ffff88008e80d180 x1830962858836352/t17179872851(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/448 e 0 to 0 dl 1746143150 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143139.042578:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e80d180 with x1830962858836352 ext(4050944->4194303) 00010000:00010000:2.0:1746143139.042586:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 23 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.042598:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 23 pid: 8449 timeout: 1020 lvb_type: 0 00002000:00010000:2.0:1746143139.042605:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e80d180 00000100:00100000:3.0:1746143139.042962:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a207d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143139.045299:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7112:1830962861324928:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143139.045315:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143139.045414:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858836608:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4082us (4358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.045423:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6814 00000100:00100000:0.0:1746143139.046001:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.046180:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858836736 00000100:00100000:3.0:1746143139.046186:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858836736 00010000:00010000:3.0:1746143139.046214:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 23 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.046236:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6815 00000100:00100000:3.0:1746143139.046242:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1969:x1830962858836736:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.046254:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.046274:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 23 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.046285:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 23 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.046306:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6798000/0x25aee876ca70e3b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cfc expref: 23 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.046319:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.046320:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.046326:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.046339:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.046366:0:7112:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143139.046378:0:7112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861325056:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143139.046435:0:7112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a207d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143139.048267:0:7112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7112:1830962861325056:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143139.048280:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143139.048686:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858836736:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2441us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.048694:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6815 00000100:00100000:0.0:1746143139.051347:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.051397:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.051567:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858836992 00000100:00100000:2.0:1746143139.051575:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858836992 00002000:00100000:2.0:1746143139.051620:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88012b802300 x1830962858836992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/0 e 0 to 0 dl 1746143150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143139.051629:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802300 with x1830962858836992 ext(3145728->4194303) 00002000:00010000:2.0:1746143139.051635:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b802300 00000100:00100000:2.0:1746143139.051660:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858837248 00000100:00100000:2.0:1746143139.051663:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858837248 00002000:00100000:2.0:1746143139.051677:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4784128->4788223) req@ffff88012b803480 x1830962858837248/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/0 e 0 to 0 dl 1746143150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143139.051684:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803480 with x1830962858837248 ext(4784128->4788223) 00002000:00010000:2.0:1746143139.051687:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b803480 00000100:00100000:2.0:1746143139.051699:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6274 00000100:00100000:2.0:1746143139.051706:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858836992:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143139.053752:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6275 00000100:00100000:2.0:1746143139.053762:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858837248:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143139.053869:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858837248:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 108us (2471us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143139.053876:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6275 00002000:00100000:2.0:1746143139.053882:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4784128->4788223) req@ffff88012b803480 x1830962858837248/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/4536 e 0 to 0 dl 1746143150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143139.053890:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b803480 with x1830962858837248 ext(4784128->4788223) 00002000:00010000:2.0:1746143139.053894:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b803480 00000100:00100000:2.0:1746143139.061417:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858836992:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 9703us (10071us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143139.061430:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6274 00002000:00100000:2.0:1746143139.061441:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88012b802300 x1830962858836992/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/440 e 0 to 0 dl 1746143150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143139.061450:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b802300 with x1830962858836992 ext(3145728->4194303) 00002000:00010000:2.0:1746143139.061455:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b802300 00000100:00100000:0.0:1746143139.068267:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.068604:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858837504 00000100:00100000:2.0:1746143139.068613:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858837504 00002000:00100000:2.0:1746143139.068664:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4788224->5210111) req@ffff88012b801500 x1830962858837504/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/0 e 0 to 0 dl 1746143150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143139.068675:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801500 with x1830962858837504 ext(4788224->5210111) 00002000:00010000:2.0:1746143139.068681:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b801500 00000100:00100000:2.0:1746143139.068718:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6276 00000100:00100000:2.0:1746143139.068725:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858837504:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143139.071963:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858837504:12345-192.168.201.28@tcp:3:cat.0 Request processed in 3228us (3696us total) trans 0 rc 421888/421888 00000100:00100000:2.0:1746143139.071975:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6276 00002000:00100000:2.0:1746143139.071985:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4788224->5210111) req@ffff88012b801500 x1830962858837504/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/440 e 0 to 0 dl 1746143150 ref 1 fl Complete:/200/0 rc 421888/421888 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143139.071995:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b801500 with x1830962858837504 ext(4788224->5210111) 00002000:00010000:2.0:1746143139.072001:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b801500 00000100:00100000:0.0:1746143139.085546:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.085773:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858837632 00000100:00100000:2.0:1746143139.085786:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858837632 00000100:00080000:0.0:1746143139.085864:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143139.085906:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8256 00000100:00100000:2.0:1746143139.085914:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:31170:x1830962858837632:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.085936:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.085952:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70e3cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d11 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.086009:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.086020:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.086067:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.086081:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.086086:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.086091:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.086192:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.086476:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 28 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.086482:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.086509:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 28 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.086524:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 28 pid: 14795 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.086535:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861325184:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143139.086779:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143139.089101:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.089197:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858837888 00000100:00100000:1.0:1746143139.089206:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858837888 00000100:00100000:2.0:1746143139.089885:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861325184:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.089910:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00080000:0.0:1746143139.090082:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143139.090176:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3504 00000100:00100000:3.0:1746143139.090190:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:26839:x1830962858837888:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143139.090483:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:26839:x1830962858837888:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 297us (1389us total) trans 8589942484 rc 0/0 00000100:00100000:3.0:1746143139.090489:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3504 00000100:00100000:0.0:1746143139.091648:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.091695:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858838016 00000100:00100000:3.0:1746143139.091700:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858838016 00010000:00010000:3.0:1746143139.091725:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 30 pid: 14795 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.091747:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6816 00000100:00100000:3.0:1746143139.091754:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858838016:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.091764:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.091770:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 30 pid: 14795 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.091781:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 30 pid: 14795 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.091802:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093455c00/0x25aee876ca70e2a5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c62 expref: 30 pid: 14795 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.091815:0:7112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143139.091819:0:7112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143139.091828:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143139.091835:0:7112:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143139.091889:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143139.091927:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1968:x1830962858838016:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 172us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.091933:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6816 00010000:00010000:2.0:1746143139.091981:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.091988:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143139.092021:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143139.092026:0:14794:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143139.092059:0:14794:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092068:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092078:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092083:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092089:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092095:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe2a400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143139.092098:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092104:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092112:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143139.092115:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143139.092118:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092134:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a400/0x25aee876ca70e3d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092147:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092151:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092156:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092160:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe2b600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143139.092162:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092167:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092172:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449b00) 00010000:00010000:2.0:1746143139.092174:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143139.092177:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092181:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b600/0x25aee876ca70e3d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.092210:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2a000/0x25aee876ca70e3cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.092221:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.092458:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143139.092461:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143139.092463:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2b800, rc 0) 00000100:00100000:2.0:1746143139.092533:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:31170:x1830962858837632:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 6618us (6994us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.092539:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8256 00000100:00100000:0.0:1746143139.095260:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.095286:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.095606:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858838144 00000100:00100000:0.0:1746143139.095611:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.095614:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858838144 00000100:00080000:0.0:1746143139.095645:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143139.095661:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.095861:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858838400 00000100:00100000:1.0:1746143139.095864:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858838400 00000100:00100000:2.0:1746143139.095951:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858838272 00000100:00100000:2.0:1746143139.095954:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858838272 00000100:00100000:2.0:1746143139.095970:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858838528 00000100:00100000:2.0:1746143139.095972:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858838528 00000100:00100000:2.0:1746143139.095983:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12826 00000100:00100000:2.0:1746143139.095989:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858838144:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.096006:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.096021:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d18 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.096068:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.096070:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143139.096258:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12827 00000100:00100000:3.0:1746143139.096265:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858838400:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143139.096273:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143139.096283:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d26 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.096297:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.096298:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.096306:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.096319:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.096328:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81d800, rc 0) 00000100:00100000:3.0:1746143139.096361:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858838400:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 97us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.096552:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12827 00000100:00100000:3.0:1746143139.096565:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12828 00000100:00100000:3.0:1746143139.096569:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858838272:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143139.096574:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143139.096578:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d1f expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.096585:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.096586:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.096589:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.096594:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.096602:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81de00, rc 0) 00000100:00100000:3.0:1746143139.096613:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858838272:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 44us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.096616:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12828 00000100:00100000:3.0:1746143139.096622:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12829 00000100:00100000:3.0:1746143139.096625:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858838528:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143139.096628:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143139.096632:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d2d expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.096638:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.096639:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.096642:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.096648:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.096651:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e81c000, rc 0) 00000100:00100000:3.0:1746143139.096658:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858838528:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 32us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.096660:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12829 00010000:00010000:2.0:1746143139.096699:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.096707:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.096711:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2ac00, rc 0) 00000100:00100000:2.0:1746143139.096722:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858838144:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 735us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.096726:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12826 00000100:00080000:1.0:1746143139.096807:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143139.096983:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.097050:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858838656 00000100:00100000:2.0:1746143139.097053:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858838656 00000100:00100000:2.0:1746143139.097072:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12830 00000100:00100000:2.0:1746143139.097077:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858838656:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.097083:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.097090:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe2bc00/0x25aee876ca70e403 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d34 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143139.097140:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861325312:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143139.097202:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143139.097812:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.099302:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858838784 00000100:00100000:2.0:1746143139.099309:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858838784 00000100:00100000:2.0:1746143139.099342:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12831 00000100:00100000:2.0:1746143139.099348:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858838784:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.099361:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.099373:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d3b expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.099395:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.099396:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.099402:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 8 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.099412:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 8 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.099419:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2a200, rc 0) 00000100:00100000:2.0:1746143139.099450:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858838784:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 102us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.099456:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12831 00000100:00100000:2.0:1746143139.099612:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861325312:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143139.099635:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe2bc00/0x25aee876ca70e403 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d34 expref: 8 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.099644:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe2bc00/0x25aee876ca70e403 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d34 expref: 8 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.099656:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2bc00, rc 0) 00000100:00100000:2.0:1746143139.099673:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858838656:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 2596us (2758us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143139.099679:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12830 00000100:00100000:0.0:1746143139.101186:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.101270:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858839040 00000100:00100000:2.0:1746143139.101277:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858839040 00000100:00100000:2.0:1746143139.101358:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8257 00000100:00100000:2.0:1746143139.101365:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:31170:x1830962858839040:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.101380:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.101408:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2aa00/0x25aee876ca70e411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d42 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.101705:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.101716:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.101720:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.101742:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.101750:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 14 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.101758:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861325440:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143139.102160:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143139.104025:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861325440:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.104195:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:0.0:1746143139.104289:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.104375:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858839168 00000100:00100000:2.0:1746143139.104380:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858839168 00010000:00010000:2.0:1746143139.104406:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 15 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.104468:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6817 00000100:00100000:2.0:1746143139.104476:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:1968:x1830962858839168:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.104488:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143139.104493:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 15 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.104503:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 15 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.104521:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b800/0x25aee876ca70e3e0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d11 expref: 15 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.104534:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143139.104538:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.104545:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.104551:0:4759:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.104690:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143139.104724:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858839168:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 249us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.104928:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6817 00010000:00010000:0.0:1746143139.104973:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.104979:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:0.0:1746143139.104997:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:0.0:1746143139.105181:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2aa00/0x25aee876ca70e411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d42 expref: 15 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.105206:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d42 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.105370:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143139.105373:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143139.105375:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2b400, rc 0) 00000100:00100000:0.0:1746143139.105405:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:31170:x1830962858839040:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 4041us (4225us total) trans 8589942485 rc 0/0 00000100:00100000:0.0:1746143139.105411:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8257 00000100:00100000:0.0:1746143139.107150:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.107229:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858839424 00000100:00100000:2.0:1746143139.107235:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858839424 00000100:00100000:2.0:1746143139.107277:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8258 00000100:00100000:2.0:1746143139.107284:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:31170:x1830962858839424:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.107304:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.107306:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143139.107323:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b400/0x25aee876ca70e418 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d42 expref: 14 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.107334:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143139.107338:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143139.107347:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70e426 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d49 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.107419:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b200/0x25aee876ca70e42d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.107429:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b200/0x25aee876ca70e42d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.107437:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b200/0x25aee876ca70e42d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143139.107446:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143139.107527:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2ae00/0x25aee876ca70e426 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d49 expref: 16 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.107538:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b200/0x25aee876ca70e42d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d49 expref: 15 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.107544:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143139.107546:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143139.107548:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe2b200, rc 0) 00000100:00100000:2.0:1746143139.107587:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:31170:x1830962858839424:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 304us (441us total) trans 8589942486 rc 0/0 00000100:00100000:2.0:1746143139.107593:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8258 00000100:00100000:0.0:1746143139.109689:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.109744:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858839552 00000100:00100000:1.0:1746143139.109750:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858839552 00000100:00100000:1.0:1746143139.109797:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8259 00000100:00100000:1.0:1746143139.109804:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+15:31170:x1830962858839552:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143139.109822:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143139.109834:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef5f400/0x25aee876ca70e43b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d50 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.109878:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef5f400/0x25aee876ca70e43b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d50 expref: 16 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.109895:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef5f400/0x25aee876ca70e43b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d50 expref: 16 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.109911:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143139.109914:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143139.109916:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef5f400, rc 0) 00000100:00100000:1.0:1746143139.109961:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:31170:x1830962858839552:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 158us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143139.109967:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8259 00000100:00100000:0.0:1746143139.112454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.112484:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.112506:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858839680 00000100:00100000:0.0:1746143139.112508:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.112513:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858839680 00000100:00100000:0.0:1746143139.112535:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.112552:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858839808 00000100:00100000:0.0:1746143139.112552:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858839936 00000100:00100000:2.0:1746143139.112554:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858839808 00000100:00100000:0.0:1746143139.112555:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858839936 00000100:00100000:2.0:1746143139.112567:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858840064 00000100:00100000:2.0:1746143139.112569:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858840064 00000100:00100000:0.0:1746143139.112574:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12832 00000100:00100000:2.0:1746143139.112636:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12833 00000100:00100000:2.0:1746143139.112643:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858839808:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143139.112685:0:8169:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.112702:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 21 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143139.112710:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12834 00010000:00010000:2.0:1746143139.112711:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 9 pid: 8449 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143139.112717:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858839936:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143139.112723:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.112729:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.112731:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.112734:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.112736:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.112747:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.112754:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 9 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143139.112761:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143139.112765:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143139.112766:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.112769:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143139.112769:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.112780:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 25 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:1.0:1746143139.112784:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143139.112791:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 25 pid: 8450 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143139.112792:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861325568:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.112799:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861325696:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143139.112826:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858839680:12345-192.168.201.28@tcp:1:mirror_io.0 00000100:00100000:3.0:1746143139.112830:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12835 00000100:00100000:3.0:1746143139.112838:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858840064:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143139.112849:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.112858:0:26949:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.112860:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 18 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.112867:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.112868:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.112874:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.112874:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.112880:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.112881:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 12 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.112881:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.112883:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.112886:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.112887:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.112889:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.112906:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 12 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.112906:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.112914:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 12 pid: 21048 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143139.112914:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 12 pid: 8450 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143139.112923:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861325824:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143139.112923:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861325952:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143139.113236:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 9 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143139.113237:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.113237:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 9 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143139.113244:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 9 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.113246:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 9 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.113250:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 8 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:1.0:1746143139.113253:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861326080:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143139.113254:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861326336:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143139.113257:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861326208:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.113278:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 21 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.113283:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.113284:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 18 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.113286:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 21 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:1.0:1746143139.113291:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 21 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.113292:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 18 pid: 22204 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143139.113293:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861326464:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143139.113298:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861326720:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.113298:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861326592:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143139.113308:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143139.113309:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143139.113313:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeeb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746143139.114232:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.114245:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 8 pid: 4756 timeout: 1020 lvb_type: 1 00000100:00100000:0.0:1746143139.114253:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861326848:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143139.114289:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 18 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.114296:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 18 pid: 4756 timeout: 1020 lvb_type: 1 00000100:00100000:0.0:1746143139.114302:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861326976:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143139.114314:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093e40840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143139.114830:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.115157:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.115174:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858840320 00000100:00100000:1.0:1746143139.115174:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858840192 00000100:00100000:3.0:1746143139.115180:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858840320 00000100:00100000:1.0:1746143139.115180:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858840192 00000100:00100000:1.0:1746143139.115213:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12836 00000100:00100000:3.0:1746143139.115219:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12837 00000100:00100000:1.0:1746143139.115219:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858840192:12345-192.168.201.28@tcp:1:mirror_io.0 00000100:00100000:3.0:1746143139.115225:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858840320:12345-192.168.201.28@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143139.115242:0:8448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.115242:0:22204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.115253:0:22204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 12 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.115254:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.115259:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143139.115260:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143139.115261:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 10 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143139.115262:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.115270:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.115272:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.115274:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.115282:0:22204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 12 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.115290:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 10 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143139.115291:0:22204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 12 pid: 8448 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.115297:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 10 pid: 8448 timeout: 1020 lvb_type: 1 00000100:00100000:1.0:1746143139.115301:0:22204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861327104:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143139.115311:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861327232:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.115342:0:22204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143139.115360:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.115368:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.115376:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861327360:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143139.115392:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143139.116358:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861325696:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.116819:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861325952:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143139.116853:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861325568:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143139.116864:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861326336:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143139.116952:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861325824:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.117250:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861326592:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.126344:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861326848:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.126359:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1830962861326976:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143139.126387:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143139.126571:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009194ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4758:1830962861326080:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.126601:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143139.126684:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.126702:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.126718:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.126723:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861326208:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143139.126731:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.126733:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26949:1830962861326720:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143139.126750:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858840448 00000100:00100000:0.0:1746143139.126756:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858840448 00010000:00010000:3.0:1746143139.126757:0:26949:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143139.126776:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858840576 00000100:00100000:3.0:1746143139.126779:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858840576 00010000:00010000:0.0:1746143139.126787:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 26 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.126795:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 11 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:0.0:1746143139.126809:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858840832 00000100:00100000:0.0:1746143139.126811:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858840832 00000100:00100000:3.0:1746143139.126817:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858841088 00000100:00100000:3.0:1746143139.126820:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858841088 00010000:00010000:0.0:1746143139.126820:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 10 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.126831:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 12 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:0.0:1746143139.126832:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6818 00000100:00100000:0.0:1746143139.127155:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858840448:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143139.127168:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143139.127176:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6819 00000100:00100000:3.0:1746143139.127182:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1971:x1830962858840576:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.127191:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143139.127191:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 26 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143139.127202:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 26 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.127203:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 12 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.127212:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 12 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:0.0:1746143139.127225:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e2f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c8c expref: 26 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.127226:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e81de00/0x25aee876ca70e3f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d1f expref: 12 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.127244:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143139.127244:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143139.127277:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6820 00000100:00100000:3.0:1746143139.127279:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+11:1971:x1830962858840576:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 97us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.127285:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6819 00000100:00100000:2.0:1746143139.127286:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858840832:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.127294:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143139.127301:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6821 00000100:00100000:3.0:1746143139.127306:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858841088:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.127308:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 10 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.127312:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143139.127317:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 10 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.127318:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 10 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.127326:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 10 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.127330:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe2ac00/0x25aee876ca70e3e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d18 expref: 10 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.127336:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e81d800/0x25aee876ca70e3ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d26 expref: 10 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.127342:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143139.127343:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143139.127654:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858840832:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 369us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.127663:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858841088:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 355us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.127663:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6820 00000100:00100000:3.0:1746143139.127669:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6821 00000100:00100000:2.0:1746143139.127693:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861326464:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143139.127704:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143139.127712:0:8169:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143139.127743:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.127764:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.127813:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.127820:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858841344 00000100:00100000:2.0:1746143139.127823:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858841344 00010000:00010000:2.0:1746143139.127836:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 19 pid: 22204 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143139.127845:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858840704 00000100:00100000:2.0:1746143139.127847:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858840704 00000100:00100000:3.0:1746143139.127854:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861327232:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.127856:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 13 pid: 21048 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143139.128048:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858840960 00000100:00100000:2.0:1746143139.128049:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858841216 00000100:00100000:3.0:1746143139.128052:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858840960 00000100:00100000:2.0:1746143139.128052:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858841216 00010000:00010000:2.0:1746143139.128061:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 9 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.128064:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 20 pid: 4756 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143139.128071:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6822 00000100:00100000:2.0:1746143139.128075:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858841344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.128083:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143139.128092:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 20 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.128100:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 20 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.128113:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5df5a00/0x25aee876ca70e1e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bcf expref: 20 pid: 22204 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.128137:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143139.128156:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858841344:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 80us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.128192:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858840448:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1039us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.128372:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6823 00000100:00100000:3.0:1746143139.128379:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1969:x1830962858840704:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.128385:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.128466:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 13 pid: 21048 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.128474:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 13 pid: 21048 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.128485:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecf8200/0x25aee876ca70e1fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bf9 expref: 13 pid: 21048 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.128493:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143139.128507:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858840704:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 129us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.128512:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6823 00000100:00100000:3.0:1746143139.128521:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6824 00000100:00100000:3.0:1746143139.128525:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858841216:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.128530:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.128535:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 9 pid: 8449 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.128542:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 9 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143139.128547:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6822 00010000:00010000:3.0:1746143139.128550:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81c000/0x25aee876ca70e3fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d2d expref: 9 pid: 8449 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143139.128560:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6825 00010000:00010000:3.0:1746143139.128561:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.128563:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143139.128565:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858840960:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.128567:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.128573:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.128574:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.128580:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 18 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.128588:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143139.128588:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 18 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.128597:0:26949:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.128602:0:26949:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.128611:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3df600/0x25aee876ca70e1cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650bba expref: 18 pid: 4756 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.128619:0:26949:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.128619:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143139.128632:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858840960:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 68us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.128638:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6825 00000100:00100000:2.0:1746143139.128691:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.128700:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858841472 00000100:00100000:2.0:1746143139.128703:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858841472 00010000:00010000:2.0:1746143139.128712:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 26 pid: 8450 timeout: 1020 lvb_type: 1 00000100:00100000:2.0:1746143139.128728:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6826 00000100:00100000:2.0:1746143139.128733:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858841472:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.128739:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143139.128747:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 26 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.128755:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 26 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.128765:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e2eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c85 expref: 26 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.128773:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143139.128784:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858841472:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 51us (93us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143139.128789:0:26949:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143139.128790:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6826 00010000:00010000:3.0:1746143139.128797:0:26949:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.128803:0:26949:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e81ca00 already unused, calling callback (ffffffffa0868d70) 00000100:00100000:1.0:1746143139.128806:0:22204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22204:1830962861327104:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143139.128807:0:26949:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.128819:0:26949:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143139.128821:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143139.128821:0:22204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.128828:0:26949:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.128832:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e81ca00/0x25aee876ca70e457 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143139.128839:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.128852:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858841856 00000100:00100000:2.0:1746143139.128855:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.128864:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858841728 00000100:00100000:2.0:1746143139.128866:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858841728 00000100:00100000:3.0:1746143139.128870:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858840064:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 16033us (16333us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143139.128875:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 9 pid: 8448 timeout: 1020 lvb_type: 1 00000100:00100000:3.0:1746143139.128877:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12835 00000100:00100000:2.0:1746143139.128887:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6827 00000100:00100000:2.0:1746143139.128891:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858841728:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.128897:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143139.128902:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1830962861327360:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.128906:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 9 pid: 8448 timeout: 1020 lvb_type: 1 00010000:00010000:2.0:1746143139.128913:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 9 pid: 8448 timeout: 1020 lvb_type: 1 00000100:00100000:0.0:1746143139.129026:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6818 00000100:00100000:0.0:1746143139.129104:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.129115:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858841984 00000100:00100000:0.0:1746143139.129118:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858841984 00010000:00010000:0.0:1746143139.129139:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 22 pid: 8450 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143139.129152:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6828 00000100:00100000:0.0:1746143139.129157:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962858841984:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143139.129163:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143139.129170:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 22 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.129178:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 22 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.129190:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a529e600/0x25aee876ca70e2ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c70 expref: 22 pid: 8450 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.129201:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.129202:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.129205:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129212:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129223:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143139.129236:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858841984:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.129240:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6828 00000100:00100000:0.0:1746143139.129281:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.129289:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858842112 00000100:00100000:0.0:1746143139.129292:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858842112 00010000:00010000:0.0:1746143139.129300:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 21 pid: 26949 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143139.129316:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6829 00000100:00100000:0.0:1746143139.129320:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858842112:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143139.129325:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143139.129331:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 21 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.129339:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 21 pid: 26949 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.129349:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c475800/0x25aee876ca70e282 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c46 expref: 21 pid: 26949 timeout: 1020 lvb_type: 0 00000100:00100000:1.0:1746143139.129465:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858841856 00010000:00010000:1.0:1746143139.129480:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 21 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:1.0:1746143139.129494:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6830 00000100:00100000:1.0:1746143139.129498:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858841856:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143139.129505:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143139.129567:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.129569:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.129572:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129580:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129593:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143139.129606:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1969:x1830962858842112:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 285us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.129611:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6829 00010000:00010000:0.0:1746143139.129625:0:8169:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129632:0:8169:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129646:0:8169:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129651:0:8169:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129760:0:8169:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129767:0:8169:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe2b600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143139.129770:0:8169:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129779:0:8169:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129788:0:8169:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129794:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2b600/0x25aee876ca70e442 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143139.129825:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858839808:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 17184us (17341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.129833:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12833 00010000:00010000:3.0:1746143139.129845:0:8448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.129852:0:16965:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe2a200/0x25aee876ca70e40a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d3b expref: 8 pid: 8448 timeout: 1020 lvb_type: 1 00010000:00010000:1.0:1746143139.129854:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 20 pid: 8449 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.129861:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143139.129863:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 20 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143139.129865:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.129871:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858841216:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1344us (2057us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143139.129874:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e81d600/0x25aee876ca70e3bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d03 expref: 20 pid: 8449 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.129877:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6824 00000100:00100000:2.0:1746143139.129877:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858841728:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 985us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.129877:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858842240 00000100:00100000:0.0:1746143139.129880:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858842240 00010000:00010000:1.0:1746143139.129888:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143139.129890:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.129890:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 12 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:1.0:1746143139.129893:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.129899:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143139.129902:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6831 00000100:00100000:0.0:1746143139.129906:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1969:x1830962858842240:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143139.129912:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143139.129912:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.129915:0:8448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129919:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 12 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.129921:0:8448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129927:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 12 pid: 8450 timeout: 1020 lvb_type: 1 00000100:00100000:1.0:1746143139.129929:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858841856:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 430us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143139.129935:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6830 00010000:00010000:0.0:1746143139.129936:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3dea00/0x25aee876ca70e212 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650be4 expref: 12 pid: 8450 timeout: 1020 lvb_type: 1 00010000:00010000:3.0:1746143139.129939:0:8448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129942:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.129944:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143139.129945:0:8448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129947:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.129951:0:8448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129952:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.129957:0:8448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6799800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143139.129959:0:8448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143139.129959:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6827 00010000:00010000:3.0:1746143139.129965:0:8448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.129975:0:8448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.129978:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143139.129980:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6799800/0x25aee876ca70e465 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.129980:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143139.129985:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143139.129990:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1969:x1830962858842240:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 82us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.129995:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6831 00010000:00010000:1.0:1746143139.129996:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.129998:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.130003:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.130003:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143139.130008:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858840320:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 14783us (14851us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.130014:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12837 00010000:00010000:2.0:1746143139.130014:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.130015:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.130019:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ef5ee00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143139.130020:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.130021:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.130026:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.130026:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.130046:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b5d5e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143139.130047:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.130048:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.130052:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef5ee00/0x25aee876ca70e449 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.130057:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143139.130062:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858841600 00010000:00010000:1.0:1746143139.130065:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143139.130067:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858841600 00010000:00010000:1.0:1746143139.130070:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e450 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143139.130076:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858839936:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 17360us (17567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.130081:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12834 00002000:00100000:3.0:1746143139.130094:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4788223) req@ffff88009ad59c00 x1830962858841600/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/0 e 0 to 0 dl 1746143150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143139.130097:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858839680:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 17516us (17651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143139.130102:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12832 00002000:00100000:3.0:1746143139.130103:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59c00 with x1830962858841600 ext(4194304->4788223) 00010000:00010000:3.0:1746143139.130109:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 11 pid: 8448 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.130130:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 11 pid: 8448 timeout: 1020 lvb_type: 0 00002000:00010000:3.0:1746143139.130136:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad59c00 00000100:00100000:3.0:1746143139.130160:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2043 00000100:00100000:3.0:1746143139.130165:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858841600:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143139.141842:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858841600:12345-192.168.201.28@tcp:4:cat.0 Request processed in 11664us (13007us total) trans 21474840113 rc 0/0 00000100:00100000:3.0:1746143139.141855:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2043 00002000:00100000:3.0:1746143139.141867:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->4788223) req@ffff88009ad59c00 x1830962858841600/t21474840113(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:290/0 lens 488/448 e 0 to 0 dl 1746143150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143139.141877:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad59c00 with x1830962858841600 ext(4194304->4788223) 00010000:00010000:3.0:1746143139.141888:0:21568:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 13 pid: 8448 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.141903:0:21568:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 13 pid: 8448 timeout: 1020 lvb_type: 0 00002000:00010000:3.0:1746143139.141910:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad59c00 00000100:00100000:2.0:1746143139.147280:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.147482:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858842368 00000100:00100000:0.0:1746143139.147493:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858842368 00010000:00010000:0.0:1746143139.147526:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 13 pid: 8448 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143139.147566:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6832 00000100:00100000:0.0:1746143139.147573:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1970:x1830962858842368:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143139.147586:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143139.147608:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 13 pid: 8448 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.147619:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 13 pid: 8448 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.147639:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ef5ea00/0x25aee876ca70e3c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d0a expref: 13 pid: 8448 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.147656:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.147657:0:7113:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.147662:0:7113:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.147676:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143139.147708:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143139.147735:0:22204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.147745:0:22204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143139.147747:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1970:x1830962858842368:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 174us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.147755:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6832 00010000:00010000:1.0:1746143139.147772:0:22204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.147780:0:22204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.147788:0:22204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.147800:0:22204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093455c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143139.147804:0:22204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.148015:0:22204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.148058:0:22204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.148065:0:22204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093455c00/0x25aee876ca70e45e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143139.148137:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1969:x1830962858840192:12345-192.168.201.28@tcp:1:mirror_io.0 Request processed in 32917us (33305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143139.148146:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12836 00000100:00100000:0.0:1746143139.154574:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.154661:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858842624 00000100:00100000:2.0:1746143139.154671:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858842624 00000100:00100000:2.0:1746143139.154769:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8260 00000100:00100000:2.0:1746143139.154779:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+16:31170:x1830962858842624:12345-192.168.201.28@tcp:36:mirror_io.0 00010000:00010000:2.0:1746143139.154925:0:14794:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143139.154954:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef5f400/0x25aee876ca70e43b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d50 expref: 16 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.154976:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143139.154980:0:14794:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143139.155010:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.155020:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 215 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155027:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 28 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155055:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 28 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155061:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 215 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155067:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 28 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155074:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 8/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.155103:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 28 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155113:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 28 pid: 14795 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.155137:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad58700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861327488:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.155229:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 215 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155237:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 215 pid: 14795 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.155244:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861327616:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.155266:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 28 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155273:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 28 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.155280:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861327744:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.155297:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 28 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155303:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 28 pid: 17079 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.155309:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861327872:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.155328:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 215 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143139.155339:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 215 pid: 14796 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.155346:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861328000:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143139.155360:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a97d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143139.156371:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad58700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861327488:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143139.158162:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861327616:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143139.158226:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.158267:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.158286:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858842752 00000100:00100000:0.0:1746143139.158293:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858842752 00000100:00100000:1.0:1746143139.158303:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143139.158327:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 29 pid: 14795 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143139.158350:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858842880 00000100:00100000:0.0:1746143139.158353:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858842880 00010000:00010000:0.0:1746143139.158362:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 216 pid: 14795 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.158432:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6833 00000100:00100000:3.0:1746143139.158440:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+29:1969:x1830962858842752:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.158453:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.158459:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 29 pid: 14795 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.158469:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 29 pid: 14795 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.158488:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e354 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650cbd expref: 29 pid: 14795 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.158505:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143139.158510:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143139.158517:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143139.158554:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1969:x1830962858842752:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.158561:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6833 00000100:00100000:0.0:1746143139.158572:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6834 00000100:00100000:0.0:1746143139.158579:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+216:1971:x1830962858842880:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143139.158585:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858843136 00000100:00100000:3.0:1746143139.158588:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858843136 00010000:00010000:0.0:1746143139.158588:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143139.158592:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 216 pid: 14795 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.158601:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 216 pid: 14795 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.158608:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3505 00000100:00100000:3.0:1746143139.158613:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:30386:x1830962858843136:12345-192.168.201.28@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746143139.158623:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136034600/0x25aee876ca70e2dd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c7e expref: 216 pid: 14795 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.158638:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143139.158642:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.158648:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143139.158672:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:1971:x1830962858842880:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 94us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.158677:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6834 00000100:00100000:0.0:1746143139.159201:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.159633:0:16965:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858843392 00000100:00100000:2.0:1746143139.159637:0:16965:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858843392 00010000:00010000:2.0:1746143139.159655:0:16965:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 215 pid: 14796 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143139.159660:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.159673:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858843264 00000100:00100000:2.0:1746143139.159676:0:16965:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6835 00000100:00100000:0.0:1746143139.159676:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858843264 00000100:00100000:2.0:1746143139.159682:0:16965:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:1968:x1830962858843392:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143139.159687:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 30 pid: 17079 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.159689:0:16965:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143139.159693:0:16965:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 215 pid: 14796 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.159700:0:16965:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 215 pid: 14796 timeout: 1020 lvb_type: 0 00000100:00100000:0.0:1746143139.159700:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6836 00000100:00100000:0.0:1746143139.159704:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858843264:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143139.159711:0:16965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143139.159711:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143139.159714:0:7113:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 30 pid: 17079 timeout: 1020 lvb_type: 0 00010000:00010000:2.0:1746143139.159715:0:16965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.159720:0:16965:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143139.159722:0:7113:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 30 pid: 17079 timeout: 1020 lvb_type: 0 00010000:00010000:0.0:1746143139.159737:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00000100:00100000:2.0:1746143139.159740:0:16965:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+215:1968:x1830962858843392:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 58us (540us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143139.159741:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.159745:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143139.159746:0:16965:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6835 00000100:00100000:0.0:1746143139.159945:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858843264:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 239us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.159950:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6836 00000100:00100000:2.0:1746143139.159960:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861327744:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.159970:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ee00/0x25aee876ca70de1b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509ad expref: 29 pid: 17079 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.159982:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861327872:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.159990:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093db5400/0x25aee876ca70de14 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c16509a6 expref: 214 pid: 14796 timeout: 1020 lvb_type: 0 00000100:00100000:2.0:1746143139.159998:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861328000:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143139.160022:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143139.161231:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:30386:x1830962858843136:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 2614us (2924us total) trans 8589942487 rc 0/0 00000100:00100000:3.0:1746143139.161239:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3505 00000100:00100000:2.0:1746143139.164359:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.164553:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858843520 00000100:00100000:3.0:1746143139.164561:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858843520 00010000:00010000:3.0:1746143139.164592:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 28 pid: 14794 timeout: 1020 lvb_type: 0 00000100:00100000:3.0:1746143139.164682:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6837 00000100:00100000:3.0:1746143139.164689:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858843520:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143139.164705:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143139.164710:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 28 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.164723:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 28 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.164745:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a523c000/0x25aee876ca70e258 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650c23 expref: 28 pid: 14794 timeout: 1020 lvb_type: 0 00010000:00010000:3.0:1746143139.164758:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143139.164763:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143139.164772:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143139.164779:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143139.165181:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143139.165227:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858843520:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 537us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143139.165237:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6837 00010000:00010000:2.0:1746143139.165546:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143139.165554:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000040:00080000:2.0:1746143139.167379:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2442, 88 off207616 00000004:00080000:2.0:1746143139.167391:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921007358836ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168014:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2453, 88 off208320 00000004:00080000:2.0:1746143139.168020:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921007988857ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143139.168378:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2454, 88 off208408 00000004:00080000:2.0:1746143139.168382:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921008350232ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143139.168391:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2443, 88 off207704 00000004:00080000:2.0:1746143139.168394:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921008362347ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168400:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2444, 88 off207792 00000004:00080000:2.0:1746143139.168402:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921008370467ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168408:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2455, 88 off208496 00000004:00080000:2.0:1746143139.168410:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921008378785ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143139.168416:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2456, 88 off208584 00000004:00080000:2.0:1746143139.168419:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921008387192ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143139.168425:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2457, 88 off208672 00000004:00080000:2.0:1746143139.168428:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921008396348ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143139.168435:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2445, 88 off207880 00000004:00080000:2.0:1746143139.168437:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921008405637ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168444:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2458, 88 off208760 00000004:00080000:2.0:1746143139.168446:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921008414945ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143139.168453:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2446, 88 off207968 00000004:00080000:2.0:1746143139.168456:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921008425027ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168463:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2459, 88 off208848 00000004:00080000:2.0:1746143139.168466:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921008434730ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143139.168473:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2447, 88 off208056 00000004:00080000:2.0:1746143139.168475:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921008443807ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168482:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2448, 88 off208144 00000004:00080000:2.0:1746143139.168484:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921008452744ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168491:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2449, 88 off208232 00000004:00080000:2.0:1746143139.168493:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921008462032ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168500:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2450, 88 off208320 00000004:00080000:2.0:1746143139.168502:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921008471020ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143139.168509:0:14794:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2460, 88 off208936 00000004:00080000:2.0:1746143139.168513:0:14794:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921008481489ns, next at 860119223596ns, rc = 0 00000001:00080000:0.0:1746143139.203680:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942485 is committed 00000001:00080000:0.0:1746143139.203693:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942483 is committed 00000001:00080000:0.0:1746143139.203699:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942475 is committed 00000001:00080000:0.0:1746143139.203710:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942480 is committed 00000001:00080000:0.0:1746143139.203732:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942488 is committed 00000004:00080000:0.0:1746143139.203737:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1877 committed 00000004:00080000:0.0:1746143139.203745:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1872 committed 00000004:00080000:0.0:1746143139.203750:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1871 committed 00000004:00080000:0.0:1746143139.203751:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1870 committed 00000004:00080000:0.0:1746143139.203753:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1869 committed 00000004:00080000:0.0:1746143139.203754:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1876 committed 00000004:00080000:0.0:1746143139.203756:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1868 committed 00000004:00080000:0.0:1746143139.203757:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1875 committed 00000004:00080000:0.0:1746143139.203761:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1867 committed 00000004:00080000:0.0:1746143139.203762:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1874 committed 00000004:00080000:0.0:1746143139.203764:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1873 committed 00000004:00080000:0.0:1746143139.203766:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1872 committed 00000004:00080000:0.0:1746143139.203768:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1866 committed 00000004:00080000:0.0:1746143139.203769:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1865 committed 00000004:00080000:0.0:1746143139.203771:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1871 committed 00000004:00080000:0.0:1746143139.203772:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1870 committed 00000004:00080000:0.0:1746143139.203775:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1864 committed 00000001:00080000:0.0:1746143139.203835:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942487 is committed 00000004:00010000:2.0:1746143139.204017:0:14794:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5e3b480 reply state ffff880092a3ec00 transno 8589942488 ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:2.0:1746143139.204043:0:14794:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746143139.204159:0:14794:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143139.204175:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31170:x1830962858842624:12345-192.168.201.28@tcp:36:mirror_io.0 Request processed in 49393us (49608us total) trans 8589942488 rc 0/0 00000100:00100000:2.0:1746143139.204183:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8260 00010000:00010000:0.0:1746143139.204684:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.204693:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.204700:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.204706:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dc1600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143139.204710:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.204717:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.204733:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143139.204736:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143139.204740:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:0.0:1746143139.204745:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e46c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143139.204849:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861328128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143139.204900:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.204940:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861328640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143139.204957:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.204969:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861329152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143139.204983:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.205006:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143139.205011:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861328256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143139.205025:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.205050:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861328768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143139.205073:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.205103:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861328128 00000100:00100000:3.0:1746143139.205110:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861328128 00000100:00100000:3.0:1746143139.205156:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861328640 00000100:00100000:3.0:1746143139.205158:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861328640 00000100:00100000:3.0:1746143139.205172:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861329152 00000100:00100000:3.0:1746143139.205174:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861329152 00000100:00100000:3.0:1746143139.205185:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861328256 00000100:00100000:3.0:1746143139.205187:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861328256 00000100:00100000:3.0:1746143139.205196:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861328768 00000100:00100000:3.0:1746143139.205197:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861328768 00000100:00100000:3.0:1746143139.205210:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12838 00000100:00100000:3.0:1746143139.205215:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861328128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143139.205241:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861328512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143139.205297:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143139.205325:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861329024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143139.205344:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143139.205363:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746143139.205369:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861328384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143139.205384:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143139.205393:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861328896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143139.205405:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.205429:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3301:x1830962861328128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (529us total) trans 21474840114 rc 0/0 00000100:00100000:2.0:1746143139.205433:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861328512 00000100:00100000:2.0:1746143139.205612:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861328512 00000100:00100000:3.0:1746143139.205632:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12838 00000100:00100000:2.0:1746143139.205644:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861329024 00000100:00100000:2.0:1746143139.205646:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861329024 00000100:00100000:3.0:1746143139.205648:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861328384 00000100:00100000:3.0:1746143139.205652:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861328384 00000100:00100000:2.0:1746143139.205655:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861328896 00000100:00100000:2.0:1746143139.205657:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861328896 00000100:00100000:3.0:1746143139.205664:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12839 00000100:00100000:3.0:1746143139.205669:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3301:x1830962861328640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143139.205684:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12840 00000100:00100000:2.0:1746143139.205691:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3301:x1830962861329152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143139.205774:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12841 00000100:00100000:1.0:1746143139.205781:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3301:x1830962861328256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143139.205904:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3301:x1830962861329152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (918us total) trans 21474840115 rc 0/0 00000100:00100000:2.0:1746143139.205915:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12840 00000100:00100000:2.0:1746143139.205929:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12842 00000100:00100000:2.0:1746143139.205935:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861328768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143139.205942:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861328256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (914us total) trans 21474840116 rc 0/0 00000100:00100000:1.0:1746143139.205948:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12841 00000100:00100000:1.0:1746143139.205960:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12843 00000100:00100000:1.0:1746143139.205966:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861328512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143139.206053:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861328768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (978us total) trans 21474840117 rc 0/0 00000100:00100000:2.0:1746143139.206060:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12842 00000100:00100000:2.0:1746143139.206072:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12844 00000100:00100000:2.0:1746143139.206077:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3300:x1830962861329024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143139.206099:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861328512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (802us total) trans 17179872852 rc 0/0 00000100:00100000:1.0:1746143139.206105:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12843 00000100:00100000:1.0:1746143139.206116:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12845 00000100:00100000:1.0:1746143139.206132:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3300:x1830962861328384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143139.206176:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143139.206179:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143139.206181:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143139.206183:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143139.206185:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143139.206208:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3300:x1830962861329024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (862us total) trans 21474840118 rc 0/0 00000100:00100000:2.0:1746143139.206213:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12844 00000100:00100000:1.0:1746143139.206223:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3300:x1830962861328384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (836us total) trans 21474840119 rc 0/0 00000100:00100000:2.0:1746143139.206226:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12846 00000100:00100000:1.0:1746143139.206230:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12845 00000100:00100000:2.0:1746143139.206232:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3300:x1830962861328896:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746143139.206246:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143139.206249:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143139.206320:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3300:x1830962861328896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (913us total) trans 21474840120 rc 0/0 00000100:00100000:2.0:1746143139.206325:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12846 00000100:00100000:2.0:1746143139.206356:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861329408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143139.206583:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143139.206608:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861329920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143139.206623:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143139.206637:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143139.206642:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861329536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143139.206657:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143139.206669:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861330048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143139.206682:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143139.206714:0:3300:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840106 gen 2 00000004:00080000:2.0:1746143139.206719:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800906a5500, transno 21474840055 00000004:00080000:2.0:1746143139.206725:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800906a5f80, transno 21474840056 00000004:00080000:2.0:1746143139.206727:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800906a4a80, transno 21474840057 00000004:00080000:2.0:1746143139.206730:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800906a4e00, transno 21474840058 00000004:00080000:2.0:1746143139.206732:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800906a5880, transno 21474840059 00000004:00080000:2.0:1746143139.206734:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800906a4000, transno 21474840060 00000004:00080000:2.0:1746143139.206736:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a7b100, transno 21474840061 00000004:00080000:2.0:1746143139.206739:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800906a4380, transno 21474840062 00000004:00080000:2.0:1746143139.206741:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800906a7800, transno 21474840063 00000004:00080000:2.0:1746143139.206743:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a7a300, transno 21474840067 00000004:00080000:2.0:1746143139.206745:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130765880, transno 21474840068 00000004:00080000:2.0:1746143139.206747:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dc000, transno 21474840069 00000004:00080000:2.0:1746143139.206749:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130764380, transno 21474840070 00000004:00080000:2.0:1746143139.206752:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130767b80, transno 21474840071 00000004:00080000:2.0:1746143139.206754:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130764700, transno 21474840072 00000004:00080000:2.0:1746143139.206756:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130766300, transno 21474840073 00000004:00080000:2.0:1746143139.206758:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130765180, transno 21474840074 00000004:00080000:2.0:1746143139.206761:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130767100, transno 21474840075 00000004:00080000:2.0:1746143139.206763:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dd880, transno 21474840076 00000004:00080000:2.0:1746143139.206765:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dd180, transno 21474840077 00000004:00080000:2.0:1746143139.206767:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dc380, transno 21474840078 00000004:00080000:2.0:1746143139.206770:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5cc8700, transno 21474840079 00000004:00080000:2.0:1746143139.206772:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919df480, transno 21474840080 00000004:00080000:2.0:1746143139.206774:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ccbb80, transno 21474840081 00000004:00080000:2.0:1746143139.206776:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919dea00, transno 21474840082 00000004:00080000:2.0:1746143139.206779:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5cca680, transno 21474840083 00000004:00080000:2.0:1746143139.206781:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e80dc00, transno 21474840084 00000100:00100000:0.0:1746143139.206782:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861329408 00000004:00080000:2.0:1746143139.206783:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b7100, transno 21474840089 00000004:00080000:2.0:1746143139.206785:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b4e00, transno 21474840090 00000100:00100000:0.0:1746143139.206786:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861329408 00000004:00080000:2.0:1746143139.206787:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b4000, transno 21474840091 00000004:00080000:2.0:1746143139.206790:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b4700, transno 21474840092 00000004:00080000:2.0:1746143139.206792:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b5f80, transno 21474840093 00000004:00080000:2.0:1746143139.206794:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b5c00, transno 21474840094 00000004:00080000:2.0:1746143139.206795:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b5500, transno 21474840095 00000004:00080000:2.0:1746143139.206798:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b7800, transno 21474840096 00000004:00080000:2.0:1746143139.206800:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eaaea00, transno 21474840097 00000004:00080000:2.0:1746143139.206802:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e680, transno 21474840098 00000100:00100000:0.0:1746143139.206803:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861329920 00000004:00080000:2.0:1746143139.206804:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314c380, transno 21474840099 00000100:00100000:0.0:1746143139.206805:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861329920 00000004:00080000:2.0:1746143139.206806:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314d180, transno 21474840100 00000004:00080000:2.0:1746143139.206808:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314f100, transno 21474840101 00000004:00080000:2.0:1746143139.206810:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e300, transno 21474840102 00000004:00080000:2.0:1746143139.206812:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314fb80, transno 21474840103 00000004:00080000:2.0:1746143139.206814:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314df80, transno 21474840104 00000100:00100000:0.0:1746143139.206814:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861329536 00000004:00080000:2.0:1746143139.206816:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314ea00, transno 21474840105 00000100:00100000:0.0:1746143139.206816:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861329536 00000004:00080000:2.0:1746143139.206818:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eaad180, transno 21474840106 00000100:00100000:2.0:1746143139.206823:0:3300:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880094426300 x1830962861328384/t21474840119(21474840119) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143155 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:0.0:1746143139.206824:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861330048 00000100:00100000:0.0:1746143139.206826:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861330048 00000004:00080000:2.0:1746143139.206834:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094426300/2, rc 0, transno 21474840119 00000100:00100000:0.0:1746143139.206838:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12847 00000100:00100000:2.0:1746143139.206839:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861328384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143139.206844:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3299:x1830962861329408:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143139.206850:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094424380/2, rc 0, transno 21474840120 00000100:00100000:2.0:1746143139.206854:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861328896:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143139.206862:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b5b100/2, rc 0, transno 17179872852 00000100:00100000:2.0:1746143139.206866:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861328512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143139.206872:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5841f80/2, rc 0, transno 21474840118 00000100:00100000:2.0:1746143139.206880:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861329024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143139.206936:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12848 00000100:00100000:2.0:1746143139.206943:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3299:x1830962861329920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143139.206955:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3299:x1830962861329408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (370us total) trans 17179872853 rc 0/0 00000100:00100000:0.0:1746143139.206961:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12847 00000100:00100000:0.0:1746143139.206972:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12849 00000100:00100000:0.0:1746143139.206976:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3299:x1830962861329536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143139.207078:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3299:x1830962861329536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (420us total) trans 17179872855 rc 0/0 00000100:00100000:0.0:1746143139.207083:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12849 00000100:00100000:0.0:1746143139.207093:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12850 00000100:00100000:0.0:1746143139.207097:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3299:x1830962861330048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143139.207180:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3299:x1830962861330048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (496us total) trans 17179872856 rc 0/0 00000100:00100000:0.0:1746143139.207185:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12850 00000100:00100000:3.0:1746143139.207372:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861328640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1702us (2413us total) trans 21474840121 rc 0/0 00000100:00100000:3.0:1746143139.207378:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12839 00000100:00100000:3.0:1746143139.207408:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861329280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143139.207431:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.207451:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861329792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143139.207466:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.207733:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746143139.207739:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861329664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143139.207759:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143139.207777:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861329280 00000100:00100000:3.0:1746143139.207780:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861329280 00000100:00100000:3.0:1746143139.207795:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861329792 00000100:00100000:3.0:1746143139.207796:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861329792 00000100:00100000:1.0:1746143139.208246:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143139.208269:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3299:x1830962861329920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1322us (1641us total) trans 17179872854 rc 0/0 00000100:00100000:1.0:1746143139.208269:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858843648 00000100:00100000:1.0:1746143139.208272:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858843648 00000100:00100000:2.0:1746143139.208277:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12848 00000100:00100000:2.0:1746143139.208290:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861329664 00000100:00100000:2.0:1746143139.208295:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861329664 00000100:00100000:1.0:1746143139.208300:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8261 00000100:00100000:1.0:1746143139.208305:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31170:x1830962858843648:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143139.208322:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143139.208643:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12851 00000100:00100000:3.0:1746143139.208649:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3302:x1830962861329280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143139.208786:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3302:x1830962861329280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (1354us total) trans 17179872857 rc 0/0 00000100:00100000:3.0:1746143139.208792:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12851 00000100:00100000:3.0:1746143139.208920:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12852 00000100:00100000:3.0:1746143139.208925:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3302:x1830962861329792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143139.209000:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3302:x1830962861329792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1532us total) trans 17179872858 rc 0/0 00000100:00100000:3.0:1746143139.209006:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12852 00000100:00100000:3.0:1746143139.209014:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12853 00000100:00100000:3.0:1746143139.209018:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3302:x1830962861329664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143139.209103:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3302:x1830962861329664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1343us total) trans 17179872859 rc 0/0 00000100:00100000:3.0:1746143139.209108:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12853 00010000:00010000:1.0:1746143139.209171:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d57 expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.209221:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.209234:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.209252:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143139.209256:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143139.209259:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136035400, rc 0) 00000100:00100000:1.0:1746143139.209290:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31170:x1830962858843648:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 985us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143139.209296:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8261 00000004:00080000:2.0:1746143139.209533:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092996d80/2, rc 0, transno 17179872855 00000004:00080000:0.0:1746143139.209535:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919de300/2, rc 0, transno 17179872859 00000100:00100000:2.0:1746143139.209541:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861329536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143139.209541:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861329664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143139.209551:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919df800/2, rc 0, transno 17179872856 00000004:00080000:0.0:1746143139.209552:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092997800/2, rc 0, transno 17179872857 00000100:00100000:2.0:1746143139.209555:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861330048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143139.209555:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861329280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143139.209562:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919ddc00/2, rc 0, transno 17179872858 00000100:00100000:0.0:1746143139.209564:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861329792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143139.209571:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092994a80/2, rc 0, transno 17179872853 00000100:00100000:2.0:1746143139.209574:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861329408:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143139.209580:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919ddf80/2, rc 0, transno 17179872854 00000100:00100000:2.0:1746143139.209583:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861329920:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143139.210308:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094426680/2, rc 0, transno 21474840116 00000100:00100000:3.0:1746143139.210312:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861328256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143139.210321:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094424000/2, rc 0, transno 21474840117 00000100:00100000:3.0:1746143139.210324:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861328768:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143139.210332:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094424e00/2, rc 0, transno 21474840114 00000100:00100000:3.0:1746143139.210335:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861328128:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143139.210342:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094424a80/2, rc 0, transno 21474840121 00000100:00100000:3.0:1746143139.210345:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861328640:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143139.210351:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5841880/2, rc 0, transno 21474840115 00000100:00100000:3.0:1746143139.210354:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861329152:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143139.211604:0:14835:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 45 done 00000100:00100000:3.0:1746143139.211700:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861330176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143139.211736:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143139.211837:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861330176 00000100:00100000:1.0:1746143139.211843:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861330176 00000100:00100000:1.0:1746143139.211870:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12854 00000100:00100000:1.0:1746143139.211876:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3301:x1830962861330176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143139.212105:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3301:x1830962861330176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 227us (366us total) trans 21474840122 rc 0/0 00000100:00100000:1.0:1746143139.212111:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12854 00000004:00080000:3.0:1746143139.212533:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009310c380/2, rc 0, transno 21474840122 00000100:00100000:3.0:1746143139.212539:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861330176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143139.215165:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143139.215213:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858843776 00000100:00100000:1.0:1746143139.215221:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858843776 00000100:00100000:1.0:1746143139.215316:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8262 00000100:00100000:1.0:1746143139.215322:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31170:x1830962858843776:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143139.215339:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143139.215358:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e47a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d5e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.215659:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143139.215672:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143139.215683:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143139.215709:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143139.215714:0:14795:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143139.215729:0:14795:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143139.215751:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dc1600/0x25aee876ca70e47a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.215763:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143139.215771:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143139.215774:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143139.215776:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee83a00, rc 0) 00000100:00100000:1.0:1746143139.215824:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31170:x1830962858843776:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 502us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143139.215829:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8262 00000100:00100000:0.0:1746143139.220565:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.220608:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.220638:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.220719:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143139.220731:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858843904 00000100:00100000:3.0:1746143139.220740:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858843904 00000100:00100000:0.0:1746143139.220743:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858844032 00000100:00100000:0.0:1746143139.220747:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858844032 00000100:00100000:3.0:1746143139.220773:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858844160 00000100:00100000:3.0:1746143139.220775:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858844160 00000100:00100000:2.0:1746143139.221693:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858844288 00000100:00100000:2.0:1746143139.221698:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858844288 00000100:00100000:2.0:1746143139.221724:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12855 00000100:00100000:2.0:1746143139.221733:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858843904:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.221752:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.221770:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094576600/0x25aee876ca70e488 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d65 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143139.221794:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x681407a0, atime: 0x681407a0, ctime: 0x681407a0, blocks: 0x7cf 00010000:00010000:2.0:1746143139.221813:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.221815:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.221824:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094576600/0x25aee876ca70e488 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d65 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.221843:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094576600/0x25aee876ca70e488 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d65 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.221854:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094576600, rc 0) 00000100:00100000:2.0:1746143139.221901:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858843904:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 168us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.221906:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12855 00000100:00100000:2.0:1746143139.221922:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12856 00000100:00100000:2.0:1746143139.221928:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858844032:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.221936:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.221947:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094577200/0x25aee876ca70e48f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d6c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143139.221962:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x681407a1, atime: 0x681407a1, ctime: 0x681407a1, blocks: 0x821 00010000:00010000:2.0:1746143139.221971:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.221973:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.221978:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094577200/0x25aee876ca70e48f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d6c expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.221989:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094577200/0x25aee876ca70e48f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d6c expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.221996:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094577200, rc 0) 00000100:00100000:2.0:1746143139.222011:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858844032:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 84us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.222016:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12856 00000100:00100000:2.0:1746143139.222026:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12857 00000100:00100000:2.0:1746143139.222046:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858844160:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.222052:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.222060:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094576e00/0x25aee876ca70e496 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d73 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143139.222070:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x681407a1, atime: 0x681407a1, ctime: 0x681407a1, blocks: 0x81f 00010000:00010000:2.0:1746143139.222076:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.222078:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.222081:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094576e00/0x25aee876ca70e496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d73 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.222089:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094576e00/0x25aee876ca70e496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d73 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.222095:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094576e00, rc 0) 00000100:00100000:2.0:1746143139.222107:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858844160:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 76us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.222111:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12857 00000100:00100000:2.0:1746143139.222131:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12858 00000100:00100000:2.0:1746143139.222135:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858844288:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.222141:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.222148:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d7a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143139.222158:0:8449:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x6814079e, atime: 0x6814079e, ctime: 0x6814079e, blocks: 0x81d 00010000:00010000:2.0:1746143139.222164:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.222165:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.222168:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.222176:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.222182:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094576a00, rc 0) 00000100:00100000:2.0:1746143139.222194:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858844288:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 58us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.222198:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12858 00000100:00100000:0.0:1746143139.222388:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.222432:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143139.222482:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858844416 00000100:00100000:0.0:1746143139.222486:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858844416 00000100:00100000:0.0:1746143139.222499:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858844544 00000100:00100000:0.0:1746143139.222500:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858844544 00000100:00100000:0.0:1746143139.222509:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12859 00000100:00100000:0.0:1746143139.222514:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858844416:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143139.222520:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143139.222533:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d81 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143139.222547:0:8448:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x681407a1, atime: 0x681407a1, ctime: 0x681407a1, blocks: 0x1807 00010000:00010000:0.0:1746143139.222554:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.222555:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143139.222560:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.222570:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143139.222576:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b5d5e00, rc 0) 00000100:00100000:2.0:1746143139.222588:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12860 00000100:00100000:2.0:1746143139.222605:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858844544:12345-192.168.201.28@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143139.222621:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143139.222638:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d88 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143139.222660:0:4756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x681407a1, atime: 0x681407a1, ctime: 0x681407a1, blocks: 0x1029 00010000:00010000:2.0:1746143139.222677:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.222679:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143139.222687:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.222701:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 8 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143139.222711:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094576c00, rc 0) 00000100:00100000:2.0:1746143139.222751:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858844544:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 154us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143139.222757:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12860 00000100:00100000:0.0:1746143139.223082:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858844416:12345-192.168.201.28@tcp:101:mirror_io.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143139.223093:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12859 00010000:00010000:1.0:1746143139.543257:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143140.238866:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.240000:0:21568:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858844800 00000100:00100000:3.0:1746143140.240011:0:21568:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858844800 00000100:00100000:3.0:1746143140.240137:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6277 00000100:00100000:3.0:1746143140.240146:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858844800:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143140.240185:0:21568:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.240199:0:21568:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.240201:0:21568:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.240206:0:21568:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.240219:0:21568:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143140.251552:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.256068:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858845056 00000100:00100000:2.0:1746143140.256079:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858845056 00000100:00100000:2.0:1746143140.256154:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6278 00000100:00100000:2.0:1746143140.256162:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858845056:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143140.256193:0:21521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.256204:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.256206:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.256210:0:21521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.256223:0:21521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143140.257586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.257613:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.257727:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858845312 00000100:00100000:3.0:1746143140.257732:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858845312 00000100:00100000:3.0:1746143140.257758:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858845568 00000100:00100000:3.0:1746143140.257760:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858845568 00000100:00100000:3.0:1746143140.260071:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6279 00000100:00100000:1.0:1746143140.260083:0:31430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6280 00000100:00100000:3.0:1746143140.260084:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858845312:12345-192.168.201.28@tcp:3:mirror_io.0 00000100:00100000:1.0:1746143140.260092:0:31430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858845568:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143140.260124:0:31431:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.260124:0:31430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.260135:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.260135:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.260136:0:31430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.260139:0:31430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.260146:0:31431:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.260149:0:31431:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.260149:0:31430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.260160:0:31431:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143140.266357:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.266381:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.266589:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.266614:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.266638:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858846080 00000100:00100000:0.0:1746143140.266647:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858846080 00000100:00100000:2.0:1746143140.266843:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858846464 00000100:00100000:2.0:1746143140.266847:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858846464 00000100:00100000:2.0:1746143140.266890:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858846336 00000100:00100000:2.0:1746143140.266892:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858846336 00000100:00100000:2.0:1746143140.266905:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858845952 00000100:00100000:2.0:1746143140.266907:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858845952 00000100:00100000:0.0:1746143140.266978:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6281 00000100:00100000:0.0:1746143140.266987:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858846464:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143140.267020:0:31806:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.267057:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143140.267059:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143140.267064:0:31806:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.267077:0:31806:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143140.267369:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6282 00000100:00100000:1.0:1746143140.267376:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1968:x1830962858846336:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143140.267388:0:8454:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.267395:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.267396:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.267399:0:8454:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.267407:0:8454:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143140.267654:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6283 00000100:00100000:1.0:1746143140.267659:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1969:x1830962858846080:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143140.267868:0:21522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.267875:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143140.267876:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6284 00010000:00010000:1.0:1746143140.267876:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.267880:0:21522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.267881:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+13:1969:x1830962858845952:12345-192.168.201.28@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143140.267889:0:21522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.267892:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.267898:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.267899:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.267902:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.267908:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.277385:0:21568:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.277403:0:21568:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.277411:0:21568:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.277418:0:21568:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a28e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143140.277422:0:21568:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.277429:0:21568:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.277447:0:21568:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.277453:0:21568:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a28e00/0x25aee876ca70e4b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21568 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.277564:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858844800:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 37414us (38701us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.277579:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6277 00010000:00010000:3.0:1746143140.284242:0:21521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.284260:0:21521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.284269:0:21521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.284276:0:21521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094154800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143140.284281:0:21521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.284288:0:21521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.284309:0:21521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.284315:0:21521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094154800/0x25aee876ca70e4b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.288274:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+14:1968:x1830962858845056:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 32095us (36713us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.288289:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6278 00010000:00010000:1.0:1746143140.289333:0:31430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.289347:0:31430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.289356:0:31430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.289362:0:31430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ee83200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143140.289367:0:31430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.289374:0:31430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.289391:0:31430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.289397:0:31430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143140.289473:0:31430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1968:x1830962858845568:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 29382us (31857us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.289481:0:31430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6280 00010000:00010000:0.0:1746143140.290628:0:31806:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.290639:0:31806:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.290646:0:31806:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.290651:0:31806:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090153600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143140.290654:0:31806:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.290661:0:31806:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.290671:0:31806:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.290677:0:31806:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e4ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143140.290714:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858846464:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 23728us (24331us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143140.290721:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6281 00010000:00010000:1.0:1746143140.310506:0:21522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.310524:0:21522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.310532:0:21522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.310538:0:21522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4aa9000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143140.310542:0:21522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.310549:0:21522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.310567:0:21522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.310573:0:21522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4aa9000/0x25aee876ca70e4dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143140.310672:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+12:1969:x1830962858846080:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 43007us (44321us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.310682:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6283 00010000:00010000:1.0:1746143140.316232:0:8454:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.316251:0:8454:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.316260:0:8454:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.316267:0:8454:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4aa9a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143140.316271:0:8454:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.316279:0:8454:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.316298:0:8454:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.316304:0:8454:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e4d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143140.317763:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858846336:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 50377us (51163us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.317779:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6282 00010000:00010000:2.0:1746143140.322450:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.322467:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.322476:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.322489:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f390800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143140.322493:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.322501:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.322520:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.322527:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f390800/0x25aee876ca70e4e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.322622:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a70b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1969:x1830962858845952:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 54735us (56001us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143140.322631:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6284 00010000:00010000:3.0:1746143140.328482:0:31431:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.328501:0:31431:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.328509:0:31431:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.328516:0:31431:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a28000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143140.328520:0:31431:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.328528:0:31431:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.328547:0:31431:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.328553:0:31431:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a28000/0x25aee876ca70e4c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31431 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.329219:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858845312:12345-192.168.201.28@tcp:3:mirror_io.0 Request processed in 69133us (71628us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.329228:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6279 00000100:00100000:0.0:1746143140.336173:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.336707:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858846720 00000100:00100000:3.0:1746143140.336716:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858846720 00000100:00100000:3.0:1746143140.336778:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 620 00000100:00100000:3.0:1746143140.336786:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31170:x1830962858846720:12345-192.168.201.28@tcp:103:mirror_io.0 00010000:00010000:3.0:1746143140.336804:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143140.336833:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe2b200/0x25aee876ca70e42d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d49 expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.337028:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143140.337055:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143140.337095:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31170:x1830962858846720:12345-192.168.201.28@tcp:103:mirror_io.0 Request processed in 311us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.337110:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 620 00000100:00100000:0.0:1746143140.338774:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.338834:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858846976 00000100:00100000:3.0:1746143140.338840:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858846976 00000100:00100000:3.0:1746143140.339256:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3506 00000100:00100000:3.0:1746143140.339264:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c04e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31170:x1830962858846976:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143140.339713:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c04e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31170:x1830962858846976:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 449us (943us total) trans 8589942489 rc 0/0 00000100:00100000:3.0:1746143140.339719:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3506 00000100:00100000:0.0:1746143140.342481:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.342566:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858847232 00000100:00100000:1.0:1746143140.342573:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858847232 00000100:00100000:1.0:1746143140.342614:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3507 00000100:00100000:1.0:1746143140.342620:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31170:x1830962858847232:12345-192.168.201.28@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143140.342817:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:31170:x1830962858847232:12345-192.168.201.28@tcp:35:mirror_io.0 Request processed in 195us (341us total) trans 8589942490 rc 0/0 00000100:00100000:1.0:1746143140.342823:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3507 00000100:00100000:0.0:1746143140.366515:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.367075:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858847488 00000100:00100000:2.0:1746143140.367085:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858847488 00000100:00100000:2.0:1746143140.367162:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8263 00000100:00100000:2.0:1746143140.367171:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:31183:x1830962858847488:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.367199:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.367221:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d8f expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.367344:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367362:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367374:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367389:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367395:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367400:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367513:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367520:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367526:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143140.367535:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143140.367626:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367633:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367639:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367649:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ee82a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143140.367652:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367658:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367668:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143140.367671:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143140.367675:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367680:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee82a00/0x25aee876ca70e4f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367706:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367711:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367716:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367721:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009532d800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143140.367724:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367729:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367736:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b53d8600) 00010000:00010000:2.0:1746143140.367738:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143140.367741:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367745:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009532d800/0x25aee876ca70e4f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143140.367791:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83200/0x25aee876ca70e4ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 200 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.367804:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 199 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.367810:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143140.367812:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143140.367815:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009532cc00, rc 0) 00000100:00100000:2.0:1746143140.367865:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31183:x1830962858847488:12345-192.168.201.28@tcp:101:cat.0 Request processed in 695us (1361us total) trans 8589942491 rc 0/0 00000100:00100000:2.0:1746143140.367872:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8263 00000100:00100000:2.0:1746143140.368945:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.369259:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858847744 00000100:00100000:1.0:1746143140.369266:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858847744 00000100:00100000:1.0:1746143140.369304:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8264 00000100:00100000:1.0:1746143140.369310:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+6:31184:x1830962858847744:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.369324:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.369335:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70e50d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d96 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.369402:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369412:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369420:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369433:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369439:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369445:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369520:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369528:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369534:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143140.369542:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143140.369603:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369611:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369617:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369622:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4aa9000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143140.369625:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369631:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369640:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143140.369643:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143140.369646:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.369651:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9000/0x25aee876ca70e514 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.371378:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.371389:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.371395:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.371404:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4aa9a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143140.371407:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.371413:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.371423:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009be92200) 00010000:00010000:1.0:1746143140.371425:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143140.371427:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.371432:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa9a00/0x25aee876ca70e51b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.371479:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4aa8400/0x25aee876ca70e50d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.371493:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.371500:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.371502:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143140.371504:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a382a00, rc 0) 00000100:00100000:1.0:1746143140.371557:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31184:x1830962858847744:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2246us (2613us total) trans 8589942492 rc 0/0 00000100:00100000:1.0:1746143140.371565:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8264 00000100:00100000:2.0:1746143140.376602:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.376642:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.376819:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858847872 00000100:00100000:0.0:1746143140.376829:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858847872 00000100:00100000:0.0:1746143140.376880:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12861 00000100:00100000:0.0:1746143140.376888:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:1971:x1830962858847872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143140.376907:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143140.376925:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094154200/0x25aee876ca70e530 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650d9d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.376949:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143140.376952:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143140.376961:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094154200/0x25aee876ca70e530 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d9d expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143140.376977:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094154200/0x25aee876ca70e530 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d9d expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143140.376990:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094154200, rc 0) 00000100:00100000:0.0:1746143140.377052:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858847872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 163us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143140.377059:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12861 00000100:00100000:1.0:1746143140.377189:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858848128 00000100:00100000:1.0:1746143140.377193:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858848128 00000100:00100000:1.0:1746143140.377224:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8265 00000100:00100000:1.0:1746143140.377228:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:31179:x1830962858848128:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143140.377242:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.377256:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f12c00/0x25aee876ca70e537 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650da4 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.377347:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.377360:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.377367:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 198 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.377374:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.377380:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 6/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.377410:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.377422:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 9 pid: 14795 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.377434:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861330304:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143140.377515:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 198 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.377524:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 198 pid: 14794 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.377532:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861330432:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143140.377559:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.377566:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 9 pid: 14795 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.377574:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861330560:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.377593:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009532bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143140.379299:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.379339:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.379364:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.379949:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.380026:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858848256 00000100:00100000:2.0:1746143140.380051:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858848256 00000100:00100000:2.0:1746143140.380086:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858848512 00000100:00100000:2.0:1746143140.380089:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858848512 00000100:00100000:2.0:1746143140.380117:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858848768 00000100:00100000:2.0:1746143140.380120:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858848768 00000100:00100000:0.0:1746143140.380863:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.383201:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.383789:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858848384 00000100:00100000:2.0:1746143140.383797:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858848384 00000100:00100000:2.0:1746143140.383848:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12862 00000100:00100000:2.0:1746143140.383858:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858848256:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.383879:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.383897:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee83600/0x25aee876ca70e545 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650dab expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.383923:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.383925:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.384738:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee83600/0x25aee876ca70e545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dab expref: 22 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.384760:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee83600/0x25aee876ca70e545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dab expref: 22 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.384773:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee83600, rc 0) 00000100:00100000:2.0:1746143140.384818:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858848256:12345-192.168.201.28@tcp:101:cat.0 Request processed in 962us (5527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.384825:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12862 00000100:00100000:2.0:1746143140.384842:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12863 00000100:00100000:2.0:1746143140.384849:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:1971:x1830962858848512:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.384858:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.384867:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650db9 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.384879:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.384881:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.384885:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 14 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.384894:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 14 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.384901:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a523c000, rc 0) 00000100:00100000:2.0:1746143140.384913:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858848512:12345-192.168.201.28@tcp:101:cat.0 Request processed in 66us (5575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.384917:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12863 00000100:00100000:2.0:1746143140.384926:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12864 00000100:00100000:2.0:1746143140.384930:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858848768:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.384935:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.384941:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650dc7 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.384949:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.384951:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.384954:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 22 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.384962:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 22 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.384967:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a523d200, rc 0) 00000100:00100000:2.0:1746143140.384977:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858848768:12345-192.168.201.28@tcp:101:cat.0 Request processed in 47us (5614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.384981:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12864 00000100:00100000:2.0:1746143140.384988:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12865 00000100:00100000:2.0:1746143140.384992:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858848384:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.384998:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.385003:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee83200/0x25aee876ca70e55a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650db2 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.385011:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.385012:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.385015:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee83200/0x25aee876ca70e55a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db2 expref: 22 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.385023:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee83200/0x25aee876ca70e55a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db2 expref: 22 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.385043:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee83200, rc 0) 00000100:00100000:2.0:1746143140.385055:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858848384:12345-192.168.201.28@tcp:101:cat.0 Request processed in 63us (4193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.385059:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12865 00000100:00100000:3.0:1746143140.385562:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858849792 00000100:00100000:3.0:1746143140.385567:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858849792 00000100:00100000:3.0:1746143140.385605:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8266 00000100:00100000:3.0:1746143140.385611:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31182:x1830962858849792:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143140.385626:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.385638:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a29200/0x25aee876ca70e561 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650df8 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.385728:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.385744:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.385751:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143140.386137:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.386155:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.386170:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.386190:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.386203:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.386218:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858848640 00000100:00100000:0.0:1746143140.386222:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858848640 00000100:00100000:1.0:1746143140.386300:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858848896 00000100:00100000:1.0:1746143140.386305:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858848896 00000100:00080000:1.0:1746143140.386325:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143140.386338:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858849024 00000100:00100000:1.0:1746143140.386340:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858849024 00000100:00100000:1.0:1746143140.386364:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858849152 00000100:00100000:1.0:1746143140.386366:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858849152 00000100:00100000:1.0:1746143140.386377:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858849280 00000100:00100000:1.0:1746143140.386378:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858849280 00000100:00100000:1.0:1746143140.386390:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12866 00000100:00100000:1.0:1746143140.386395:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858849024:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.386403:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.386411:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650dd5 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.386427:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386429:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386435:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 26 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386445:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 26 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386452:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529f600, rc 0) 00000100:00100000:1.0:1746143140.386663:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858849024:12345-192.168.201.28@tcp:101:cat.0 Request processed in 268us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.386669:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12866 00000100:00100000:1.0:1746143140.386678:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858849408 00000100:00100000:1.0:1746143140.386680:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858849408 00000100:00100000:1.0:1746143140.386687:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12867 00000100:00100000:1.0:1746143140.386691:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858849152:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.386696:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.386701:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ddc expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.386709:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386710:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386714:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 26 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386722:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 26 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386730:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529f800, rc 0) 00000100:00100000:1.0:1746143140.386741:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858849152:12345-192.168.201.28@tcp:101:cat.0 Request processed in 50us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.386745:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12867 00000100:00100000:1.0:1746143140.386755:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12868 00000100:00100000:1.0:1746143140.386759:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858849280:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.386765:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.386770:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650de3 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.386778:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386779:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386782:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386791:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386796:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529ee00, rc 0) 00000100:00100000:1.0:1746143140.386805:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858849280:12345-192.168.201.28@tcp:101:cat.0 Request processed in 46us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.386809:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12868 00000100:00100000:1.0:1746143140.386815:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12869 00000100:00100000:1.0:1746143140.386818:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858849408:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.386825:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.386829:0:10061:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650dea expref: -99 pid: 10061 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.386836:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386837:0:10061:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386840:0:10061:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386848:0:10061:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 20 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386854:0:10061:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529e600, rc 0) 00000100:00100000:1.0:1746143140.386863:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858849408:12345-192.168.201.28@tcp:101:cat.0 Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.386867:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12869 00000100:00080000:1.0:1746143140.386875:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143140.386903:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12870 00000100:00100000:1.0:1746143140.386907:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858848896:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.386911:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.386916:0:8448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650dce expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.386924:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386926:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.386930:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 20 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386943:0:8448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 20 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.386949:0:8448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529f000, rc 0) 00000100:00100000:1.0:1746143140.386958:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858848896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 51us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.386962:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12870 00000100:00100000:1.0:1746143140.387010:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.387019:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858849536 00000100:00100000:1.0:1746143140.387021:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858849536 00000100:00100000:1.0:1746143140.387049:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12871 00000100:00100000:1.0:1746143140.387053:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1969:x1830962858849536:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.387058:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.387064:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650df1 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.387073:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.387075:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.387078:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 27 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.387087:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 27 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.387093:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529fe00, rc 0) 00000100:00100000:1.0:1746143140.387115:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1969:x1830962858849536:12345-192.168.201.28@tcp:101:cat.0 Request processed in 62us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.387120:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12871 00000100:00100000:1.0:1746143140.387185:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861330304:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.387217:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861330432:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.387238:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861330560:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143140.387257:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:1.0:1746143140.387279:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.387293:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858849920 00000100:00100000:1.0:1746143140.387296:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858849920 00010000:00010000:1.0:1746143140.387311:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 10 pid: 14795 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.387330:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6838 00000100:00100000:1.0:1746143140.387335:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1970:x1830962858849920:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143140.387345:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143140.387350:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 10 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387361:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 10 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387376:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a382a00/0x25aee876ca70e522 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d96 expref: 10 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387388:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.387393:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.387400:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.387406:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143140.387418:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1970:x1830962858849920:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.387424:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6838 00000100:00100000:1.0:1746143140.387479:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.387491:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858850048 00000100:00100000:1.0:1746143140.387493:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858850048 00010000:00010000:1.0:1746143140.387503:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 201 pid: 14794 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.387516:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6839 00000100:00100000:1.0:1746143140.387520:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1970:x1830962858850048:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143140.387526:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143140.387529:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 201 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387536:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 201 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387545:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009532cc00/0x25aee876ca70e4ff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d8f expref: 201 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387553:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.387557:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.387561:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.387565:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143140.387575:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1970:x1830962858850048:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 55us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.387580:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6839 00000100:00100000:1.0:1746143140.387622:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.387632:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858850176 00000100:00100000:1.0:1746143140.387635:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858850176 00010000:00010000:1.0:1746143140.387645:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 10 pid: 14795 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.387658:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6840 00000100:00100000:1.0:1746143140.387662:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1968:x1830962858850176:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143140.387667:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143140.387671:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 10 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387679:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 10 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387690:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee83a00/0x25aee876ca70e481 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d5e expref: 10 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.387698:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.387702:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.387709:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.387716:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.387722:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.387727:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.387732:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.387749:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143140.387760:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858850176:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 98us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.387766:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6840 00010000:00010000:1.0:1746143140.387780:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143140.387786:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143140.387803:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143140.387935:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f12c00/0x25aee876ca70e537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.387946:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.387957:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.387959:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143140.387961:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f13000, rc 0) 00000100:00100000:1.0:1746143140.387989:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31179:x1830962858848128:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10759us (11345us total) trans 8589942493 rc 0/0 00000100:00100000:1.0:1746143140.387995:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8265 00000100:00100000:0.0:1746143140.388662:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12872 00000100:00100000:0.0:1746143140.388669:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1971:x1830962858848640:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143140.388679:0:22204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143140.388687:0:22204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650dc0 expref: -99 pid: 22204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.388699:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143140.388701:0:22204:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143140.388706:0:22204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 15 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143140.388716:0:22204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 15 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143140.388723:0:22204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094154c00, rc 0) 00000100:00100000:0.0:1746143140.388737:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1971:x1830962858848640:12345-192.168.201.28@tcp:101:cat.0 Request processed in 70us (5540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143140.388742:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12872 00010000:00010000:3.0:1746143140.389357:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.389363:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143140.389377:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143140.389457:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a29200/0x25aee876ca70e561 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 201 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.389485:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.389491:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143140.389494:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143140.389496:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a28000, rc 0) 00000100:00100000:3.0:1746143140.389521:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31182:x1830962858849792:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3909us (9572us total) trans 8589942494 rc 0/0 00000100:00100000:3.0:1746143140.389527:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8266 00000100:00100000:0.0:1746143140.401189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.403341:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.403368:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858850304 00000100:00100000:3.0:1746143140.403378:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858850304 00000100:00100000:3.0:1746143140.403642:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8267 00000100:00100000:3.0:1746143140.403653:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31183:x1830962858850304:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143140.403684:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.403705:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650dff expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.403769:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 201 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.403785:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 201 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.403805:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143140.403808:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143140.403812:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a28e00, rc 0) 00000100:00100000:3.0:1746143140.403867:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31183:x1830962858850304:12345-192.168.201.28@tcp:101:cat.0 Request processed in 216us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.403873:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8267 00000100:00100000:1.0:1746143140.404127:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858850432 00000100:00100000:1.0:1746143140.404132:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858850432 00000100:00100000:1.0:1746143140.404157:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8268 00000100:00100000:1.0:1746143140.404162:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31184:x1830962858850432:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.404174:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.404181:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ea00/0x25aee876ca70e5b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e06 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.404207:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ea00/0x25aee876ca70e5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e06 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.404217:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ea00/0x25aee876ca70e5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e06 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.404228:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.404231:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143140.404233:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a529ea00, rc 0) 00000100:00100000:1.0:1746143140.404256:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31184:x1830962858850432:12345-192.168.201.28@tcp:101:cat.0 Request processed in 93us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.404261:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8268 00000100:00100000:2.0:1746143140.429665:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.429692:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.429707:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.429743:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.430017:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858850688 00000100:00100000:1.0:1746143140.430027:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858850688 00002000:00100000:1.0:1746143140.430089:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009310ea00 x1830962858850688/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.430111:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310ea00 with x1830962858850688 ext(0->1048575) 00002000:00010000:1.0:1746143140.430117:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310ea00 00000100:00100000:1.0:1746143140.430135:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858850944 00000100:00100000:1.0:1746143140.430138:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858850944 00002000:00100000:1.0:1746143140.430158:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880130765880 x1830962858850944/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.430166:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130765880 with x1830962858850944 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.430170:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130765880 00000100:00100000:1.0:1746143140.430180:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858851200 00000100:00100000:1.0:1746143140.430182:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858851200 00002000:00100000:1.0:1746143140.430193:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880130764380 x1830962858851200/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.430199:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764380 with x1830962858851200 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.430202:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130764380 00000100:00100000:1.0:1746143140.430219:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858851456 00000100:00100000:1.0:1746143140.430220:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858851456 00002000:00100000:1.0:1746143140.430228:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880130767b80 x1830962858851456/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.430234:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767b80 with x1830962858851456 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.430237:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130767b80 00000100:00100000:1.0:1746143140.430248:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6285 00000100:00100000:1.0:1746143140.430255:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858850688:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143140.430650:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6286 00000100:00100000:2.0:1746143140.430659:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858850944:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143140.432317:0:21568:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6287 00000100:00100000:3.0:1746143140.432327:0:21568:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858851200:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143140.433628:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6288 00000100:00100000:3.0:1746143140.433637:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858851456:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143140.439014:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.439112:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.439121:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858851712 00000100:00100000:0.0:1746143140.439130:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858851712 00000100:00100000:0.0:1746143140.439194:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8269 00000100:00100000:0.0:1746143140.439202:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:31179:x1830962858851712:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143140.439228:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143140.439231:0:17079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143140.439268:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a529ea00/0x25aee876ca70e5b5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e06 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.439314:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143140.439318:0:17079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143140.439332:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094155e00/0x25aee876ca70e5bc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e0d expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.439575:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143140.439593:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.439600:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.439607:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143140.439649:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 200 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.439662:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 200 pid: 17079 timeout: 1022 lvb_type: 0 00000100:00100000:0.0:1746143140.439684:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861330688:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143140.439856:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.439880:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 8 pid: 14794 timeout: 1022 lvb_type: 0 00000100:00100000:0.0:1746143140.439892:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861330816:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143140.439949:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2450300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143140.439986:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858851968 00000100:00100000:0.0:1746143140.439991:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858851968 00002000:00100000:0.0:1746143140.440083:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009c1e9f80 x1830962858851968/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143140.440116:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9f80 with x1830962858851968 ext(0->1048575) 00002000:00010000:0.0:1746143140.440121:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e9f80 00000100:00100000:0.0:1746143140.440156:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6289 00000100:00100000:0.0:1746143140.440165:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858851968:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143140.445190:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.452162:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858852224 00000100:00100000:1.0:1746143140.452179:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858852224 00002000:00100000:1.0:1746143140.452234:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093b8b100 x1830962858852224/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.452244:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8b100 with x1830962858852224 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.452250:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b8b100 00000100:00100000:1.0:1746143140.452282:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6290 00000100:00100000:1.0:1746143140.452289:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858852224:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143140.455584:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.455633:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.455712:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861330688:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143140.455769:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861330816:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143140.455796:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:0.0:1746143140.455840:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.455886:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.456073:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858852736 00000100:00100000:2.0:1746143140.456081:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858852736 00002000:00100000:2.0:1746143140.456182:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880091982a00 x1830962858852736/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.456199:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982a00 with x1830962858852736 ext(1048576->2097151) 00002000:00010000:2.0:1746143140.456205:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091982a00 00000100:00100000:2.0:1746143140.456236:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858852608 00000100:00100000:2.0:1746143140.456241:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858852608 00002000:00100000:2.0:1746143140.456259:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a84e4000 x1830962858852608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.456266:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e4000 with x1830962858852608 ext(1048576->2097151) 00002000:00010000:2.0:1746143140.456270:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e4000 00000100:00100000:2.0:1746143140.456297:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6291 00000100:00100000:2.0:1746143140.456307:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858852736:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143140.458447:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6292 00000100:00100000:2.0:1746143140.458462:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858852608:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143140.461995:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858852864 00000100:00100000:1.0:1746143140.462008:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858852864 00010000:00010000:1.0:1746143140.462067:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 201 pid: 17079 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.462095:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858852992 00000100:00100000:1.0:1746143140.462109:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858852992 00010000:00010000:1.0:1746143140.462120:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 9 pid: 14794 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.462143:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6841 00000100:00100000:1.0:1746143140.462149:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858852864:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143140.462166:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143140.462171:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 201 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.462186:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 201 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.462206:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28e00/0x25aee876ca70e5ae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dff expref: 201 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.462224:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.462228:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.462235:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.462239:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143140.462285:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1969:x1830962858852864:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 137us (6447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.462290:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6841 00000100:00100000:1.0:1746143140.462304:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6842 00000100:00100000:1.0:1746143140.462307:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1969:x1830962858852992:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143140.462313:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143140.462316:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 9 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.462323:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 9 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.462333:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136035400/0x25aee876ca70e473 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d57 expref: 9 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.462341:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.462344:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.462350:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.462355:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.462371:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143140.462380:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858852992:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 72us (6496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.462384:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6842 00010000:00010000:0.0:1746143140.462517:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143140.462524:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000040:00080000:0.0:1746143140.463193:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2451, 88 off208408 00000004:00080000:0.0:1746143140.463205:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303172256ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463263:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2461, 88 off209024 00000004:00080000:0.0:1746143140.463271:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922303238964ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143140.463289:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2462, 88 off209112 00000004:00080000:0.0:1746143140.463294:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922303262446ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143140.463304:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2452, 88 off208496 00000004:00080000:0.0:1746143140.463308:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303276238ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463316:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2453, 88 off208584 00000004:00080000:0.0:1746143140.463320:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303288063ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463328:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2463, 88 off209200 00000004:00080000:0.0:1746143140.463331:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922303300061ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143140.463340:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2464, 88 off209288 00000004:00080000:0.0:1746143140.463344:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922303312204ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143140.463352:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2465, 88 off209376 00000004:00080000:0.0:1746143140.463355:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922303323615ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143140.463364:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2454, 88 off208672 00000004:00080000:0.0:1746143140.463367:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303335201ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463375:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2466, 88 off209464 00000004:00080000:0.0:1746143140.463378:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922303346270ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143140.463386:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2455, 88 off208760 00000004:00080000:0.0:1746143140.463389:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303357383ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463397:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2467, 88 off209552 00000004:00080000:0.0:1746143140.463400:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922303368970ns, next at 860119223596ns, rc = 0 00000040:00080000:0.0:1746143140.463408:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2456, 88 off208848 00000004:00080000:0.0:1746143140.463411:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303379800ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463421:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2457, 88 off208936 00000004:00080000:0.0:1746143140.463424:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303392201ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463431:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2458, 88 off209024 00000004:00080000:0.0:1746143140.463434:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303402658ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463442:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2459, 88 off209112 00000004:00080000:0.0:1746143140.463444:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303413016ns, next at 860071159912ns, rc = 0 00000040:00080000:0.0:1746143140.463453:0:17079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2468, 88 off209640 00000004:00080000:0.0:1746143140.463456:0:17079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922303424624ns, next at 860119223596ns, rc = 0 00000100:00100000:3.0:1746143140.480934:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858850944:12345-192.168.201.28@tcp:3:cat.0 Request processed in 50261us (51224us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.480950:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6286 00002000:00100000:3.0:1746143140.480965:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880130765880 x1830962858850944/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.480981:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130765880 with x1830962858850944 ext(1048576->2097151) 00002000:00010000:3.0:1746143140.480988:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130765880 00000100:00100000:3.0:1746143140.492109:0:21568:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1970:x1830962858851200:12345-192.168.201.28@tcp:3:cat.0 Request processed in 59758us (62374us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.492125:0:21568:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6287 00002000:00100000:3.0:1746143140.492141:0:21568:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff880130764380 x1830962858851200/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.492151:0:21568:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130764380 with x1830962858851200 ext(1048576->2097151) 00002000:00010000:3.0:1746143140.492157:0:21568:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130764380 00000100:00100000:1.0:1746143140.502313:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1970:x1830962858850688:12345-192.168.201.28@tcp:3:cat.0 Request processed in 72046us (72646us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.502325:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6285 00002000:00100000:1.0:1746143140.502337:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009310ea00 x1830962858850688/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.502346:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310ea00 with x1830962858850688 ext(0->1048575) 00002000:00010000:1.0:1746143140.502352:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310ea00 00000100:00100000:0.0:1746143140.525303:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858851968:12345-192.168.201.28@tcp:3:cat.0 Request processed in 85129us (86193us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143140.525318:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6289 00002000:00100000:0.0:1746143140.525334:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff88009c1e9f80 x1830962858851968/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143140.525346:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1e9f80 with x1830962858851968 ext(0->1048575) 00002000:00010000:0.0:1746143140.525353:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1e9f80 00000100:00100000:0.0:1746143140.525560:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.525731:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858853120 00000100:00100000:1.0:1746143140.525740:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858853120 00000100:00100000:2.0:1746143140.528079:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858851456:12345-192.168.201.28@tcp:3:cat.0 Request processed in 94437us (98329us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143140.528091:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6288 00002000:00100000:2.0:1746143140.528112:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880130767b80 x1830962858851456/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.528122:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130767b80 with x1830962858851456 ext(1048576->2097151) 00002000:00010000:2.0:1746143140.528128:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130767b80 00000100:00100000:1.0:1746143140.528464:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8270 00000100:00100000:2.0:1746143140.528471:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858852224:12345-192.168.201.28@tcp:3:cat.0 Request processed in 76183us (83293us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.528475:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31184:x1830962858853120:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:2.0:1746143140.528477:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6290 00002000:00100000:2.0:1746143140.528484:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093b8b100 x1830962858852224/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.528491:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b8b100 with x1830962858852224 ext(1048576->2097151) 00010000:00010000:1.0:1746143140.528493:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746143140.528494:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b8b100 00010000:00010000:1.0:1746143140.528512:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e14 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.528566:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.528576:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 4/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.528592:0:14795:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143140.528603:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.528615:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.528618:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143140.528621:0:14795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.528627:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132051000, rc 0) 00000100:00100000:1.0:1746143140.528647:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31184:x1830962858853120:12345-192.168.201.28@tcp:101:cat.0 Request processed in 175us (3089us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.528653:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8270 00000100:00100000:0.0:1746143140.541285:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858852736:12345-192.168.201.28@tcp:3:cat.0 Request processed in 84967us (85938us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143140.541299:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6291 00002000:00100000:0.0:1746143140.541315:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880091982a00 x1830962858852736/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143140.541325:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091982a00 with x1830962858852736 ext(1048576->2097151) 00002000:00010000:0.0:1746143140.541332:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091982a00 00010000:00010000:1.0:1746143140.545119:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143140.549024:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.549087:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858853248 00000100:00100000:1.0:1746143140.549106:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858853248 00000100:00100000:1.0:1746143140.549153:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8271 00000100:00100000:1.0:1746143140.549161:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31183:x1830962858853248:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143140.549182:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.549208:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70e5d1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e1b expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.549273:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70e5d1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e1b expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.549285:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70e5d1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e1b expref: 201 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.549297:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143140.549301:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143140.549304:0:14795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 12 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.549315:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132050e00, rc 0) 00000100:00100000:1.0:1746143140.549623:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31183:x1830962858853248:12345-192.168.201.28@tcp:101:cat.0 Request processed in 461us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.549630:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8271 00000100:00100000:2.0:1746143140.551926:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858852608:12345-192.168.201.28@tcp:3:cat.0 Request processed in 93465us (96289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143140.551937:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6292 00002000:00100000:2.0:1746143140.551947:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff8800a84e4000 x1830962858852608/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.551957:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e4000 with x1830962858852608 ext(1048576->2097151) 00002000:00010000:2.0:1746143140.551962:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a84e4000 00010000:00010000:3.0:1746143140.557416:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e0d expref: 13 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.557431:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143140.557434:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143140.557439:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.557448:0:17079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.557454:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.557460:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70e5d1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e1b expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.557472:0:17079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70e5d1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e1b expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.557478:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70e5d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e1b expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.557806:0:17079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70e5d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e1b expref: 200 pid: 14795 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.557821:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861330944:192.168.201.28@tcp:105: 00000001:00080000:1.0:1746143140.557893:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942495 is committed 00000004:00080000:1.0:1746143140.557903:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1885 committed 00000004:00080000:1.0:1746143140.557912:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1881 committed 00000004:00080000:1.0:1746143140.557917:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1880 committed 00000004:00080000:1.0:1746143140.557919:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1879 committed 00000004:00080000:1.0:1746143140.557920:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1878 committed 00000004:00080000:1.0:1746143140.557922:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1884 committed 00000004:00080000:1.0:1746143140.557923:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1877 committed 00000004:00080000:1.0:1746143140.557924:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1883 committed 00000004:00080000:1.0:1746143140.557925:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1876 committed 00000004:00080000:1.0:1746143140.557927:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1882 committed 00000004:00080000:1.0:1746143140.557928:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1881 committed 00000004:00080000:1.0:1746143140.557930:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1880 committed 00000004:00080000:1.0:1746143140.557933:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1875 committed 00000004:00080000:1.0:1746143140.557934:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1874 committed 00000004:00080000:1.0:1746143140.557936:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1879 committed 00000004:00080000:1.0:1746143140.557937:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1878 committed 00000004:00080000:1.0:1746143140.557939:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1873 committed 00000001:00080000:1.0:1746143140.557954:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942490 is committed 00000001:00080000:1.0:1746143140.557958:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942491 is committed 00000001:00080000:1.0:1746143140.557969:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942494 is committed 00010000:00010000:3.0:1746143140.558068:0:17079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 10 pid: 14795 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.558077:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861332096:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143140.558110:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.558159:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861331456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143140.558198:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.558220:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861331968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143140.558235:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.558248:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861332608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143140.558264:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.558276:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861333120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143140.558341:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861331072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143140.558364:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143140.558382:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861331584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143140.558396:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143140.558406:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861332224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143140.558419:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143140.558630:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861332736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143140.558631:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861331456 00000100:00100000:0.0:1746143140.558638:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861331456 00000100:00100000:1.0:1746143140.558644:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143140.558667:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861331968 00000100:00100000:1.0:1746143140.558669:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861331968 00000100:00100000:0.0:1746143140.558671:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861332608 00000100:00100000:0.0:1746143140.558673:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861332608 00000100:00100000:1.0:1746143140.558683:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861331072 00000100:00100000:1.0:1746143140.558685:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861331072 00000100:00100000:0.0:1746143140.558685:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861331584 00000100:00100000:0.0:1746143140.558686:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861331584 00000100:00100000:1.0:1746143140.558693:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861332224 00000100:00100000:1.0:1746143140.558695:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861332224 00000100:00100000:0.0:1746143140.558696:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861332736 00000100:00100000:0.0:1746143140.558698:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861332736 00000100:00100000:1.0:1746143140.558705:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12873 00000100:00100000:2.0:1746143140.558917:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.558941:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861331200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143140.558959:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.558967:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861331712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143140.558983:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.558990:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861332352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143140.559002:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.559009:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861332864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143140.559023:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.559056:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746143140.559061:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861331328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143140.559078:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.559087:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861331840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143140.559111:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.559118:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861332480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143140.559130:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.559136:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861332992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143140.559147:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143140.559166:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861333120 00000100:00100000:2.0:1746143140.559169:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861333120 00000100:00100000:0.0:1746143140.559250:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12874 00000100:00100000:0.0:1746143140.559258:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3301:x1830962861331968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143140.560137:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3301:x1830962861331456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143140.560193:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861331200 00000100:00100000:1.0:1746143140.560196:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861331200 00000100:00100000:1.0:1746143140.560208:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861331712 00000100:00100000:1.0:1746143140.560210:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861331712 00000100:00100000:1.0:1746143140.560217:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861332352 00000100:00100000:1.0:1746143140.560218:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861332352 00000100:00100000:2.0:1746143140.560220:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861332864 00000100:00100000:2.0:1746143140.560223:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861332864 00000100:00100000:1.0:1746143140.560225:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861331328 00000100:00100000:1.0:1746143140.560226:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861331328 00000100:00100000:2.0:1746143140.560232:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861331840 00000100:00100000:1.0:1746143140.560232:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861332480 00000100:00100000:2.0:1746143140.560233:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861331840 00000100:00100000:1.0:1746143140.560233:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861332480 00000100:00100000:2.0:1746143140.560239:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861332992 00000100:00100000:2.0:1746143140.560241:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861332992 00000100:00100000:1.0:1746143140.560241:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12875 00000100:00100000:1.0:1746143140.560247:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3301:x1830962861332608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143140.560248:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12876 00000100:00100000:2.0:1746143140.560252:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3302:x1830962861331072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143140.560299:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12877 00000100:00100000:2.0:1746143140.560304:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3302:x1830962861331584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143140.560403:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861332608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (2137us total) trans 21474840123 rc 0/0 00000100:00100000:1.0:1746143140.560409:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12875 00000004:00080000:2.0:1746143140.560422:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314f100/2, rc 0, transno 21474840123 00000100:00100000:1.0:1746143140.560426:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12878 00000100:00100000:2.0:1746143140.560429:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861332608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143140.560430:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861332224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143140.560466:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861333248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143140.560485:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746143140.560510:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143140.560514:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143136 -> 1746143136 00002000:00010000:1.0:1746143140.560516:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143136 -> 1746143136 00002000:00010000:1.0:1746143140.560518:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143136 -> 1746143136 00002000:00010000:1.0:1746143140.560520:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1999 -> 1999 00000100:00100000:1.0:1746143140.560862:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861332224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (2120us total) trans 21474840124 rc 0/0 00000100:00100000:1.0:1746143140.560870:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12878 00000100:00100000:1.0:1746143140.560886:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861333248 00000100:00100000:1.0:1746143140.560891:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861333248 00000100:00100000:1.0:1746143140.560909:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12879 00000100:00100000:1.0:1746143140.560915:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861332736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143140.561027:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3302:x1830962861332736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (2380us total) trans 21474840125 rc 0/0 00000100:00100000:1.0:1746143140.561062:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12879 00000100:00100000:1.0:1746143140.561078:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12880 00000100:00100000:1.0:1746143140.561085:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861333120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143140.561723:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3301:x1830962861333120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 639us (2805us total) trans 21474840126 rc 0/0 00000100:00100000:1.0:1746143140.561729:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12880 00000100:00100000:1.0:1746143140.561740:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12881 00000004:00080000:2.0:1746143140.561743:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e680/2, rc 0, transno 21474840124 00000100:00100000:1.0:1746143140.561744:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3299:x1830962861331200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143140.561747:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861332224:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143140.561928:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314e300/2, rc 0, transno 21474840125 00000100:00100000:2.0:1746143140.561931:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861332736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143140.561974:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861331968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2717us (3737us total) trans 17179872860 rc 0/0 00000100:00100000:0.0:1746143140.561980:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12874 00000004:00080000:3.0:1746143140.561984:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135182300/2, rc 0, transno 17179872860 00000100:00100000:3.0:1746143140.561988:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861331968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143140.561990:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12882 00000004:00080000:3.0:1746143140.561995:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314ea00/2, rc 0, transno 21474840126 00000100:00100000:0.0:1746143140.561996:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3299:x1830962861331712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143140.561997:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861333120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143140.562053:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12883 00000100:00100000:1.0:1746143140.562059:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861332352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143140.562114:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3299:x1830962861331712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (3129us total) trans 17179872861 rc 0/0 00000100:00100000:0.0:1746143140.562120:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12882 00000100:00100000:0.0:1746143140.562129:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12884 00000100:00100000:0.0:1746143140.562133:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3299:x1830962861332864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143140.562149:0:8169:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143140.562152:0:8169:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143140.562154:0:8169:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143140.562156:0:8169:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143134 -> 1746143134 00002000:00010000:1.0:1746143140.562159:0:8169:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746143140.562177:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3299:x1830962861332352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (3174us total) trans 21474840127 rc 0/0 00000100:00100000:1.0:1746143140.562183:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12883 00000100:00100000:1.0:1746143140.562192:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12885 00000100:00100000:1.0:1746143140.562197:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3299:x1830962861331328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143140.562205:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3299:x1830962861332864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (3180us total) trans 21474840128 rc 0/0 00000100:00100000:0.0:1746143140.562210:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12884 00000100:00100000:0.0:1746143140.562218:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12886 00000100:00100000:0.0:1746143140.562222:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3299:x1830962861331840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143140.562238:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12887 00000100:00100000:1.0:1746143140.562243:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861332480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143140.562289:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3299:x1830962861331840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (3177us total) trans 17179872862 rc 0/0 00000100:00100000:0.0:1746143140.562294:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12886 00000100:00100000:0.0:1746143140.562304:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12888 00000100:00100000:0.0:1746143140.562308:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3299:x1830962861332992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143140.562310:0:21048:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:1.0:1746143140.562313:0:21048:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.562315:0:21048:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.562316:0:21048:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.562318:0:21048:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:1.0:1746143140.562336:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3299:x1830962861332480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (3204us total) trans 21474840129 rc 0/0 00000100:00100000:1.0:1746143140.562341:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12887 00000100:00100000:1.0:1746143140.562350:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12889 00000100:00100000:1.0:1746143140.562354:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3302:x1830962861333248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143140.562365:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143140.562368:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143140.562370:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143140.562371:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143140.562373:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143140.562391:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3299:x1830962861332992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (3242us total) trans 21474840130 rc 0/0 00000100:00100000:0.0:1746143140.562395:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12888 00000004:00080000:2.0:1746143140.562492:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135183100/2, rc 0, transno 17179872862 00000100:00100000:2.0:1746143140.562496:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861331840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143140.562502:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314d180/2, rc 0, transno 21474840129 00000100:00100000:2.0:1746143140.562504:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861332480:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143140.562509:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314df80/2, rc 0, transno 21474840130 00000100:00100000:2.0:1746143140.562512:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861332992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143140.562517:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135181f80/2, rc 0, transno 17179872861 00000100:00100000:2.0:1746143140.562520:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861331712:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143140.562524:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314c380/2, rc 0, transno 21474840127 00000100:00100000:2.0:1746143140.562526:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861332352:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143140.562532:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009314fb80/2, rc 0, transno 21474840128 00000100:00100000:2.0:1746143140.562534:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861332864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143140.562646:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3302:x1830962861333248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (2159us total) trans 21474840131 rc 0/0 00000100:00100000:1.0:1746143140.562653:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12889 00000004:00080000:3.0:1746143140.562941:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092aefb80/2, rc 0, transno 21474840131 00000100:00100000:3.0:1746143140.562947:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861333248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143140.563065:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.563083:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.563223:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3301:x1830962861331456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4512us (5025us total) trans 17179872863 rc 0/0 00000100:00100000:1.0:1746143140.563229:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12873 00000100:00100000:1.0:1746143140.563250:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858853504 00000100:00100000:1.0:1746143140.563254:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858853504 00000100:00100000:1.0:1746143140.563275:0:14798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858853376 00000100:00100000:1.0:1746143140.563277:0:14798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858853376 00000100:00100000:1.0:1746143140.563299:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3508 00000100:00100000:1.0:1746143140.563304:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31183:x1830962858853504:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:1.0:1746143140.563389:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31183:x1830962858853504:12345-192.168.201.28@tcp:49:cat.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.563394:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3508 00000100:00100000:1.0:1746143140.563405:0:14798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3509 00000100:00100000:1.0:1746143140.563409:0:14798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31184:x1830962858853376:12345-192.168.201.28@tcp:49:cat.0 00000100:00100000:1.0:1746143140.563443:0:14798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31184:x1830962858853376:12345-192.168.201.28@tcp:49:cat.0 Request processed in 33us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.563448:0:14798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3509 00002000:00010000:1.0:1746143140.563520:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143140.563522:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.563524:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.563526:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.563527:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143140.563599:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861332096:192.168.201.28@tcp:105: 00000004:00080000:3.0:1746143140.563623:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b88000/2, rc 0, transno 17179872863 00000100:00100000:3.0:1746143140.563628:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861331456:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143140.564055:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143140.564059:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143137 -> 1746143137 00002000:00010000:2.0:1746143140.564062:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143137 -> 1746143137 00002000:00010000:2.0:1746143140.564064:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143137 -> 1746143137 00002000:00010000:2.0:1746143140.564065:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143140.564119:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3302:x1830962861331072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3864us (5752us total) trans 17179872865 rc 0/0 00000100:00100000:2.0:1746143140.564125:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12876 00000100:00100000:2.0:1746143140.564235:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3302:x1830962861331584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3928us (5834us total) trans 17179872866 rc 0/0 00000100:00100000:2.0:1746143140.564241:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12877 00000004:00080000:3.0:1746143140.564358:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e4700/2, rc 0, transno 17179872865 00000100:00100000:3.0:1746143140.564364:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861331072:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143140.564375:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b8a300/2, rc 0, transno 17179872866 00000100:00100000:3.0:1746143140.564378:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861331584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143140.564455:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3299:x1830962861331200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2710us (5494us total) trans 17179872864 rc 0/0 00000100:00100000:1.0:1746143140.564460:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12881 00000100:00100000:3.0:1746143140.564759:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861330944:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143140.564795:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094155e00/0x25aee876ca70e5bc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e0d expref: 10 pid: 17079 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143140.564813:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e0d expref: 9 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.564836:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094154800, rc 0) 00000100:00100000:3.0:1746143140.565054:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31179:x1830962858851712:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 125852us (126049us total) trans 8589942495 rc 0/0 00000100:00100000:3.0:1746143140.565061:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8269 00002000:00010000:1.0:1746143140.565194:0:8169:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143140.565197:0:8169:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.565199:0:8169:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.565201:0:8169:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143137 -> 1746143137 00002000:00010000:1.0:1746143140.565202:0:8169:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143140.565224:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3299:x1830962861331328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3027us (6145us total) trans 17179872867 rc 0/0 00000100:00100000:1.0:1746143140.565229:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12885 00000004:00080000:2.0:1746143140.565285:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e5c00/2, rc 0, transno 17179872867 00000100:00100000:2.0:1746143140.565289:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861331328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143140.565295:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a84e4a80/2, rc 0, transno 17179872864 00000100:00100000:2.0:1746143140.565298:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861331200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143140.573822:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.573896:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858853632 00000100:00100000:1.0:1746143140.573905:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858853632 00000100:00100000:1.0:1746143140.577210:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12890 00000100:00100000:1.0:1746143140.577227:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:31179:x1830962858853632:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143140.577248:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.577269:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e22 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.577300:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.577308:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 26 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.577315:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 23 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.577320:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.577322:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.577326:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2916352->3145727] (req 2916352->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 23 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.577357:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 23 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.577368:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 23 pid: 754 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.577381:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861333376:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143140.577673:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 26 pid: 20836 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.577682:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 26 pid: 20836 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.577690:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861333504:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143140.577711:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 7 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.577720:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 7 pid: 4756 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.577728:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861333632:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.577741:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143140.579116:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.579176:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858853888 00000100:00100000:2.0:1746143140.579183:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858853888 00002000:00100000:2.0:1746143140.579222:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012baa3b80 x1830962858853888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.579231:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa3b80 with x1830962858853888 ext(1048576->2097151) 00002000:00010000:2.0:1746143140.579236:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa3b80 00000100:00100000:2.0:1746143140.579263:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6293 00000100:00100000:2.0:1746143140.579268:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858853888:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143140.583801:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.583802:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a709c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861333376:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.583814:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861333504:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143140.583831:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.583852:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858854016 00000100:00100000:2.0:1746143140.583858:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858854016 00000100:00100000:0.0:1746143140.583859:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.583876:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858854272 00000100:00100000:0.0:1746143140.583878:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858854272 00010000:00010000:2.0:1746143140.583890:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 26 pid: 754 timeout: 1022 lvb_type: 1 00010000:00010000:0.0:1746143140.583890:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 8 pid: 4756 timeout: 1022 lvb_type: 1 00000100:00100000:0.0:1746143140.583912:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858854144 00000100:00100000:0.0:1746143140.583914:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858854144 00010000:00010000:0.0:1746143140.583923:0:7113:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 27 pid: 20836 timeout: 1022 lvb_type: 1 00000100:00100000:2.0:1746143140.584694:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6843 00000100:00100000:2.0:1746143140.584703:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858854272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.584716:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143140.584739:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 8 pid: 4756 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.584749:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 8 pid: 4756 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.584775:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143140.584807:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1970:x1830962858854272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 107us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.584813:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6843 00000100:00100000:2.0:1746143140.584826:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6844 00000100:00100000:2.0:1746143140.584830:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858854016:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.584836:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143140.584842:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 26 pid: 754 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.584850:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 26 pid: 754 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.584859:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e553 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc7 expref: 26 pid: 754 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.584885:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143140.584898:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1970:x1830962858854016:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 67us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.584904:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6844 00000100:00100000:2.0:1746143140.584914:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6845 00000100:00100000:2.0:1746143140.584919:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858854144:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.584927:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143140.584934:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 27 pid: 20836 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.584943:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 27 pid: 20836 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.584954:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a529fe00/0x25aee876ca70e592 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df1 expref: 27 pid: 20836 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.585627:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094576c00/0x25aee876ca70e4ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d88 expref: 7 pid: 4756 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.586430:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.586432:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.586440:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.587338:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.587380:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.587393:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093914380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861333760:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143140.587452:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143140.587809:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861333632:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143140.588012:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.588022:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b201200, rc 0) 00000100:00100000:1.0:1746143140.588070:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31179:x1830962858853632:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 10848us (14261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.588078:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12890 00000100:00100000:2.0:1746143140.589670:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.589700:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858854528 00000100:00100000:0.0:1746143140.589709:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858854528 00002000:00100000:0.0:1746143140.589743:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093917b80 x1830962858854528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143140.589787:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093917b80 with x1830962858854528 ext(1048576->2097151) 00002000:00010000:0.0:1746143140.589962:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093917b80 00000100:00100000:0.0:1746143140.589991:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6294 00000100:00100000:0.0:1746143140.589998:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858854528:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143140.599135:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093914380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:4759:1830962861333760:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143140.599158:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143140.599206:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858854144:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 14285us (15344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.599218:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6845 00000100:00100000:2.0:1746143140.599797:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1968:x1830962858853888:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 20526us (20685us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143140.599805:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6293 00002000:00100000:2.0:1746143140.599818:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff88012baa3b80 x1830962858853888/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.599828:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa3b80 with x1830962858853888 ext(1048576->2097151) 00002000:00010000:2.0:1746143140.599834:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa3b80 00000100:00100000:0.0:1746143140.600167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.603152:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858854528:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13145us (13477us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.603165:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6294 00002000:00100000:1.0:1746143140.603175:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x303:0x0] (1048576->2097151) req@ffff880093917b80 x1830962858854528/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.603184:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093917b80 with x1830962858854528 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.603190:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093917b80 00000100:00100000:1.0:1746143140.603212:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858854784 00000100:00100000:1.0:1746143140.603220:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858854784 00002000:00100000:1.0:1746143140.603258:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2916352->2920447) req@ffff88012baa3100 x1830962858854784/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.603265:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa3100 with x1830962858854784 ext(2916352->2920447) 00002000:00010000:1.0:1746143140.603269:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa3100 00000100:00100000:1.0:1746143140.603300:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6295 00000100:00100000:1.0:1746143140.603320:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858854784:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143140.603518:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1971:x1830962858854784:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 208us (3348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143140.603524:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6295 00002000:00100000:1.0:1746143140.603531:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2916352->2920447) req@ffff88012baa3100 x1830962858854784/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.603537:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa3100 with x1830962858854784 ext(2916352->2920447) 00002000:00010000:1.0:1746143140.603540:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa3100 00000100:00100000:0.0:1746143140.607948:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.608070:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858854912 00000100:00100000:1.0:1746143140.608079:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858854912 00000100:00100000:1.0:1746143140.609154:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12891 00000100:00100000:1.0:1746143140.609163:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:31179:x1830962858854912:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143140.609183:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.609202:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e29 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.609234:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.609242:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 16 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.609249:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 19 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.609255:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.609256:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.609259:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 16 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.609289:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 19 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.609300:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 19 pid: 10061 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.609312:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861333888:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143140.611507:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 16 pid: 22204 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.611521:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 16 pid: 22204 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.611533:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861334016:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143140.611760:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:1.0:1746143140.611870:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143140.611879:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 7 pid: 8448 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.611888:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861334144:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.611909:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.612148:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858855168 00000100:00100000:2.0:1746143140.612156:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858855168 00002000:00100000:2.0:1746143140.612199:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012baa0700 x1830962858855168/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.612208:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0700 with x1830962858855168 ext(1048576->2097151) 00002000:00010000:2.0:1746143140.612213:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa0700 00000100:00100000:2.0:1746143140.612239:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6296 00000100:00100000:2.0:1746143140.612245:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858855168:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143140.617089:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.617139:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.617274:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858855424 00000100:00100000:1.0:1746143140.617282:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858855424 00002000:00100000:1.0:1746143140.617327:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88012baa3480 x1830962858855424/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.617338:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa3480 with x1830962858855424 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.617344:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa3480 00000100:00100000:1.0:1746143140.617372:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858855680 00000100:00100000:1.0:1746143140.617375:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858855680 00002000:00100000:1.0:1746143140.617389:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012baa1180 x1830962858855680/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.617403:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa1180 with x1830962858855680 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.617407:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa1180 00000100:00100000:1.0:1746143140.617420:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6297 00000100:00100000:1.0:1746143140.617426:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858855424:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143140.620007:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6298 00000100:00100000:1.0:1746143140.620019:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858855680:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143140.625337:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861333888:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143140.627197:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.627260:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858855808 00000100:00100000:3.0:1746143140.627268:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858855808 00010000:00010000:3.0:1746143140.627306:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 20 pid: 10061 timeout: 1022 lvb_type: 1 00000100:00100000:3.0:1746143140.627341:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6846 00000100:00100000:3.0:1746143140.627349:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858855808:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143140.627362:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143140.627386:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 20 pid: 10061 timeout: 1022 lvb_type: 1 00010000:00010000:3.0:1746143140.627396:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 20 pid: 10061 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.627401:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861334016:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.627410:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861334144:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143140.627417:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a529e600/0x25aee876ca70e584 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dea expref: 20 pid: 10061 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.627436:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.627438:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143140.627445:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc0c00, rc 0) 00000100:00100000:3.0:1746143140.627471:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858855808:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.627479:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6846 00000100:00100000:1.0:1746143140.628250:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31179:x1830962858854912:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 19086us (20309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.628258:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12891 00000100:00100000:0.0:1746143140.630125:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.633201:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.633683:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858856064 00000100:00100000:1.0:1746143140.633693:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858856064 00000100:00100000:3.0:1746143140.633715:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858855936 00000100:00100000:3.0:1746143140.633719:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858855936 00010000:00010000:1.0:1746143140.633929:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 8 pid: 8448 timeout: 1022 lvb_type: 1 00010000:00010000:3.0:1746143140.633937:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 18 pid: 22204 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.633963:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6847 00000100:00100000:1.0:1746143140.633971:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858856064:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143140.633984:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6848 00010000:00010000:1.0:1746143140.633985:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143140.633990:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858855936:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143140.633997:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143140.634008:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 18 pid: 22204 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.634008:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 8 pid: 8448 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.634018:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 8 pid: 8448 timeout: 1022 lvb_type: 1 00010000:00010000:3.0:1746143140.634050:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 18 pid: 22204 timeout: 1022 lvb_type: 1 00010000:00010000:3.0:1746143140.634071:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094154c00/0x25aee876ca70e5a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dc0 expref: 18 pid: 22204 timeout: 1022 lvb_type: 1 00010000:00010000:3.0:1746143140.634086:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143140.634136:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858855936:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 145us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.634142:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6848 00010000:00010000:1.0:1746143140.634255:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b5d5e00/0x25aee876ca70e4a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d81 expref: 8 pid: 8448 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.634275:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.634278:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.634285:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 16 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.634294:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 16 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.634323:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 16 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143140.634334:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861334272:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143140.634387:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.635343:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858855168:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 23096us (23582us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143140.635351:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6296 00002000:00100000:2.0:1746143140.635362:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012baa0700 x1830962858855168/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.635372:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0700 with x1830962858855168 ext(1048576->2097151) 00002000:00010000:2.0:1746143140.635377:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa0700 00000100:00100000:0.0:1746143140.641294:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.644231:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858856320 00000100:00100000:3.0:1746143140.644244:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858856320 00002000:00100000:3.0:1746143140.644296:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3403776->3407871) req@ffff88012baa0380 x1830962858856320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.644306:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0380 with x1830962858856320 ext(3403776->3407871) 00002000:00010000:3.0:1746143140.644312:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0380 00000100:00100000:3.0:1746143140.644339:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6299 00000100:00100000:3.0:1746143140.644348:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1970:x1830962858856320:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143140.644665:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858855424:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 27234us (27774us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.644674:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6297 00002000:00100000:1.0:1746143140.644682:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88012baa3480 x1830962858855424/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.644690:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa3480 with x1830962858855424 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.644694:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa3480 00000100:00100000:0.0:1746143140.644701:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861334272:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143140.645049:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1970:x1830962858856320:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 702us (3768us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143140.645055:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6299 00002000:00100000:3.0:1746143140.645059:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3403776->3407871) req@ffff88012baa0380 x1830962858856320/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.645071:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa0380 with x1830962858856320 ext(3403776->3407871) 00002000:00010000:3.0:1746143140.645074:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa0380 00010000:00010000:0.0:1746143140.645215:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143140.645241:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858856064:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 11270us (15120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143140.645250:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6847 00000100:00100000:1.0:1746143140.647753:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858855680:12345-192.168.201.28@tcp:3:cat.0 Request processed in 27732us (30608us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.647762:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6298 00002000:00100000:1.0:1746143140.647768:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x304:0x0] (1048576->2097151) req@ffff88012baa1180 x1830962858855680/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.647776:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa1180 with x1830962858855680 ext(1048576->2097151) 00002000:00010000:1.0:1746143140.647781:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baa1180 00000100:00100000:0.0:1746143140.649141:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.649194:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858856448 00000100:00100000:1.0:1746143140.649201:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858856448 00000100:00100000:1.0:1746143140.649800:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12892 00000100:00100000:1.0:1746143140.649807:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:31182:x1830962858856448:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:1.0:1746143140.649822:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143140.649840:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e30 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.649866:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 14 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.649875:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143140.649877:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143140.649880:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.650477:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 14 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.650489:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 14 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.650500:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861334400:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.651078:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143140.653137:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861334400:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143140.653167:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.653182:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dc1a00, rc 0) 00000100:00100000:1.0:1746143140.653215:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:31182:x1830962858856448:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3407us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.653223:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12892 00000100:00100000:0.0:1746143140.657277:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.657334:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.657591:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858856704 00000100:00100000:2.0:1746143140.657600:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858856704 00000100:00100000:1.0:1746143140.657618:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858856576 00000100:00100000:1.0:1746143140.657622:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858856576 00002000:00100000:1.0:1746143140.657707:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3407871) req@ffff88012baa2d80 x1830962858856576/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.657719:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa2d80 with x1830962858856576 ext(3145728->3407871) 00010000:00010000:1.0:1746143140.657728:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 16 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.657748:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 16 pid: 8169 timeout: 1022 lvb_type: 0 00002000:00010000:1.0:1746143140.657755:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012baa2d80 00000100:00100000:2.0:1746143140.657799:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12893 00000100:00100000:2.0:1746143140.657808:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31184:x1830962858856704:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.657822:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.657836:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e37 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.657862:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143140.657868:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.657874:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143140.657877:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143140.657903:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2044 00000100:00100000:1.0:1746143140.657909:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858856576:12345-192.168.201.28@tcp:4:multiop.0 00010000:00010000:2.0:1746143140.658388:0:8169:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.658402:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.658412:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090153600, rc 0) 00000100:00100000:2.0:1746143140.658466:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31184:x1830962858856704:12345-192.168.201.28@tcp:101:cat.0 Request processed in 659us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.658472:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12893 00000100:00100000:0.0:1746143140.658716:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.658913:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858856960 00000100:00100000:3.0:1746143140.658918:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858856960 00002000:00100000:3.0:1746143140.658939:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88012baa2a00 x1830962858856960/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.658947:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa2a00 with x1830962858856960 ext(1048576->2097151) 00002000:00010000:3.0:1746143140.658951:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa2a00 00000100:00100000:3.0:1746143140.658962:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6300 00000100:00100000:3.0:1746143140.658968:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858856960:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143140.668207:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858856576:12345-192.168.201.28@tcp:4:multiop.0 Request processed in 10285us (10928us total) trans 21474840132 rc 0/0 00000100:00100000:1.0:1746143140.668221:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2044 00002000:00100000:1.0:1746143140.668235:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3407871) req@ffff88012baa2d80 x1830962858856576/t21474840132(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/448 e 0 to 0 dl 1746143151 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.668246:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa2d80 with x1830962858856576 ext(3145728->3407871) 00010000:00010000:1.0:1746143140.668258:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 18 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.668272:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 18 pid: 8169 timeout: 1022 lvb_type: 0 00002000:00010000:1.0:1746143140.668279:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012baa2d80 00000100:00100000:3.0:1746143140.668841:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858856960:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 9870us (10123us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.668850:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6300 00002000:00100000:3.0:1746143140.668856:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff88012baa2a00 x1830962858856960/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.668865:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baa2a00 with x1830962858856960 ext(1048576->2097151) 00002000:00010000:3.0:1746143140.669061:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baa2a00 00000100:00100000:0.0:1746143140.673712:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.673766:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.673790:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858857088 00000100:00100000:2.0:1746143140.673799:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858857088 00010000:00010000:2.0:1746143140.673832:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 18 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:0.0:1746143140.673857:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.674062:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6849 00000100:00100000:2.0:1746143140.674071:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858857088:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.674086:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143140.674118:0:9869:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143137 -> 1746143139 00002000:00010000:2.0:1746143140.674121:0:9869:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143137 -> 1746143139 00010000:00010000:2.0:1746143140.674127:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 18 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.674134:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858857344 00010000:00010000:2.0:1746143140.674140:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 18 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.674143:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858857344 00010000:00010000:2.0:1746143140.674164:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dc0c00/0x25aee876ca70e5df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e29 expref: 18 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.674167:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858857216 00000100:00100000:3.0:1746143140.674169:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858857216 00000100:00100000:3.0:1746143140.674185:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12894 00010000:00010000:2.0:1746143140.674187:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.674189:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143140.674191:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858857344:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.674197:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.674210:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.674210:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.674225:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e5f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e45 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.674245:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.674257:0:9869:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.674260:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861334784:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143140.674267:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093914380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861334656:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143140.674345:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143140.674361:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.674361:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12895 00000100:00100000:2.0:1746143140.674368:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858857216:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.674376:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.674383:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090152800/0x25aee876ca70e5fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e3e expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.674408:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861334912:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143140.674486:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143140.677616:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.677665:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093914380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861334656:192.168.201.28@tcp:105: 00002000:00010000:2.0:1746143140.677670:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143137 -> 1746143139 00010000:00010000:3.0:1746143140.677686:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143140.677693:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861334912:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143140.677722:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090152800/0x25aee876ca70e5fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e3e expref: 21 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143140.677737:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858857088:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3662us (4031us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143140.677741:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090152800/0x25aee876ca70e5fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e3e expref: 21 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143140.677747:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6849 00010000:00010000:2.0:1746143140.677750:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090152800, rc 0) 00000100:00100000:2.0:1746143140.677775:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858857216:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3408us (3918us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143140.677782:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12895 00002000:00010000:3.0:1746143140.677792:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime: 1746143137 -> 1746143139 00002000:00010000:3.0:1746143140.677795:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143137 -> 1746143139 00002000:00010000:3.0:1746143140.677797:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime: 1746143137 -> 1746143139 00000100:00100000:3.0:1746143140.677810:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861334784:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143140.677831:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858857600 00000100:00100000:2.0:1746143140.677836:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858857600 00010000:00010000:3.0:1746143140.677838:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e5f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e45 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143140.677849:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a523d200/0x25aee876ca70e5f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e45 expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143140.677873:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a523d200, rc 0) 00002000:00100000:2.0:1746143140.677877:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2940928->2945023) req@ffff8801317b4700 x1830962858857600/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.677885:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b4700 with x1830962858857600 ext(2940928->2945023) 00010000:00010000:2.0:1746143140.677892:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.677898:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858857344:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3707us (4131us total) trans 0 rc 301/301 00010000:00010000:2.0:1746143140.677903:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.677907:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12894 00002000:00010000:2.0:1746143140.677909:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317b4700 00000100:00100000:2.0:1746143140.677939:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2045 00000100:00100000:2.0:1746143140.677946:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858857600:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143140.678148:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858857600:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 203us (542us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143140.678154:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2045 00002000:00100000:2.0:1746143140.678161:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2940928->2945023) req@ffff8801317b4700 x1830962858857600/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746143151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.678167:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b4700 with x1830962858857600 ext(2940928->2945023) 00010000:00010000:2.0:1746143140.678172:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.678180:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 20 pid: 8169 timeout: 1022 lvb_type: 0 00002000:00010000:2.0:1746143140.678186:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317b4700 00000100:00100000:0.0:1746143140.680690:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.680734:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858857728 00000100:00100000:3.0:1746143140.680739:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858857728 00000100:00100000:3.0:1746143140.680773:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12896 00000100:00100000:3.0:1746143140.680780:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:31183:x1830962858857728:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143140.680793:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.680806:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e4c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.680829:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143140.680834:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.680846:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 21 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.680855:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c6e000, rc 0) 00000100:00100000:3.0:1746143140.680893:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31183:x1830962858857728:12345-192.168.201.28@tcp:101:cat.0 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.680899:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12896 00000100:00100000:0.0:1746143140.682197:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.682419:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858858112 00000100:00100000:3.0:1746143140.682424:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858858112 00000100:00100000:3.0:1746143140.682457:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12897 00000100:00100000:3.0:1746143140.682463:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:31182:x1830962858858112:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:0.0:1746143140.682471:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143140.682473:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.682695:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e53 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.682706:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858857984 00000100:00100000:2.0:1746143140.682711:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858857984 00010000:00010000:3.0:1746143140.682713:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 21 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.682719:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143140.682720:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143140.682723:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->2830335] (req 2097152->2830335) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143140.682736:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2940928->3145727) req@ffff8801317b5500 x1830962858857984/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143140.682744:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 21 pid: 8169 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143140.682745:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b5500 with x1830962858857984 ext(2940928->3145727) 00010000:00010000:2.0:1746143140.682752:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 21 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.682754:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 21 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.682763:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861335040:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143140.682763:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 21 pid: 8169 timeout: 1022 lvb_type: 0 00002000:00010000:2.0:1746143140.682769:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317b5500 00000100:00100000:2.0:1746143140.682796:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2046 00000100:00100000:2.0:1746143140.682801:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858857984:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143140.682832:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143140.683716:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861335040:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143140.683734:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->2830335] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.683744:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c6f800, rc 0) 00000100:00100000:3.0:1746143140.683768:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:31182:x1830962858858112:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 1304us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.683774:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12897 00000100:00100000:2.0:1746143140.684348:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.684383:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858858240 00000100:00100000:1.0:1746143140.684389:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858858240 00002000:00100000:1.0:1746143140.684420:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2916352->3145727) req@ffff880092a73480 x1830962858858240/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.684429:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73480 with x1830962858858240 ext(2916352->3145727) 00010000:00010000:1.0:1746143140.684436:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 22 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.684445:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 22 pid: 8169 timeout: 1022 lvb_type: 0 00002000:00010000:1.0:1746143140.684451:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a73480 00000100:00100000:1.0:1746143140.684477:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2047 00000100:00100000:1.0:1746143140.684483:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+22:1969:x1830962858858240:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143140.686467:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858857984:12345-192.168.201.28@tcp:4:cat.0 Request processed in 3659us (3988us total) trans 21474840133 rc 0/0 00000100:00100000:2.0:1746143140.686478:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2046 00002000:00100000:2.0:1746143140.686486:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2940928->3145727) req@ffff8801317b5500 x1830962858857984/t21474840133(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/448 e 0 to 0 dl 1746143151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.686495:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b5500 with x1830962858857984 ext(2940928->3145727) 00010000:00010000:2.0:1746143140.686503:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 23 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.686514:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 23 pid: 8169 timeout: 1022 lvb_type: 0 00002000:00010000:2.0:1746143140.686521:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317b5500 00000100:00100000:0.0:1746143140.689680:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.689736:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858858368 00000100:00100000:3.0:1746143140.689745:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858858368 00010000:00010000:3.0:1746143140.689775:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 23 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.689806:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6850 00000100:00100000:3.0:1746143140.689812:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858858368:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143140.689825:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143140.689844:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 23 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.689855:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 23 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.689876:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dc1a00/0x25aee876ca70e5e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e30 expref: 23 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.689888:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.689890:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.689898:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 16 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.689906:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 16 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.689914:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.689915:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.689918:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.689930:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.689959:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.689970:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861335168:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143140.690073:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 16 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.690081:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861335296:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143140.690114:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143140.691323:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858858240:12345-192.168.201.28@tcp:4:cat.0 Request processed in 6837us (6974us total) trans 17179872868 rc 0/0 00000100:00100000:1.0:1746143140.691333:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2047 00002000:00100000:1.0:1746143140.691342:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2916352->3145727) req@ffff880092a73480 x1830962858858240/t17179872868(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/448 e 0 to 0 dl 1746143151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.691351:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a73480 with x1830962858858240 ext(2916352->3145727) 00010000:00010000:1.0:1746143140.691359:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.691371:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 1022 lvb_type: 0 00002000:00010000:1.0:1746143140.691377:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a73480 00000100:00100000:3.0:1746143140.691859:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861335168:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143140.691868:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861335296:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143140.691882:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143140.691901:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858858368:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2088us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.691909:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6850 00000100:00100000:2.0:1746143140.695317:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.695585:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858858496 00000100:00100000:3.0:1746143140.695595:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858858496 00010000:00010000:3.0:1746143140.695626:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.695654:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6851 00000100:00100000:3.0:1746143140.695661:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1970:x1830962858858496:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143140.695675:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143140.695697:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.695710:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.695732:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b201200/0x25aee876ca70e5d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e22 expref: 24 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.695745:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.695747:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.695754:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.695762:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.695792:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.695802:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861335424:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143140.695876:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143140.696757:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.697057:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858858752 00000100:00100000:1.0:1746143140.697062:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858858752 00002000:00100000:1.0:1746143140.697106:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8801317b6d80 x1830962858858752/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.697122:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b6d80 with x1830962858858752 ext(2097152->3145727) 00002000:00010000:1.0:1746143140.697128:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b6d80 00000100:00100000:0.0:1746143140.697201:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.697327:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6301 00000100:00100000:1.0:1746143140.697625:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858858752:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143140.697986:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858859008 00000100:00100000:2.0:1746143140.697990:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858859008 00002000:00100000:2.0:1746143140.698011:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8801317b5880 x1830962858859008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.698020:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b5880 with x1830962858859008 ext(2097152->3145727) 00002000:00010000:2.0:1746143140.698024:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b5880 00000100:00100000:2.0:1746143140.698054:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6302 00000100:00100000:2.0:1746143140.698060:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858859008:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143140.698074:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861335424:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143140.698090:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143140.698133:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1970:x1830962858858496:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2472us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.698141:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6851 00000100:00100000:0.0:1746143140.703726:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.703797:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858859264 00000100:00100000:3.0:1746143140.703806:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858859264 00002000:00100000:3.0:1746143140.703852:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2826240->2830335) req@ffff8801317b4380 x1830962858859264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.703863:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b4380 with x1830962858859264 ext(2826240->2830335) 00002000:00010000:3.0:1746143140.703869:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317b4380 00000100:00100000:3.0:1746143140.703902:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6303 00000100:00100000:3.0:1746143140.703910:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858859264:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143140.704511:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858859264:12345-192.168.201.28@tcp:3:cat.0 Request processed in 599us (793us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143140.704519:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6303 00002000:00100000:3.0:1746143140.704526:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2826240->2830335) req@ffff8801317b4380 x1830962858859264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.704533:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b4380 with x1830962858859264 ext(2826240->2830335) 00002000:00010000:3.0:1746143140.704537:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317b4380 00000100:00100000:2.0:1746143140.706983:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858859008:12345-192.168.201.28@tcp:3:cat.0 Request processed in 8913us (9771us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143140.706995:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6302 00002000:00100000:2.0:1746143140.707004:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8801317b5880 x1830962858859008/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.707014:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b5880 with x1830962858859008 ext(2097152->3145727) 00002000:00010000:2.0:1746143140.707019:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b5880 00000100:00100000:1.0:1746143140.707693:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858858752:12345-192.168.201.28@tcp:3:cat.0 Request processed in 10357us (10936us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143140.707702:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6301 00002000:00100000:1.0:1746143140.707708:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8801317b6d80 x1830962858858752/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.707716:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b6d80 with x1830962858858752 ext(2097152->3145727) 00002000:00010000:1.0:1746143140.707720:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317b6d80 00000100:00100000:0.0:1746143140.712410:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.712745:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858859520 00000100:00100000:1.0:1746143140.712755:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858859520 00002000:00100000:1.0:1746143140.712801:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2830336->3145727) req@ffff8801317b6a00 x1830962858859520/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.712812:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b6a00 with x1830962858859520 ext(2830336->3145727) 00002000:00010000:1.0:1746143140.712818:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317b6a00 00000100:00100000:2.0:1746143140.713179:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6304 00000100:00100000:2.0:1746143140.713221:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1970:x1830962858859520:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143140.714695:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.715494:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858859776 00000100:00100000:1.0:1746143140.715501:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858859776 00002000:00100000:1.0:1746143140.715529:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008f576a00 x1830962858859776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.715539:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576a00 with x1830962858859776 ext(3145728->4194303) 00002000:00010000:1.0:1746143140.715544:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f576a00 00000100:00100000:1.0:1746143140.715571:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6305 00000100:00100000:1.0:1746143140.715578:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858859776:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143140.718714:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.718792:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858860032 00000100:00100000:3.0:1746143140.718799:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858860032 00002000:00100000:3.0:1746143140.718834:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008f577b80 x1830962858860032/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.718844:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577b80 with x1830962858860032 ext(3145728->4194303) 00002000:00010000:3.0:1746143140.718849:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f577b80 00000100:00100000:3.0:1746143140.719112:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6306 00000100:00100000:3.0:1746143140.719121:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858860032:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143140.722264:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.722327:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858860160 00000100:00100000:2.0:1746143140.722337:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858860160 00000100:00100000:2.0:1746143140.722600:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12898 00000100:00100000:2.0:1746143140.722607:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:31184:x1830962858860160:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.722623:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.722643:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e5a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.722673:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.722682:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143140.722684:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143140.722687:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.722718:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.722731:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143140.722749:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861335552:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143140.722831:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.722971:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1970:x1830962858859520:12345-192.168.201.28@tcp:3:cat.0 Request processed in 9783us (10571us total) trans 0 rc 315392/315392 00000100:00100000:2.0:1746143140.722980:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6304 00002000:00100000:2.0:1746143140.722988:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2830336->3145727) req@ffff8801317b6a00 x1830962858859520/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 315392/315392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.722997:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317b6a00 with x1830962858859520 ext(2830336->3145727) 00010000:00010000:2.0:1746143140.723002:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 28 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.723011:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 28 pid: 8449 timeout: 1022 lvb_type: 0 00002000:00010000:2.0:1746143140.723018:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801317b6a00 00000100:00100000:3.0:1746143140.727353:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861335552:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143140.727385:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.727404:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245400, rc 0) 00000100:00100000:3.0:1746143140.728912:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31184:x1830962858860160:12345-192.168.201.28@tcp:101:cat.0 Request processed in 6303us (6655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.728913:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1970:x1830962858859776:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13327us (14215us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.728922:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12898 00000100:00100000:1.0:1746143140.728924:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6305 00002000:00100000:1.0:1746143140.728936:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88008f576a00 x1830962858859776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.728947:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576a00 with x1830962858859776 ext(3145728->4194303) 00002000:00010000:1.0:1746143140.728953:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f576a00 00000100:00100000:2.0:1746143140.729020:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.729071:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858860288 00000100:00100000:1.0:1746143140.729077:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858860288 00002000:00100000:1.0:1746143140.729118:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2830335) req@ffff880092a71180 x1830962858860288/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.729126:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71180 with x1830962858860288 ext(2097152->2830335) 00010000:00010000:1.0:1746143140.729133:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.729148:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00002000:00010000:1.0:1746143140.729154:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a71180 00000100:00100000:1.0:1746143140.729170:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2048 00000100:00100000:1.0:1746143140.729177:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858860288:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143140.730562:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1970:x1830962858860032:12345-192.168.201.28@tcp:3:cat.0 Request processed in 11436us (11852us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.730569:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6306 00002000:00100000:3.0:1746143140.730576:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008f577b80 x1830962858860032/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.730584:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f577b80 with x1830962858860032 ext(3145728->4194303) 00010000:00010000:3.0:1746143140.730590:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.730602:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00002000:00010000:3.0:1746143140.731698:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f577b80 00000100:00100000:2.0:1746143140.732454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.732524:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858860416 00000100:00100000:3.0:1746143140.732532:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858860416 00000100:00100000:3.0:1746143140.732570:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12899 00000100:00100000:3.0:1746143140.732577:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:31183:x1830962858860416:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143140.732594:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.732611:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e61 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.732636:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143140.732639:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143140.732643:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 30 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.732653:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 30 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.732664:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7b000, rc 0) 00000100:00100000:3.0:1746143140.732696:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:31183:x1830962858860416:12345-192.168.201.28@tcp:101:cat.0 Request processed in 118us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.732702:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12899 00000100:00100000:1.0:1746143140.742700:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858860288:12345-192.168.201.28@tcp:4:cat.0 Request processed in 13510us (13666us total) trans 17179872869 rc 0/0 00000100:00100000:1.0:1746143140.742713:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2048 00002000:00100000:1.0:1746143140.742725:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2830335) req@ffff880092a71180 x1830962858860288/t17179872869(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/448 e 0 to 0 dl 1746143151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.742734:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a71180 with x1830962858860288 ext(2097152->2830335) 00010000:00010000:1.0:1746143140.742744:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 30 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143140.742760:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 30 pid: 8449 timeout: 1022 lvb_type: 0 00002000:00010000:1.0:1746143140.742767:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a71180 00000100:00100000:0.0:1746143140.749012:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.749081:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858860544 00000100:00100000:3.0:1746143140.749102:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858860544 00010000:00010000:3.0:1746143140.749139:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 30 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.749175:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6852 00000100:00100000:3.0:1746143140.749183:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1971:x1830962858860544:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143140.749198:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143140.749220:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 30 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.749238:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 30 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.749261:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129c6f800/0x25aee876ca70e609 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e53 expref: 30 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143140.749277:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.749278:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.749286:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.749293:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.749300:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.749301:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.749303:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.749308:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.749336:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.749348:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861335680:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143140.749438:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143140.749446:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861335808:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143140.749465:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143140.755431:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861335680:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143140.755441:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861335808:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143140.755464:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143140.755526:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1971:x1830962858860544:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 6342us (6523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.755537:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6852 00000100:00100000:0.0:1746143140.761584:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.761678:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.761721:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.762662:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858860800 00000100:00100000:3.0:1746143140.762674:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858860800 00002000:00100000:3.0:1746143140.762721:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008f574a80 x1830962858860800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.762731:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574a80 with x1830962858860800 ext(3145728->4194303) 00002000:00010000:3.0:1746143140.762737:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f574a80 00000100:00100000:3.0:1746143140.762959:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858861056 00000100:00100000:3.0:1746143140.762963:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858861056 00002000:00100000:3.0:1746143140.762975:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008f575500 x1830962858861056/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.762982:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575500 with x1830962858861056 ext(2097152->3145727) 00002000:00010000:3.0:1746143140.762985:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f575500 00000100:00100000:3.0:1746143140.763001:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858861312 00000100:00100000:3.0:1746143140.763003:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858861312 00002000:00100000:3.0:1746143140.763013:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008f576680 x1830962858861312/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.763019:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576680 with x1830962858861312 ext(3145728->4194303) 00002000:00010000:3.0:1746143140.763021:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f576680 00000100:00100000:3.0:1746143140.763052:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6307 00000100:00100000:3.0:1746143140.763059:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858860800:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143140.763213:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6308 00000100:00100000:0.0:1746143140.763220:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1969:x1830962858861056:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143140.765050:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6309 00000100:00100000:1.0:1746143140.765069:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858861312:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143140.770627:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.770684:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858861568 00000100:00100000:3.0:1746143140.770693:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858861568 00002000:00100000:3.0:1746143140.770740:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094514380 x1830962858861568/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.770750:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514380 with x1830962858861568 ext(3145728->4194303) 00002000:00010000:3.0:1746143140.770756:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094514380 00000100:00100000:3.0:1746143140.770780:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6310 00000100:00100000:3.0:1746143140.770787:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858861568:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143140.788717:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858861056:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25486us (27027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143140.788729:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6308 00002000:00100000:2.0:1746143140.788742:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88008f575500 x1830962858861056/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.788752:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f575500 with x1830962858861056 ext(2097152->3145727) 00002000:00010000:2.0:1746143140.788759:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f575500 00000100:00100000:3.0:1746143140.793295:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1968:x1830962858860800:12345-192.168.201.28@tcp:3:cat.0 Request processed in 30224us (31709us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.793307:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6307 00002000:00100000:3.0:1746143140.793318:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008f574a80 x1830962858860800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.793327:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f574a80 with x1830962858860800 ext(3145728->4194303) 00002000:00010000:3.0:1746143140.793333:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f574a80 00000100:00100000:0.0:1746143140.800247:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.800315:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858861824 00000100:00100000:3.0:1746143140.800326:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858861824 00000100:00100000:3.0:1746143140.800381:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8272 00000100:00100000:3.0:1746143140.800390:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:31188:x1830962858861824:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143140.800415:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.800825:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b800/0x25aee876ca70e61e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e68 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.800949:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.800962:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143140.800964:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858861312:12345-192.168.201.28@tcp:3:cat.0 Request processed in 35905us (39240us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746143140.800972:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143140.800974:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6309 00002000:00100000:1.0:1746143140.800983:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008f576680 x1830962858861312/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143140.800985:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.800990:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00002000:00100000:1.0:1746143140.800992:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f576680 with x1830962858861312 ext(3145728->4194303) 00010000:00010000:3.0:1746143140.800995:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00002000:00010000:1.0:1746143140.800997:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f576680 00010000:00010000:3.0:1746143140.801118:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70e633 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801125:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70e633 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801130:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70e633 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143140.801138:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143140.801665:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801673:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801680:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801686:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132f7bc00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143140.801690:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801696:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801706:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143140.801709:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143140.801713:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801717:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7bc00/0x25aee876ca70e625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801735:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801815:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801820:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801824:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132f7ae00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143140.801826:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801834:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801840:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a497f500) 00010000:00010000:3.0:1746143140.801842:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143140.801844:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801848:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7ae00/0x25aee876ca70e62c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.801887:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7b800/0x25aee876ca70e61e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e68 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.801897:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70e633 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e68 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.801903:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143140.801905:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143140.801907:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f7a800, rc 0) 00000100:00100000:3.0:1746143140.802596:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31188:x1830962858861824:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 2205us (2360us total) trans 8589942496 rc 0/0 00000100:00100000:3.0:1746143140.802604:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8272 00000100:00100000:3.0:1746143140.807288:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858861568:12345-192.168.201.28@tcp:3:cat.0 Request processed in 36487us (36657us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143140.807300:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6310 00002000:00100000:3.0:1746143140.807314:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff880094514380 x1830962858861568/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.807329:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094514380 with x1830962858861568 ext(3145728->4194303) 00002000:00010000:3.0:1746143140.807335:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094514380 00000100:00100000:0.0:1746143140.807918:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.807968:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.808121:0:31431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858862080 00000100:00100000:3.0:1746143140.808128:0:31431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858862080 00002000:00100000:3.0:1746143140.808162:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008eb74700 x1830962858862080/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.808170:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74700 with x1830962858862080 ext(4194304->5210111) 00002000:00010000:3.0:1746143140.808174:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb74700 00000100:00100000:3.0:1746143140.808201:0:31431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6311 00000100:00100000:3.0:1746143140.808208:0:31431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858862080:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143140.809543:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858862336 00000100:00100000:2.0:1746143140.809549:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858862336 00000100:00100000:2.0:1746143140.809595:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3510 00000100:00100000:2.0:1746143140.809602:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:31188:x1830962858862336:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143140.810027:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31188:x1830962858862336:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 425us (2058us total) trans 8589942497 rc 0/0 00000100:00100000:2.0:1746143140.810047:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3510 00000100:00100000:0.0:1746143140.819479:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.820159:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858862592 00000100:00100000:1.0:1746143140.820168:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858862592 00002000:00100000:1.0:1746143140.820212:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008eb77100 x1830962858862592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.820222:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77100 with x1830962858862592 ext(4194304->5210111) 00002000:00010000:1.0:1746143140.820228:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb77100 00000100:00100000:1.0:1746143140.820392:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6312 00000100:00100000:1.0:1746143140.820400:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858862592:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143140.820452:0:31431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858862080:12345-192.168.201.28@tcp:3:cat.0 Request processed in 12243us (12534us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143140.820460:0:31431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6311 00002000:00100000:3.0:1746143140.820467:0:31431:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008eb74700 x1830962858862080/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143140.820474:0:31431:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb74700 with x1830962858862080 ext(4194304->5210111) 00002000:00010000:3.0:1746143140.820478:0:31431:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb74700 00000100:00100000:0.0:1746143140.836154:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.836275:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858862848 00000100:00100000:1.0:1746143140.836284:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858862848 00000100:00100000:1.0:1746143140.836335:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3511 00000100:00100000:1.0:1746143140.836341:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f1f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31183:x1830962858862848:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:1.0:1746143140.836737:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f1f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31183:x1830962858862848:12345-192.168.201.28@tcp:35:cat.0 Request processed in 395us (595us total) trans 8589942498 rc 0/0 00000100:00100000:1.0:1746143140.836743:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3511 00000100:00100000:2.0:1746143140.837376:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1969:x1830962858862592:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16975us (17907us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143140.837385:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6312 00002000:00100000:2.0:1746143140.837394:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88008eb77100 x1830962858862592/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.837404:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb77100 with x1830962858862592 ext(4194304->5210111) 00002000:00010000:2.0:1746143140.837410:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb77100 00000100:00100000:0.0:1746143140.851455:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.851562:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858863104 00000100:00100000:3.0:1746143140.851571:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858863104 00000100:00100000:3.0:1746143140.851616:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8273 00000100:00100000:3.0:1746143140.851624:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31190:x1830962858863104:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143140.851648:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.851666:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90600/0x25aee876ca70e641 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e6f expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.851774:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.851979:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.851990:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.852000:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.852005:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.852010:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855384:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90c00/0x25aee876ca70e656 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855402:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90c00/0x25aee876ca70e656 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855414:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90c00/0x25aee876ca70e656 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143140.855426:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143140.855523:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855529:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855539:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855545:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d90800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143140.855549:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855556:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855569:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143140.855571:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143140.855575:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855580:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855609:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855615:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855620:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855624:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d90a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143140.855627:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855632:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855641:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a497f600) 00010000:00010000:3.0:1746143140.855643:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143140.855646:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855650:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90a00/0x25aee876ca70e64f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.855698:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90600/0x25aee876ca70e641 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e6f expref: 203 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.855710:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90c00/0x25aee876ca70e656 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e6f expref: 202 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.855716:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143140.855718:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143140.855721:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d90c00, rc 0) 00000100:00100000:3.0:1746143140.855795:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31190:x1830962858863104:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4170us (4350us total) trans 8589942499 rc 0/0 00000100:00100000:3.0:1746143140.855803:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8273 00000100:00100000:0.0:1746143140.858193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.858465:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858863360 00000100:00100000:3.0:1746143140.858474:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858863360 00000100:00100000:3.0:1746143140.858524:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3512 00000100:00100000:3.0:1746143140.858530:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+12:31184:x1830962858863360:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:3.0:1746143140.858714:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31184:x1830962858863360:12345-192.168.201.28@tcp:35:cat.0 Request processed in 183us (529us total) trans 8589942500 rc 0/0 00000100:00100000:3.0:1746143140.858721:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3512 00000100:00100000:0.0:1746143140.862318:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.862387:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858863616 00000100:00100000:3.0:1746143140.862397:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858863616 00000100:00100000:3.0:1746143140.863023:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3513 00000100:00100000:3.0:1746143140.863078:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31190:x1830962858863616:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143140.863324:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:31190:x1830962858863616:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 290us (1011us total) trans 8589942501 rc 0/0 00000100:00100000:3.0:1746143140.863331:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3513 00000100:00100000:0.0:1746143140.869702:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.871354:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858863744 00000100:00100000:2.0:1746143140.871365:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858863744 00000100:00100000:2.0:1746143140.871632:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12900 00000100:00100000:2.0:1746143140.871640:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31190:x1830962858863744:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143140.871658:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.871674:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e76 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.871706:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.871719:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 23 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.871726:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.871730:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.871732:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.871735:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1302528->1384447] (req 1302528->1384447) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.871760:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 16 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.871771:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 16 pid: 754 timeout: 1022 lvb_type: 1 00000100:00100000:2.0:1746143140.871781:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861335936:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143140.872346:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 23 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.872354:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 23 pid: 10061 timeout: 1022 lvb_type: 1 00000100:00100000:2.0:1746143140.872362:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861336064:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143140.872390:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.872397:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 6 pid: 8449 timeout: 1022 lvb_type: 1 00000100:00100000:2.0:1746143140.872402:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861336192:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143140.872414:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.875749:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861336064:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143140.881726:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.882337:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858863872 00000100:00100000:2.0:1746143140.882349:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858863872 00010000:00010000:2.0:1746143140.882584:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 7 pid: 8449 timeout: 1022 lvb_type: 1 00000100:00100000:2.0:1746143140.882617:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6853 00000100:00100000:2.0:1746143140.882624:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858863872:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.882638:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143140.882663:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 7 pid: 8449 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.882673:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 7 pid: 8449 timeout: 1022 lvb_type: 1 00010000:00010000:2.0:1746143140.882694:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143140.882750:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858863872:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 125us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.882758:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6853 00000100:00100000:3.0:1746143140.883102:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861335936:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143140.883119:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094576a00/0x25aee876ca70e49d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d7a expref: 6 pid: 8449 timeout: 1022 lvb_type: 1 00000100:00100000:3.0:1746143140.883140:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861336192:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143140.883174:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [1302528->1384447] (req 1302528->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.883188:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f13200, rc 0) 00000100:00100000:3.0:1746143140.883226:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:31190:x1830962858863744:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 11586us (13535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.883234:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12900 00000100:00100000:0.0:1746143140.883625:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.883677:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.883723:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.883772:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858864000 00000100:00100000:3.0:1746143140.883777:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858864000 00000100:00100000:1.0:1746143140.883967:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858864128 00000100:00100000:1.0:1746143140.883971:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858864128 00010000:00010000:1.0:1746143140.883988:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 18 pid: 754 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.884007:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858864256 00000100:00100000:1.0:1746143140.884009:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858864256 00010000:00010000:1.0:1746143140.884017:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 23 pid: 10061 timeout: 1022 lvb_type: 1 00000100:00100000:1.0:1746143140.884049:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6854 00000100:00100000:1.0:1746143140.884054:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858864128:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143140.884065:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143140.884097:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 18 pid: 754 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.884108:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 18 pid: 754 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.884128:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a523c000/0x25aee876ca70e54c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db9 expref: 18 pid: 754 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.884141:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143140.884162:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1968:x1830962858864128:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 108us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.884168:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6854 00000100:00100000:1.0:1746143140.884180:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6855 00000100:00100000:1.0:1746143140.884184:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858864256:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143140.884191:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143140.884197:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 23 pid: 10061 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.884206:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 23 pid: 10061 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.884224:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a529ee00/0x25aee876ca70e57d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650de3 expref: 23 pid: 10061 timeout: 1022 lvb_type: 1 00010000:00010000:1.0:1746143140.884239:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.884241:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143140.884248:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 22 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.884256:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 22 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143140.884285:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 22 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143140.884296:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861336320:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143140.884336:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143140.884727:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12901 00000100:00100000:3.0:1746143140.884734:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31188:x1830962858864000:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:3.0:1746143140.884746:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.884758:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e7d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.884776:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.884785:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.884790:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.884792:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143140.884795:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.884811:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.884821:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.884829:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861336448:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143140.885524:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.885533:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143140.885541:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861336576:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143140.885868:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094515c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861336320:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143140.885881:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143140.885896:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858864256:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1711us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143140.885903:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6855 00000100:00100000:3.0:1746143140.886238:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.886708:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.886727:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858864512 00000100:00100000:2.0:1746143140.886731:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858864512 00002000:00100000:2.0:1746143140.886764:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1302528->1306623) req@ffff8800a84e7480 x1830962858864512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.886772:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e7480 with x1830962858864512 ext(1302528->1306623) 00002000:00010000:2.0:1746143140.886776:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e7480 00000100:00100000:2.0:1746143140.886964:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6313 00000100:00100000:2.0:1746143140.886969:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858864512:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143140.887281:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861336448:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143140.888420:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858864512:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 1449us (1711us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143140.888427:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6313 00002000:00100000:2.0:1746143140.888434:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1302528->1306623) req@ffff8800a84e7480 x1830962858864512/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.888442:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a84e7480 with x1830962858864512 ext(1302528->1306623) 00002000:00010000:2.0:1746143140.888446:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a84e7480 00000100:00100000:3.0:1746143140.889140:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861336576:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143140.889167:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.889182:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d90e00, rc 0) 00000100:00100000:3.0:1746143140.889209:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31188:x1830962858864000:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 4476us (5585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143140.889216:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12901 00000100:00100000:1.0:1746143140.892306:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.892760:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858864640 00000100:00100000:2.0:1746143140.892768:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858864640 00010000:00010000:2.0:1746143140.892800:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143140.892837:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6856 00000100:00100000:2.0:1746143140.892844:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858864640:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.892858:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143140.893067:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.893079:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.893111:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129c6e000/0x25aee876ca70e602 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e4c expref: 22 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:0.0:1746143140.893336:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143140.893954:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143140.894008:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858864640:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1163us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.894015:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6856 00000100:00100000:0.0:1746143140.894420:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.894700:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858865024 00000100:00100000:2.0:1746143140.894704:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858865024 00010000:00010000:2.0:1746143140.894724:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143140.894805:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858864896 00000100:00100000:1.0:1746143140.894809:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858864896 00002000:00100000:1.0:1746143140.894839:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1380352->1384447) req@ffff88008eb76300 x1830962858864896/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.894847:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb76300 with x1830962858864896 ext(1380352->1384447) 00002000:00010000:1.0:1746143140.894851:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb76300 00000100:00100000:2.0:1746143140.895166:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6857 00000100:00100000:2.0:1746143140.895173:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1971:x1830962858865024:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.895184:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143140.895202:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.895213:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.895232:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090153600/0x25aee876ca70e5ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e37 expref: 17 pid: 8169 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.895244:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.895246:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.895252:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.895260:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.895287:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.895296:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a84e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861336704:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143140.895348:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143140.895779:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6314 00000100:00100000:1.0:1746143140.895950:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858864896:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143140.899751:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858864896:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 3951us (6400us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143140.899766:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6314 00002000:00100000:1.0:1746143140.899780:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1380352->1384447) req@ffff88008eb76300 x1830962858864896/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.899790:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eb76300 with x1830962858864896 ext(1380352->1384447) 00002000:00010000:1.0:1746143140.899797:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eb76300 00000100:00100000:2.0:1746143140.900075:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a84e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861336704:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143140.900109:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143140.901005:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858865024:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5828us (6582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.901016:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6857 00000100:00100000:2.0:1746143140.903282:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.903399:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858865152 00000100:00100000:3.0:1746143140.903409:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858865152 00000100:00100000:2.0:1746143140.903739:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12902 00000100:00100000:2.0:1746143140.903750:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a84e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:31188:x1830962858865152:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143140.903966:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.903984:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e84 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.904016:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.904025:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.905808:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.905810:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.905816:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->2146303] (req 2097152->2146303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.906153:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.906168:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 28 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143140.906180:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861336832:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143140.907643:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.907652:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 25 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143140.907667:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861336960:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143140.908252:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.910350:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861336832:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143140.910361:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861336960:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143140.910385:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->2146303] (req 2097152->2146303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 25 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.910402:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309f3400, rc 0) 00000100:00100000:2.0:1746143140.911708:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a84e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:31188:x1830962858865152:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 7958us (8430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.911718:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12902 00000100:00100000:0.0:1746143140.913144:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.913196:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.914137:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858865280 00000100:00100000:2.0:1746143140.914146:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858865280 00010000:00010000:2.0:1746143140.914181:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143140.914211:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858865408 00000100:00100000:2.0:1746143140.914214:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858865408 00010000:00010000:2.0:1746143140.914226:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 25 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143140.914251:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6858 00000100:00100000:2.0:1746143140.914259:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:1969:x1830962858865280:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.914272:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143140.914297:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.914309:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.914331:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f7b000/0x25aee876ca70e617 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e61 expref: 29 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.914349:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143140.914394:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009535dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858865280:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 136us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.914400:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6858 00000100:00100000:2.0:1746143140.914412:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6859 00000100:00100000:2.0:1746143140.914416:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+25:1968:x1830962858865408:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143140.914421:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143140.914428:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 25 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.914436:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 25 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.914449:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093245400/0x25aee876ca70e610 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e5a expref: 25 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143140.914458:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.914459:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143140.914467:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.914475:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143140.914503:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.914514:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861337088:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143140.914563:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143140.917318:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143140.917814:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861337088:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143140.917833:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143140.917874:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858865408:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3456us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143140.917885:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6859 00000100:00100000:1.0:1746143140.918437:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858865664 00000100:00100000:1.0:1746143140.918444:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858865664 00002000:00100000:1.0:1746143140.918657:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2142208->2146303) req@ffff8800906a5500 x1830962858865664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.918667:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5500 with x1830962858865664 ext(2142208->2146303) 00002000:00010000:1.0:1746143140.918672:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a5500 00000100:00100000:1.0:1746143140.918701:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6315 00000100:00100000:1.0:1746143140.918706:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858865664:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143140.918865:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1969:x1830962858865664:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 158us (1557us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143140.918871:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6315 00002000:00100000:1.0:1746143140.918877:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2142208->2146303) req@ffff8800906a5500 x1830962858865664/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143140.919574:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a5500 with x1830962858865664 ext(2142208->2146303) 00002000:00010000:1.0:1746143140.919579:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800906a5500 00000100:00100000:0.0:1746143140.960952:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.961014:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858865920 00000100:00100000:3.0:1746143140.961024:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858865920 00000100:00100000:3.0:1746143140.961106:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8274 00000100:00100000:3.0:1746143140.961114:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+203:31197:x1830962858865920:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143140.961137:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143140.961154:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e679 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e8b expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.961263:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961275:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961285:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961301:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961307:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961311:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961408:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e68e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961416:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e68e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961420:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e68e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143140.961429:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143140.961504:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961511:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961517:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961522:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d91800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143140.961525:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961531:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961541:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143140.961544:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143140.961547:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.961552:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91800/0x25aee876ca70e680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.962518:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.962526:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.962530:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.962534:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d91a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143140.962536:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.962540:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.962547:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a497f500) 00010000:00010000:3.0:1746143140.962549:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143140.962551:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.962555:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e687 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.962592:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e8b expref: 206 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.962604:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e68e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e8b expref: 205 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.962610:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143140.962612:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143140.962614:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d91c00, rc 0) 00000100:00100000:3.0:1746143140.962670:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:31197:x1830962858865920:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1557us (1729us total) trans 8589942502 rc 0/0 00000100:00100000:3.0:1746143140.962675:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8274 00000100:00100000:0.0:1746143140.970778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.970808:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.970847:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143140.970881:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858866304 00000100:00100000:0.0:1746143140.970888:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858866304 00000100:00100000:0.0:1746143140.970933:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 621 00000100:00100000:0.0:1746143140.970939:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:1971:x1830962858866304:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143140.970951:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143140.970974:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e68e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e8b expref: 205 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143140.971004:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143140.971008:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143140.971062:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:1971:x1830962858866304:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 123us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143140.971068:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 621 00000100:00100000:2.0:1746143140.971188:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858866048 00000100:00100000:2.0:1746143140.971192:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858866048 00000100:00100000:2.0:1746143140.971214:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858866176 00000100:00100000:2.0:1746143140.971215:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858866176 00000100:00100000:2.0:1746143140.971228:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12903 00000100:00100000:2.0:1746143140.971233:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858866048:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.971248:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.971262:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309f3000/0x25aee876ca70e69c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e92 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.971304:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861337216:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143140.971360:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143140.971381:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12904 00000100:00100000:2.0:1746143140.971385:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858866176:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143140.971392:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143140.971400:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309f2600/0x25aee876ca70e6a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650e99 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143140.971422:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861337344:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143140.971438:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143140.974075:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861337344:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143140.974134:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801309f2600/0x25aee876ca70e6a3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e99 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143140.974148:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309f2600/0x25aee876ca70e6a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e99 expref: 29 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143140.974162:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309f2600, rc 0) 00000100:00100000:3.0:1746143140.974217:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858866176:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2829us (3406us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143140.974225:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12904 00000100:00100000:2.0:1746143140.974325:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861337216:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143140.974343:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309f3000/0x25aee876ca70e69c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e92 expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.974351:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309f3000/0x25aee876ca70e69c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e92 expref: 22 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143140.974364:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309f3000, rc 0) 00000100:00100000:2.0:1746143140.974384:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858866048:12345-192.168.201.28@tcp:101:cat.0 Request processed in 3150us (3616us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143140.974389:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12903 00000100:00100000:2.0:1746143140.987887:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143140.987918:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.987935:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858866560 00000100:00100000:1.0:1746143140.987944:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143140.987945:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858866560 00000100:00100000:2.0:1746143140.987988:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858866944 00000100:00100000:2.0:1746143140.987991:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858866944 00000100:00100000:3.0:1746143140.987992:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8275 00000100:00100000:3.0:1746143140.988000:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+13:31200:x1830962858866560:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143140.988021:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746143140.988026:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094515c00 x1830962858866944/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 504/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.988058:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515c00 with x1830962858866944 ext(1048576->2097151) 00010000:00010000:3.0:1746143140.988059:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91e00/0x25aee876ca70e6aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ea0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143140.988063:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094515c00 00000100:00100000:2.0:1746143140.988075:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858866816 00000100:00100000:2.0:1746143140.988078:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858866816 00002000:00100000:2.0:1746143140.988099:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880094515f80 x1830962858866816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/0 e 0 to 0 dl 1746143151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143140.988106:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515f80 with x1830962858866816 ext(0->1048575) 00002000:00010000:2.0:1746143140.988109:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094515f80 00000100:00100000:2.0:1746143140.988127:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6316 00000100:00100000:2.0:1746143140.988132:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858866944:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143140.988903:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6317 00000100:00100000:2.0:1746143140.988913:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858866816:12345-192.168.201.28@tcp:3:cat.0 00010000:00010000:3.0:1746143140.989183:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989197:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989208:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989219:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989223:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989228:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989330:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e6bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989339:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e6bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989344:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e6bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:3.0:1746143140.989353:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:3.0:1746143140.989443:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989450:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989457:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989462:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d91c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143140.989466:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989472:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989483:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143140.989486:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143140.989489:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989494:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91c00/0x25aee876ca70e6b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989522:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989527:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989532:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989537:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d91200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143140.989539:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989544:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989555:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a497f600) 00010000:00010000:3.0:1746143140.989557:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143140.989559:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989563:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91200/0x25aee876ca70e6b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143140.989605:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91e00/0x25aee876ca70e6aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ea0 expref: 16 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.989615:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e6bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ea0 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143140.989622:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143140.989624:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143140.989627:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d91a00, rc 0) 00000100:00100000:3.0:1746143140.989680:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:31200:x1830962858866560:12345-192.168.201.28@tcp:101:cat.0 Request processed in 1680us (1806us total) trans 8589942503 rc 0/0 00000100:00100000:3.0:1746143140.989687:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8275 00000100:00100000:0.0:1746143141.001227:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.001274:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.001295:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858867200 00000100:00100000:2.0:1746143141.001304:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858867200 00000100:00100000:2.0:1746143141.001377:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12905 00000100:00100000:2.0:1746143141.001591:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858867200:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143141.001613:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.001632:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931f8600/0x25aee876ca70e6cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ea7 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143141.001691:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861337472:192.168.201.28@tcp:106: 00000100:00100000:2.0:1746143141.001776:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143141.001849:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858867328 00000100:00100000:1.0:1746143141.001854:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858867328 00000100:00100000:1.0:1746143141.001888:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 622 00000100:00100000:1.0:1746143141.001893:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858867328:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143141.001904:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143141.001926:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e6bf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ea0 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.001945:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143141.001949:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143141.001971:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858867328:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 77us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.001984:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 622 00000100:00080000:0.0:1746143141.002149:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143141.002153:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143141.008581:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858866944:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20436us (20651us total) trans 0 rc 966656/966656 00000100:00100000:2.0:1746143141.008595:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6316 00002000:00100000:2.0:1746143141.008608:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff880094515c00 x1830962858866944/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 504/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 966656/966656 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.008618:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515c00 with x1830962858866944 ext(1048576->2097151) 00002000:00010000:2.0:1746143141.008625:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094515c00 00002000:00010000:2.0:1746143141.011849:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143134 -> 1746143139 00002000:00010000:2.0:1746143141.011858:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143134 -> 1746143139 00002000:00010000:2.0:1746143141.011860:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143134 -> 1746143139 00000100:00100000:2.0:1746143141.011883:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861337472:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143141.011919:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931f8600/0x25aee876ca70e6cd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ea7 expref: 17 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.011934:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931f8600/0x25aee876ca70e6cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ea7 expref: 17 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.012624:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8600, rc 0) 00000100:00100000:2.0:1746143141.013021:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858867200:12345-192.168.201.28@tcp:101:cat.0 Request processed in 11252us (11625us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143141.013045:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12905 00000100:00100000:3.0:1746143141.014325:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858866816:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25408us (26372us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143141.014335:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6317 00002000:00100000:3.0:1746143141.014345:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff880094515f80 x1830962858866816/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:291/0 lens 488/440 e 0 to 0 dl 1746143151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.014354:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094515f80 with x1830962858866816 ext(0->1048575) 00002000:00010000:3.0:1746143141.014359:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094515f80 00000100:00100000:0.0:1746143141.023340:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.023437:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858867584 00000100:00100000:3.0:1746143141.023446:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858867584 00002000:00100000:3.0:1746143141.023491:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800906a7800 x1830962858867584/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.023619:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a7800 with x1830962858867584 ext(0->1048575) 00002000:00010000:3.0:1746143141.023625:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a7800 00000100:00100000:3.0:1746143141.023693:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6318 00000100:00100000:3.0:1746143141.023701:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858867584:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143141.051199:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.051248:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.051273:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858867712 00000100:00100000:3.0:1746143141.051282:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858867712 00000100:00100000:0.0:1746143141.051305:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858867840 00000100:00100000:0.0:1746143141.051309:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858867840 00000100:00100000:2.0:1746143141.051366:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.051458:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12906 00000100:00100000:0.0:1746143141.051466:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12907 00000100:00100000:3.0:1746143141.051468:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858867712:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:0.0:1746143141.051474:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858867840:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.051487:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143141.051487:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.051505:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d91600/0x25aee876ca70e6d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650eae expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.051505:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309f2c00/0x25aee876ca70e6db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650eb5 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.051554:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861337600:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143141.051555:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861337728:192.168.201.28@tcp:106: 00000100:00100000:0.0:1746143141.051647:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143141.051648:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143141.052062:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858868096 00000100:00100000:2.0:1746143141.052067:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858868096 00000100:00100000:2.0:1746143141.052125:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8276 00000100:00100000:2.0:1746143141.052132:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e36f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+204:31202:x1830962858868096:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143141.052149:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.052162:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8800/0x25aee876ca70e6e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ebc expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746143141.052257:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143141.052278:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052291:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052301:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052312:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052319:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052325:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052622:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8e00/0x25aee876ca70e6f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052633:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8e00/0x25aee876ca70e6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052639:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8e00/0x25aee876ca70e6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143141.052648:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:1.0:1746143141.052649:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1971:x1830962858867584:12345-192.168.201.28@tcp:3:cat.0 Request processed in 28947us (29323us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143141.052657:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6318 00002000:00100000:1.0:1746143141.052666:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fc:0x0] (0->1048575) req@ffff8800906a7800 x1830962858867584/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.052676:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800906a7800 with x1830962858867584 ext(0->1048575) 00002000:00010000:1.0:1746143141.052680:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800906a7800 00010000:00010000:2.0:1746143141.052936:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052948:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052954:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052959:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931f8a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143141.052963:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052970:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.052982:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143141.052985:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143141.052988:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00000100:00100000:3.0:1746143141.054246:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861337600:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143141.054246:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861337728:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143141.054269:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d91600/0x25aee876ca70e6d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eae expref: 22 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143141.054269:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801309f2c00/0x25aee876ca70e6db lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eb5 expref: 29 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.054280:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e6e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143141.054281:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d91600/0x25aee876ca70e6d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eae expref: 22 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143141.054281:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309f2c00/0x25aee876ca70e6db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eb5 expref: 29 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143141.054298:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309f2c00, rc 0) 00010000:00010000:2.0:1746143141.054300:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143141.054307:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d91600, rc 0) 00000100:00100000:3.0:1746143141.054324:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800906a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858867712:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2859us (3138us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143141.054324:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1968:x1830962858867840:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2851us (3075us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143141.054331:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12907 00000100:00100000:3.0:1746143141.054333:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12906 00010000:00010000:2.0:1746143141.054555:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.054561:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.054567:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931f8c00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143141.054570:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.054580:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.054590:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a55ddb00) 00010000:00010000:2.0:1746143141.054593:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143141.054595:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.054600:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e6f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.054643:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8800/0x25aee876ca70e6e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ebc expref: 207 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.054654:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8e00/0x25aee876ca70e6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ebc expref: 206 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.054660:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143141.054661:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143141.054664:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8e00, rc 0) 00000100:00100000:2.0:1746143141.054700:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e36f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:31202:x1830962858868096:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 2567us (3333us total) trans 8589942504 rc 0/0 00000100:00100000:2.0:1746143141.054706:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8276 00000100:00100000:0.0:1746143141.062984:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.063071:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858868224 00000100:00100000:3.0:1746143141.063081:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858868224 00000100:00100000:3.0:1746143141.063158:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12908 00000100:00100000:3.0:1746143141.063167:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31197:x1830962858868224:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.063187:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.063206:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ec3 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.063241:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.063250:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143141.063253:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143141.063256:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.063289:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 15 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.063302:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 15 pid: 4758 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143141.063315:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861337856:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143141.063623:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143141.066826:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.066890:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.066962:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858868352 00000100:00100000:3.0:1746143141.066970:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858868352 00000100:00100000:1.0:1746143141.067508:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858868608 00000100:00100000:1.0:1746143141.067513:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858868608 00000100:00100000:1.0:1746143141.067561:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3514 00000100:00100000:1.0:1746143141.067575:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:31202:x1830962858868608:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:3.0:1746143141.067703:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8277 00000100:00100000:3.0:1746143141.067709:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:31204:x1830962858868352:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143141.067722:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.067739:0:17079:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e70c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650eca expref: -99 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.067794:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143141.067808:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143141.067811:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31202:x1830962858868608:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 236us (919us total) trans 8589942505 rc 0/0 00000100:00100000:1.0:1746143141.067817:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3514 00010000:00010000:3.0:1746143141.067818:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143141.067831:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143141.067837:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00000100:00080000:1.0:1746143141.067837:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746143141.067842:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143141.067935:0:17079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143141.067944:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.067952:0:17079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 206 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.067960:0:17079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:3.0:1746143141.067985:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 206 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.067995:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 206 pid: 17079 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143141.068006:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861337984:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143141.068114:0:17079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 13 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.068123:0:17079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 13 pid: 14795 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143141.068131:0:17079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861338112:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143141.068155:0:17079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143141.072851:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.072992:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858868736 00000100:00100000:1.0:1746143141.073000:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858868736 00000100:00100000:2.0:1746143141.073010:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861337984:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143141.073011:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861337856:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143141.073064:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 22 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143141.073078:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 623 00010000:00010000:3.0:1746143141.073082:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d91400, rc 0) 00000100:00100000:1.0:1746143141.073095:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:1969:x1830962858868736:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143141.073110:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143141.073137:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8e00/0x25aee876ca70e6f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ebc expref: 207 pid: 17079 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.073139:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31197:x1830962858868224:12345-192.168.201.28@tcp:101:cat.0 Request processed in 9973us (10167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.073147:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12908 00010000:00010000:1.0:1746143141.073154:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143141.073159:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143141.073168:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143141.073174:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143141.073179:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143141.073200:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:1969:x1830962858868736:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.073205:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 623 00000100:00100000:0.0:1746143141.075164:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.075678:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.075723:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.075742:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858869120 00000100:00100000:0.0:1746143141.075748:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858869120 00010000:00010000:0.0:1746143141.075770:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 206 pid: 17079 timeout: 1022 lvb_type: 0 00000100:00100000:0.0:1746143141.075790:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6860 00000100:00100000:0.0:1746143141.075796:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:1968:x1830962858869120:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143141.075805:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143141.075810:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 206 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:0.0:1746143141.075819:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 206 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:0.0:1746143141.075838:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a28000/0x25aee876ca70e568 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650df8 expref: 206 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:0.0:1746143141.075855:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143141.075859:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143141.075867:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143141.075872:0:4759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:0.0:1746143141.075877:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143141.075906:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:1968:x1830962858869120:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 109us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.075911:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858868864 00000100:00100000:0.0:1746143141.075912:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6860 00000100:00100000:3.0:1746143141.075916:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858868864 00000100:00100000:3.0:1746143141.075951:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12909 00000100:00100000:3.0:1746143141.075956:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31200:x1830962858868864:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.075973:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.075988:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ed1 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.076009:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.076016:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143141.076018:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143141.076021:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 17 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143141.076058:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858868992 00000100:00100000:1.0:1746143141.076062:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858868992 00010000:00010000:3.0:1746143141.076065:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.076076:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 21 pid: 4758 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143141.076099:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861338240:192.168.201.28@tcp:104: 00002000:00100000:1.0:1746143141.076100:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2580480->3145727) req@ffff8800a5cc9500 x1830962858868992/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.076110:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc9500 with x1830962858868992 ext(2580480->3145727) 00010000:00010000:1.0:1746143141.076117:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 18 pid: 4758 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143141.076151:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17be40 going to sleep for 11 seconds 00010000:00010000:1.0:1746143141.076238:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 18 pid: 4758 timeout: 1022 lvb_type: 0 00002000:00010000:1.0:1746143141.076245:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5cc9500 00000100:00100000:1.0:1746143141.076272:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2049 00000100:00100000:1.0:1746143141.076278:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1968:x1830962858868992:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:2.0:1746143141.083146:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.083195:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.083348:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858869504 00000100:00100000:3.0:1746143141.083357:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858869504 00002000:00100000:3.0:1746143141.083407:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1302528->1384447) req@ffff880090f21180 x1830962858869504/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.083424:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21180 with x1830962858869504 ext(1302528->1384447) 00010000:00010000:3.0:1746143141.083434:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 22 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143141.083447:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 22 pid: 4758 timeout: 1022 lvb_type: 0 00002000:00010000:3.0:1746143141.083667:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090f21180 00000100:00100000:3.0:1746143141.083698:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2050 00000100:00100000:3.0:1746143141.083706:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1971:x1830962858869504:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143141.083910:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861338240:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143141.083933:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.083949:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d91800, rc 0) 00000100:00100000:3.0:1746143141.083973:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31200:x1830962858868864:12345-192.168.201.28@tcp:101:cat.0 Request processed in 8016us (8813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.083980:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12909 00000100:00100000:3.0:1746143141.084015:0:17079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17079:1830962861338112:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143141.084051:0:17079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000100:00100000:1.0:1746143141.084300:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858869376 00000100:00100000:1.0:1746143141.084305:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858869376 00000100:00100000:1.0:1746143141.084344:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3515 00000100:00100000:1.0:1746143141.084350:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:27541:x1830962858869376:12345-192.168.201.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143141.084535:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:27541:x1830962858869376:12345-192.168.201.28@tcp:35:ldlm_bl.0 Request processed in 184us (1401us total) trans 8589942506 rc 0/0 00000100:00100000:1.0:1746143141.084541:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3515 00000100:00100000:0.0:1746143141.091370:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.091450:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858869632 00000100:00100000:1.0:1746143141.091458:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858869632 00010000:00010000:1.0:1746143141.091492:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 15 pid: 14795 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143141.091519:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6861 00000100:00100000:1.0:1746143141.091526:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1968:x1830962858869632:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143141.091540:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143141.091545:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 15 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143141.091556:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 15 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143141.091577:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f13000/0x25aee876ca70e53e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650da4 expref: 15 pid: 14795 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143141.091590:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143141.091595:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143141.091604:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143141.091610:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17079 initiator: MDT0 00010000:00010000:1.0:1746143141.091644:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143141.091647:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858869504:12345-192.168.201.28@tcp:4:cat.0 Request processed in 7941us (8451us total) trans 21474840134 rc 0/0 00000100:00100000:3.0:1746143141.091660:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2050 00000100:00100000:1.0:1746143141.091660:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:1968:x1830962858869632:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 135us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.091665:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6861 00002000:00100000:3.0:1746143141.091670:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2fe:0x0] (1302528->1384447) req@ffff880090f21180 x1830962858869504/t21474840134(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/448 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.091679:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f21180 with x1830962858869504 ext(1302528->1384447) 00010000:00010000:3.0:1746143141.091687:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 24 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143141.091696:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 24 pid: 4758 timeout: 1022 lvb_type: 0 00002000:00010000:3.0:1746143141.091702:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090f21180 00010000:00010000:2.0:1746143141.092195:0:17079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092203:0:17079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00000004:00200000:2.0:1746143141.092244:0:17079:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143141.092249:0:17079:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143141.092266:0:17079:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092276:0:17079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092284:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092290:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092296:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092301:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d91600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143141.092305:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092310:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092318:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143141.092320:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143141.092324:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092333:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91600/0x25aee876ca70e713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092357:0:17079:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092362:0:17079:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092367:0:17079:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092372:0:17079:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d91000 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143141.092374:0:17079:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092380:0:17079:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092387:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a497f600) 00010000:00010000:2.0:1746143141.092389:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143141.092391:0:17079:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092396:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e71a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 00010000:00010000:2.0:1746143141.092426:0:17079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90800/0x25aee876ca70e70c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.092436:0:17079:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 7 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.092448:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143141.092450:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143141.092452:0:17079:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d91a00, rc 0) 00000100:00100000:2.0:1746143141.092489:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31204:x1830962858868352:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 24780us (25672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.092497:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8277 00000100:00100000:1.0:1746143141.096826:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858868992:12345-192.168.201.28@tcp:4:cat.0 Request processed in 20539us (21139us total) trans 21474840135 rc 0/0 00000100:00100000:1.0:1746143141.096838:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2049 00002000:00100000:1.0:1746143141.096848:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (2580480->3145727) req@ffff8800a5cc9500 x1830962858868992/t21474840135(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/448 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.096857:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc9500 with x1830962858868992 ext(2580480->3145727) 00010000:00010000:1.0:1746143141.096866:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 19 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143141.096879:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 19 pid: 4758 timeout: 1022 lvb_type: 0 00002000:00010000:1.0:1746143141.096885:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5cc9500 00000100:00100000:0.0:1746143141.100798:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.102028:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858869760 00000100:00100000:3.0:1746143141.102062:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858869760 00000100:00100000:3.0:1746143141.102172:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12910 00000100:00100000:3.0:1746143141.102183:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1969:x1830962858869760:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143141.102202:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.102221:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e12800/0x25aee876ca70e72f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ed8 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.102279:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861338368:192.168.201.28@tcp:106: 00000100:00080000:1.0:1746143141.102326:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143141.102722:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.102955:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858870016 00000100:00100000:2.0:1746143141.102960:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858870016 00000100:00100000:0.0:1746143141.102973:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.102993:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858869888 00000100:00100000:0.0:1746143141.102994:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.102995:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858869888 00000100:00100000:2.0:1746143141.103010:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12911 00000100:00100000:0.0:1746143141.103011:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858870144 00000100:00100000:0.0:1746143141.103013:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858870144 00000100:00100000:2.0:1746143141.103016:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858870016:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143141.103024:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143141.103045:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 24 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143141.103051:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931f9200/0x25aee876ca70e736 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ee6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143141.103065:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6862 00000100:00100000:0.0:1746143141.103071:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858870144:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143141.103079:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143141.103082:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861338496:192.168.201.28@tcp:106: 00010000:00010000:0.0:1746143141.103113:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 24 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:0.0:1746143141.103127:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 24 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:0.0:1746143141.103148:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143141.103151:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143141.103158:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.103166:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143141.103173:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:0.0:1746143141.103189:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143141.103191:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858870272 00000100:00100000:2.0:1746143141.103194:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858870272 00000100:00100000:0.0:1746143141.103199:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861338624:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143141.103202:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12912 00010000:00010000:2.0:1746143141.103207:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 19 pid: 4758 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143141.103218:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858869888:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:2.0:1746143141.103225:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6863 00000100:00100000:2.0:1746143141.103231:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858870272:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143141.103236:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.103241:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143141.103252:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 19 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143141.103253:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650edf expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.103261:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 19 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143141.103276:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d90e00/0x25aee876ca70e66b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e7d expref: 19 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:1.0:1746143141.103276:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.103279:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.103287:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 9 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.103301:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.103303:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.103309:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.103316:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.103356:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 9 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.103364:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.103368:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e8b7200, rc 0) 00000100:00100000:2.0:1746143141.103375:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861338752:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143141.103415:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858869888:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 204us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.103422:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12912 00000100:00100000:2.0:1746143141.103423:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143141.103424:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143141.103428:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2180 going to sleep for 11 seconds 00000100:00080000:1.0:1746143141.103454:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143141.107853:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143141.108134:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861338496:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143141.108172:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931f9200/0x25aee876ca70e736 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ee6 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.108194:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9200/0x25aee876ca70e736 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ee6 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.108205:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f9200, rc 0) 00000100:00100000:2.0:1746143141.108267:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858870016:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5248us (5544us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143141.108276:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12911 00000100:00100000:0.0:1746143141.108539:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861338624:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143141.108553:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143141.108577:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858870144:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5506us (5582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143141.108587:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6862 00000100:00100000:3.0:1746143141.110640:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f20380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7111:1830962861338752:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143141.110659:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143141.110699:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1970:x1830962858870272:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7467us (7524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.110709:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6863 00010000:00010000:3.0:1746143141.110786:0:8169:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.201.28@tcp) returned -22 from glimpse AST (req@ffff880136be9500 x1830962861338368) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 23 pid: 4758 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143141.110827:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f13200/0x25aee876ca70e664 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1384447) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e76 expref: 23 pid: 4758 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143141.110844:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861338368:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143141.110865:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e12800/0x25aee876ca70e72f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed8 expref: 8 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.110876:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e12800/0x25aee876ca70e72f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed8 expref: 8 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.111102:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e12800, rc 0) 00000100:00100000:3.0:1746143141.111126:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858869760:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 8945us (10340us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143141.111132:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12910 00000100:00100000:0.0:1746143141.112065:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.112242:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858870528 00000100:00100000:1.0:1746143141.112253:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858870528 00002000:00100000:1.0:1746143141.112295:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800a5cca300 x1830962858870528/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.112305:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cca300 with x1830962858870528 ext(1048576->2097151) 00002000:00010000:1.0:1746143141.112310:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5cca300 00000100:00100000:1.0:1746143141.112339:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6319 00000100:00100000:1.0:1746143141.112346:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858870528:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143141.124610:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.124678:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858870784 00000100:00100000:3.0:1746143141.124688:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858870784 00002000:00100000:3.0:1746143141.124738:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5cc8000 x1830962858870784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.124750:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc8000 with x1830962858870784 ext(2097152->3145727) 00002000:00010000:3.0:1746143141.124757:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5cc8000 00000100:00100000:3.0:1746143141.124995:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6320 00000100:00100000:3.0:1746143141.125005:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858870784:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143141.126556:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.127690:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858871040 00000100:00100000:2.0:1746143141.127698:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858871040 00000100:00100000:2.0:1746143141.127745:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8278 00000100:00100000:2.0:1746143141.127751:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:31204:x1830962858871040:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143141.127859:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.127881:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9a00/0x25aee876ca70e744 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650eed expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143141.129338:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1971:x1830962858870528:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16985us (17270us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143141.129349:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6319 00002000:00100000:1.0:1746143141.129360:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2fe:0x0] (1048576->2097151) req@ffff8800a5cca300 x1830962858870528/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.129370:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cca300 with x1830962858870528 ext(1048576->2097151) 00002000:00010000:1.0:1746143141.129377:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5cca300 00010000:00010000:2.0:1746143141.129907:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.129925:0:14794:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.129933:0:14794:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.129965:0:14794:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 8 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.129983:0:14794:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 8 pid: 17079 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143141.129995:0:14794:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861338880:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143141.130079:0:14794:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143141.138607:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.138675:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858871168 00000100:00100000:3.0:1746143141.138684:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858871168 00010000:00010000:3.0:1746143141.138723:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 9 pid: 17079 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143141.138724:0:14794:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14794:1830962861338880:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143141.138748:0:14794:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143141.138756:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6864 00000100:00100000:3.0:1746143141.138764:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1968:x1830962858871168:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143141.138780:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143141.138787:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 9 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143141.138800:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 9 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143141.138825:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91a00/0x25aee876ca70e721 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eca expref: 9 pid: 17079 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143141.138846:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143141.138851:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143141.138861:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143141.138868:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14794 initiator: MDT0 00010000:00010000:3.0:1746143141.138884:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143141.138927:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858871168:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 163us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.138935:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6864 00010000:00010000:2.0:1746143141.141158:0:14794:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.141169:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143141.141191:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143141.141341:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9a00/0x25aee876ca70e744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.141374:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 8 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.141382:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143141.141384:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143141.141387:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8400, rc 0) 00000100:00100000:2.0:1746143141.141437:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31204:x1830962858871040:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 13685us (14882us total) trans 8589942507 rc 0/0 00000100:00100000:2.0:1746143141.141450:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8278 00000100:00100000:1.0:1746143141.144282:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.144371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.144825:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858871296 00000100:00100000:3.0:1746143141.144835:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858871296 00000100:00100000:3.0:1746143141.145149:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12913 00000100:00100000:3.0:1746143141.145158:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31200:x1830962858871296:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.145178:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.145197:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ef4 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143141.145201:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858871552 00000100:00100000:2.0:1746143141.145206:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858871552 00000100:00100000:0.0:1746143141.145218:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143141.145224:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143141.145226:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143141.145237:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143141.145242:0:14794:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858871680 00000100:00100000:2.0:1746143141.145245:0:14794:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858871680 00010000:00010000:3.0:1746143141.145253:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 19 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.145266:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e13600, rc 0) 00000100:00100000:2.0:1746143141.145267:0:14794:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8279 00000100:00100000:1.0:1746143141.145272:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8280 00000100:00100000:2.0:1746143141.145273:0:14794:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+14:31206:x1830962858871552:12345-192.168.201.28@tcp:101:multiop.0 00000100:00100000:1.0:1746143141.145277:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31204:x1830962858871680:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143141.145288:0:14794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143141.145288:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.145300:0:14794:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e767 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650efb expref: -99 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.145300:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135db2200/0x25aee876ca70e760 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f02 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.145385:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143141.145390:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145397:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143141.145398:0:14795:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.145405:0:14795:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143141.145407:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145418:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145423:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145428:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00010000:00010000:1.0:1746143141.145432:0:14795:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 9 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.145443:0:14795:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 9 pid: 14794 timeout: 1022 lvb_type: 0 00000100:00100000:1.0:1746143141.145454:0:14795:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861339008:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143141.145514:0:14795:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a540 going to sleep for 11 seconds 00010000:00010000:2.0:1746143141.145518:0:14794:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8200/0x25aee876ca70e783 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145530:0:14794:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8200/0x25aee876ca70e783 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145536:0:14794:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8200/0x25aee876ca70e783 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14794 initiator: MDT0 00000004:00200000:2.0:1746143141.145544:0:14794:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:2.0:1746143141.145630:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145638:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145644:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145650:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931f8a00 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143141.145654:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145662:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145672:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:2.0:1746143141.145675:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143141.145679:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145684:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8a00/0x25aee876ca70e775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145695:0:14794:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145705:0:14794:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145710:0:14794:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145715:0:14794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931f8600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143141.145717:0:14794:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14794 initiator: MDT0 00000100:00100000:3.0:1746143141.145721:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858870784:12345-192.168.201.28@tcp:3:cat.0 Request processed in 20715us (21123us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746143141.145722:0:14794:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14794 initiator: MDT0 00010000:00010000:2.0:1746143141.145729:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a55dd100) 00000100:00100000:3.0:1746143141.145730:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6320 00010000:00010000:2.0:1746143141.145731:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143141.145734:0:14794:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00002000:00100000:3.0:1746143141.145738:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff8800a5cc8000 x1830962858870784/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143141.145739:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8600/0x25aee876ca70e77c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14794 initiator: MDT0 00002000:00100000:3.0:1746143141.145749:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5cc8000 with x1830962858870784 ext(2097152->3145727) 00002000:00010000:3.0:1746143141.145753:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5cc8000 00010000:00010000:2.0:1746143141.145773:0:14794:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8c00/0x25aee876ca70e767 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650efb expref: 17 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.145784:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31200:x1830962858871296:12345-192.168.201.28@tcp:101:cat.0 Request processed in 628us (1514us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143141.145784:0:14794:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8200/0x25aee876ca70e783 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650efb expref: 16 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.145790:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12913 00010000:00010000:2.0:1746143141.145791:0:14794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143141.145793:0:14794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143141.145796:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143141.145806:0:14794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143141.145811:0:14794:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8200, rc 0) 00000100:00100000:2.0:1746143141.145850:0:14794:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31206:x1830962858871552:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 576us (1479us total) trans 8589942508 rc 0/0 00000100:00100000:2.0:1746143141.145856:0:14794:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8279 00000100:00100000:1.0:1746143141.149101:0:14795:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009314d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14795:1830962861339008:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143141.149128:0:14795:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000100:00100000:1.0:1746143141.152454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.152495:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.152525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.152574:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858871936 00000100:00100000:2.0:1746143141.152583:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858871936 00000100:00100000:2.0:1746143141.152624:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12914 00000100:00100000:2.0:1746143141.152631:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:31197:x1830962858871936:12345-192.168.201.28@tcp:101:cat.0 00000100:00100000:3.0:1746143141.152677:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858872064 00000100:00100000:3.0:1746143141.152682:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858872064 00000100:00100000:3.0:1746143141.152715:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858871808 00000100:00100000:3.0:1746143141.152718:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858871808 00010000:00010000:3.0:1746143141.152731:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 10 pid: 14794 timeout: 1022 lvb_type: 0 00000100:00100000:3.0:1746143141.152752:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6865 00000100:00100000:3.0:1746143141.152758:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+10:1970:x1830962858871808:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143141.152773:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143141.152779:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 10 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143141.152791:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 10 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143141.152812:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.152814:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8400/0x25aee876ca70e74b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650eed expref: 10 pid: 14794 timeout: 1022 lvb_type: 0 00010000:00010000:2.0:1746143141.152828:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f09 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.152836:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143141.152841:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:3.0:1746143141.152862:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143141.152865:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143141.152865:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 624 00010000:00010000:3.0:1746143141.152869:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14795 initiator: MDT0 00010000:00010000:2.0:1746143141.152872:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143141.152873:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143141.152877:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 29 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143141.152884:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1969:x1830962858872064:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143141.152889:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143141.152902:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.152902:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143141.152914:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 23 pid: 8449 timeout: 1022 lvb_type: 0 00000100:00100000:2.0:1746143141.152928:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861339136:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143141.152929:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f8200/0x25aee876ca70e783 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650efb expref: 16 pid: 14794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.152931:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1970:x1830962858871808:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 173us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.152938:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6865 00010000:00010000:0.0:1746143141.152964:0:4759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143141.152968:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143141.152976:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143141.153013:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:1969:x1830962858872064:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 137us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143141.153021:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 624 00010000:00010000:1.0:1746143141.153276:0:14795:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.153284:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00000004:00200000:1.0:1746143141.153330:0:14795:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:1.0:1746143141.153335:0:14795:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143141.153353:0:14795:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.153382:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135db2200/0x25aee876ca70e760 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f02 expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.153412:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f02 expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.153418:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143141.153421:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143141.153423:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be4e000, rc 0) 00000100:00100000:1.0:1746143141.153699:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31204:x1830962858871680:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 8419us (8479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.153706:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8280 00000100:00100000:2.0:1746143141.158194:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8169:1830962861339136:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143141.158234:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 29 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.158254:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f9000, rc 0) 00000100:00100000:2.0:1746143141.158312:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:31197:x1830962858871936:12345-192.168.201.28@tcp:101:cat.0 Request processed in 5680us (5866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.158322:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12914 00000100:00100000:2.0:1746143141.159488:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.160083:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.160142:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.161056:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858872448 00000100:00100000:3.0:1746143141.161066:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858872448 00000100:00100000:0.0:1746143141.161702:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858872192 00000100:00100000:0.0:1746143141.161708:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858872192 00002000:00100000:3.0:1746143141.161735:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2146303) req@ffff880090f20380 x1830962858872448/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.161746:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20380 with x1830962858872448 ext(2097152->2146303) 00000100:00100000:0.0:1746143141.161752:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858872320 00000100:00100000:0.0:1746143141.161754:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858872320 00010000:00010000:3.0:1746143141.161756:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 24 pid: 8449 timeout: 1022 lvb_type: 0 00010000:00010000:3.0:1746143141.161772:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 24 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:3.0:1746143141.161779:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090f20380 00000100:00100000:0.0:1746143141.161779:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12915 00000100:00100000:0.0:1746143141.161965:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858872192:12345-192.168.201.28@tcp:101:lfs.0 00000100:00100000:3.0:1746143141.161984:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2051 00000100:00100000:3.0:1746143141.161991:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+24:1968:x1830962858872448:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143141.162054:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12916 00000100:00080000:1.0:1746143141.162064:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143141.162077:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858872320:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143141.162097:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143141.162114:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be4e600/0x25aee876ca70e798 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f17 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143141.162163:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861339264:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143141.162230:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a540 going to sleep for 11 seconds 00010000:00010000:0.0:1746143141.162593:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143141.162605:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f10 expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.162619:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143141.163141:0:754:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143141.163152:0:754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143141.163172:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 8 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143141.163182:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309f3e00, rc 0) 00000100:00100000:0.0:1746143141.163210:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1968:x1830962858872192:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 1246us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143141.163217:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12915 00000100:00100000:1.0:1746143141.163506:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.163574:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.163618:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.163624:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858872960 00000100:00100000:2.0:1746143141.163629:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858872960 00000100:00100000:1.0:1746143141.163644:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143141.163653:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3194880->4194303) req@ffff8800942c7800 x1830962858872960/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143141.163660:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858872832 00002000:00100000:2.0:1746143141.163662:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7800 with x1830962858872960 ext(3194880->4194303) 00000100:00100000:1.0:1746143141.163663:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858872832 00010000:00010000:2.0:1746143141.163668:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00100000:1.0:1746143141.163676:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2146304->3194879) req@ffff8800942c4000 x1830962858872832/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143141.163678:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00100000:1.0:1746143141.163684:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4000 with x1830962858872832 ext(2146304->3194879) 00010000:00010000:1.0:1746143141.163688:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:2.0:1746143141.163691:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c7800 00010000:00010000:1.0:1746143141.163696:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:1.0:1746143141.163701:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c4000 00000100:00100000:1.0:1746143141.163706:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858873088 00000100:00100000:2.0:1746143141.163707:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858873216 00000100:00100000:2.0:1746143141.163708:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858873216 00000100:00100000:1.0:1746143141.163708:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858873088 00002000:00100000:1.0:1746143141.163717:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880091948700 x1830962858873088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.163720:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009194ad80 x1830962858873216/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.163727:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194ad80 with x1830962858873216 ext(3145728->4194303) 00002000:00010000:2.0:1746143141.163730:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194ad80 00002000:00100000:1.0:1746143141.163730:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948700 with x1830962858873088 ext(2097152->3145727) 00002000:00010000:1.0:1746143141.163733:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948700 00000100:00100000:2.0:1746143141.163740:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2052 00000100:00100000:1.0:1746143141.163743:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2053 00000100:00100000:2.0:1746143141.163745:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1969:x1830962858872960:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:1.0:1746143141.163747:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1968:x1830962858872832:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143141.163756:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6321 00000100:00100000:0.0:1746143141.164008:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6322 00000100:00100000:0.0:1746143141.164015:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1971:x1830962858873088:12345-192.168.201.28@tcp:3:cat.0 00002000:00010000:1.0:1746143141.165652:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime: 1746143139 -> 1746143140 00000100:00100000:1.0:1746143141.165672:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861339264:192.168.201.28@tcp:106: 00010000:00010000:1.0:1746143141.165700:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be4e600/0x25aee876ca70e798 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f17 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143141.165714:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be4e600/0x25aee876ca70e798 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f17 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143141.165743:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be4e600, rc 0) 00000100:00100000:1.0:1746143141.165769:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858872320:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 3708us (5626us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143141.165776:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12916 00000100:00100000:1.0:1746143141.170455:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858873216:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:3.0:1746143141.173759:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+30:1968:x1830962858872448:12345-192.168.201.28@tcp:4:cat.0 Request processed in 11754us (13662us total) trans 17179872870 rc 0/0 00000100:00100000:3.0:1746143141.173772:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2051 00002000:00100000:3.0:1746143141.173785:0:8453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x305:0x0] (2097152->2146303) req@ffff880090f20380 x1830962858872448/t17179872870(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/448 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.173795:0:8453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090f20380 with x1830962858872448 ext(2097152->2146303) 00010000:00010000:3.0:1746143141.173808:0:8453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 30 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.173826:0:8453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 30 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:3.0:1746143141.173833:0:8453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090f20380 00000100:00100000:0.0:1746143141.177866:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.178246:0:14795:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858873728 00000100:00100000:1.0:1746143141.178256:0:14795:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858873728 00000100:00100000:1.0:1746143141.178384:0:14795:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8281 00000100:00100000:1.0:1746143141.178393:0:14795:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31204:x1830962858873728:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143141.178412:0:14795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143141.178430:0:14795:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d600/0x25aee876ca70e7a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f1e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.178531:0:14795:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178547:0:14795:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178560:0:14795:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178571:0:14795:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178577:0:14795:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178584:0:14795:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178590:0:14795:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092c7d800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:1.0:1746143141.178594:0:14795:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178601:0:14795:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178866:0:14795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143141.178869:0:14795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143141.178874:0:14795:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178880:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d800/0x25aee876ca70e7ad lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14795 initiator: MDT0 00010000:00010000:1.0:1746143141.178928:0:14795:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d600/0x25aee876ca70e7a6 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f1e expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.178935:0:14795:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092c7d600/0x25aee876ca70e7a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f1e expref: 9 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.178943:0:14795:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c7d600, rc 0) 00000100:00100000:1.0:1746143141.179001:0:14795:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31204:x1830962858873728:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 609us (1146us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143141.179008:0:14795:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8281 00000100:00100000:1.0:1746143141.181261:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1968:x1830962858872832:12345-192.168.201.28@tcp:3:cat.0 Request processed in 17502us (17676us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143141.181273:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2053 00002000:00100000:1.0:1746143141.181285:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (2146304->3194879) req@ffff8800942c4000 x1830962858872832/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.181295:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c4000 with x1830962858872832 ext(2146304->3194879) 00010000:00010000:1.0:1746143141.181305:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.181321:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:1.0:1746143141.181328:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c4000 00000100:00100000:0.0:1746143141.183718:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.183813:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858873984 00000100:00100000:3.0:1746143141.183823:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858873984 00000100:00100000:3.0:1746143141.185620:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3516 00000100:00100000:3.0:1746143141.185635:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:31204:x1830962858873984:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:3.0:1746143141.185866:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:31204:x1830962858873984:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 234us (2155us total) trans 8589942509 rc 0/0 00000100:00100000:3.0:1746143141.185873:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3516 00000100:00100000:0.0:1746143141.189180:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1971:x1830962858873088:12345-192.168.201.28@tcp:3:cat.0 Request processed in 25156us (25551us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143141.189193:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6322 00002000:00100000:0.0:1746143141.189205:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (2097152->3145727) req@ffff880091948700 x1830962858873088/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143141.189217:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091948700 with x1830962858873088 ext(2097152->3145727) 00002000:00010000:0.0:1746143141.189222:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091948700 00000100:00100000:0.0:1746143141.192161:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.192311:0:14791:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858874112 00000100:00100000:3.0:1746143141.192322:0:14791:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858874112 00000100:00100000:3.0:1746143141.192377:0:14791:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 234 00000100:00100000:3.0:1746143141.192384:0:14791:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1970:x1830962858874112:12345-192.168.201.28@tcp:400:kworker.0 00000100:00100000:3.0:1746143141.193596:0:14791:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1970:x1830962858874112:12345-192.168.201.28@tcp:400:kworker.0 Request processed in 1209us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.193605:0:14791:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 234 00000100:00100000:2.0:1746143141.197291:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858872960:12345-192.168.201.28@tcp:3:cat.0 Request processed in 33534us (33774us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746143141.197302:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2052 00002000:00100000:2.0:1746143141.197314:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (3194880->4194303) req@ffff8800942c7800 x1830962858872960/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.197325:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c7800 with x1830962858872960 ext(3194880->4194303) 00010000:00010000:2.0:1746143141.197336:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.197351:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:2.0:1746143141.197358:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942c7800 00000100:00100000:0.0:1746143141.200712:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.202222:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858874240 00000100:00100000:1.0:1746143141.202232:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858874240 00000100:00100000:1.0:1746143141.202294:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12917 00000100:00100000:1.0:1746143141.202303:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:31200:x1830962858874240:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143141.202323:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143141.202340:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f25 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.202648:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143141.202656:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.202669:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.202681:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c7dc00, rc 0) 00000100:00100000:1.0:1746143141.202727:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:31200:x1830962858874240:12345-192.168.201.28@tcp:101:cat.0 Request processed in 426us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.202733:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12917 00000100:00100000:1.0:1746143141.203356:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009194ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1971:x1830962858873216:12345-192.168.201.28@tcp:3:cat.0 Request processed in 39593us (39708us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143141.203363:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6321 00002000:00100000:1.0:1746143141.203373:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009194ad80 x1830962858873216/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.203382:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009194ad80 with x1830962858873216 ext(3145728->4194303) 00002000:00010000:1.0:1746143141.203387:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009194ad80 00000100:00100000:0.0:1746143141.210722:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.212869:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858874368 00000100:00100000:1.0:1746143141.212881:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858874368 00010000:00010000:1.0:1746143141.212922:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00000100:00100000:1.0:1746143141.212956:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6866 00000100:00100000:1.0:1746143141.212962:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1970:x1830962858874368:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143141.212976:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143141.213000:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.213012:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.213064:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3400/0x25aee876ca70e672 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e84 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.213098:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.213100:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.213107:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 28 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.213115:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 28 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.213123:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.213124:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.213127:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.213137:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.213168:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143141.213179:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861339392:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143141.215355:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.215420:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858874496 00000100:00100000:0.0:1746143141.215426:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858874496 00000100:00100000:0.0:1746143141.215659:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12918 00000100:00100000:0.0:1746143141.215666:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+29:31202:x1830962858874496:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:0.0:1746143141.215684:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143141.215698:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f2c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.215723:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.215732:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.215738:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143141.215740:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143141.215744:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 30 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.215768:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.216229:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00000100:00100000:0.0:1746143141.216242:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861339520:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143141.217071:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.217081:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.217356:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:0.0:1746143141.217356:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861339648:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143141.217367:0:9869:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:1.0:1746143141.217377:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861339776:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143141.217732:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143141.217740:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143141.217761:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091948000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861339392:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143141.221098:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861339520:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143141.221113:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861339648:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143141.221143:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 30 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.221163:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309f3a00, rc 0) 00000100:00100000:2.0:1746143141.221215:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:31202:x1830962858874496:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 5549us (5867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.221225:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12918 00000100:00100000:1.0:1746143141.226823:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861339776:192.168.201.28@tcp:105: 00010000:00010000:1.0:1746143141.226850:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143141.226892:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858874368:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 13928us (16180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.226902:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6866 00000100:00100000:0.0:1746143141.227065:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.227243:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858874880 00000100:00100000:1.0:1746143141.227250:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858874880 00002000:00100000:1.0:1746143141.227287:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ad5ad80 x1830962858874880/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.227296:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ad80 with x1830962858874880 ext(3145728->4194303) 00010000:00010000:1.0:1746143141.227305:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.227317:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:1.0:1746143141.227323:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad5ad80 00000100:00100000:1.0:1746143141.227347:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2054 00000100:00100000:1.0:1746143141.227353:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858874880:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143141.227496:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.228194:0:21522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858874752 00000100:00100000:3.0:1746143141.228199:0:21522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858874752 00002000:00100000:3.0:1746143141.228219:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094512d80 x1830962858874752/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.228227:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512d80 with x1830962858874752 ext(2097152->3145727) 00010000:00010000:3.0:1746143141.228234:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.228242:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:3.0:1746143141.228248:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094512d80 00000100:00100000:3.0:1746143141.228265:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2055 00000100:00100000:3.0:1746143141.228271:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:1971:x1830962858874752:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143141.237505:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.237570:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.237588:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858875264 00000100:00100000:2.0:1746143141.237599:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858875264 00000100:00100000:0.0:1746143141.237617:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00002000:00100000:2.0:1746143141.237647:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009ad58700 x1830962858875264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.237658:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58700 with x1830962858875264 ext(2097152->3145727) 00010000:00010000:2.0:1746143141.237668:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.237682:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00002000:00010000:2.0:1746143141.237690:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad58700 00000100:00100000:2.0:1746143141.237722:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2056 00000100:00100000:2.0:1746143141.237732:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858875264:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143141.237757:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858875520 00000100:00100000:1.0:1746143141.237764:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858875520 00002000:00100000:1.0:1746143141.237792:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ad5a680 x1830962858875520/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.237800:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5a680 with x1830962858875520 ext(3145728->4194303) 00010000:00010000:1.0:1746143141.237806:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 31 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.237815:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 31 pid: 8169 timeout: 1023 lvb_type: 0 00002000:00010000:1.0:1746143141.237821:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad5a680 00000100:00100000:1.0:1746143141.237841:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858875776 00000100:00100000:1.0:1746143141.237846:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858875776 00002000:00100000:1.0:1746143141.237865:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ad5b100 x1830962858875776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746143141.238282:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2057 00000100:00100000:0.0:1746143141.238292:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1969:x1830962858875520:12345-192.168.201.28@tcp:3:multiop.0 00002000:00100000:1.0:1746143141.240335:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5b100 with x1830962858875776 ext(3145728->4194303) 00002000:00010000:1.0:1746143141.240341:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5b100 00000100:00100000:1.0:1746143141.240376:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6323 00000100:00100000:1.0:1746143141.240385:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858875776:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:1.0:1746143141.244107:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1971:x1830962858874880:12345-192.168.201.28@tcp:3:cat.0 Request processed in 16728us (17016us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143141.244121:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2054 00002000:00100000:1.0:1746143141.244136:0:21520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ad5ad80 x1830962858874880/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.244145:0:21520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ad80 with x1830962858874880 ext(3145728->4194303) 00010000:00010000:1.0:1746143141.244158:0:21520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.244172:0:21520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:1.0:1746143141.244179:0:21520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad5ad80 00000100:00100000:2.0:1746143141.252376:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1971:x1830962858874752:12345-192.168.201.28@tcp:3:cat.0 Request processed in 24094us (24869us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143141.252390:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2055 00002000:00100000:2.0:1746143141.252402:0:21522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff880094512d80 x1830962858874752/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.252412:0:21522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094512d80 with x1830962858874752 ext(2097152->3145727) 00010000:00010000:2.0:1746143141.252423:0:21522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.252437:0:21522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:2.0:1746143141.252443:0:21522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094512d80 00000100:00100000:2.0:1746143141.264120:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+32:1969:x1830962858875264:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 26375us (26616us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143141.264134:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2056 00002000:00100000:2.0:1746143141.264148:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2097152->3145727) req@ffff88009ad58700 x1830962858875264/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.264158:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad58700 with x1830962858875264 ext(2097152->3145727) 00010000:00010000:2.0:1746143141.264169:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 32 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.264183:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 32 pid: 8169 timeout: 1023 lvb_type: 0 00002000:00010000:2.0:1746143141.264194:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad58700 00000100:00100000:2.0:1746143141.271929:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858875520:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 33625us (34346us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143141.271943:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2057 00002000:00100000:2.0:1746143141.271958:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009ad5a680 x1830962858875520/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.271969:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5a680 with x1830962858875520 ext(3145728->4194303) 00010000:00010000:2.0:1746143141.271980:0:21521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.271994:0:21521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00002000:00010000:2.0:1746143141.272002:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad5a680 00000100:00100000:0.0:1746143141.272267:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.272301:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.272318:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858875904 00000100:00100000:2.0:1746143141.272326:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858875904 00000100:00100000:1.0:1746143141.272343:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858876032 00000100:00100000:1.0:1746143141.272348:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858876032 00000100:00100000:2.0:1746143141.272612:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12919 00000100:00100000:2.0:1746143141.272620:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+27:31200:x1830962858875904:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143141.272635:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.272650:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eaa0000/0x25aee876ca70e7c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f33 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.272654:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 27 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.272673:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.272676:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.272684:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eaa0000/0x25aee876ca70e7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f33 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143141.272686:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6867 00000100:00100000:1.0:1746143141.272694:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:1970:x1830962858876032:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143141.272700:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eaa0000/0x25aee876ca70e7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f33 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.272704:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143141.272711:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eaa0000, rc 0) 00010000:00010000:1.0:1746143141.272722:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.272732:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00000100:00100000:2.0:1746143141.272735:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+28:31200:x1830962858875904:12345-192.168.201.28@tcp:101:cat.0 Request processed in 116us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.272741:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12919 00010000:00010000:1.0:1746143141.272748:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092c7dc00/0x25aee876ca70e7b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f25 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.272765:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143141.272786:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858876032:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 93us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.272792:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6867 00000100:00100000:1.0:1746143141.274895:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858875776:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 34501us (37267us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143141.274907:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6323 00002000:00100000:1.0:1746143141.274920:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->4194303) req@ffff88009ad5b100 x1830962858875776/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.274930:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5b100 with x1830962858875776 ext(3145728->4194303) 00002000:00010000:1.0:1746143141.274936:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5b100 00000100:00100000:0.0:1746143141.277364:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.277676:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858876160 00000100:00100000:1.0:1746143141.277685:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858876160 00010000:00010000:1.0:1746143141.277722:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:1.0:1746143141.277762:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6868 00000100:00100000:1.0:1746143141.277771:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858876160:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143141.277791:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143141.277815:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.278027:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.278078:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9000/0x25aee876ca70e791 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f09 expref: 30 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:1.0:1746143141.278110:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.278112:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.278121:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.278131:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.278173:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 29 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143141.278187:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861339904:192.168.201.28@tcp:105: 00000100:00100000:1.0:1746143141.278303:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143141.280576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.280633:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.280780:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858876544 00000100:00100000:2.0:1746143141.280787:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858876544 00000100:00100000:2.0:1746143141.280991:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12920 00000100:00100000:2.0:1746143141.281000:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:31197:x1830962858876544:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143141.281018:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143141.281027:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858876416 00000100:00100000:1.0:1746143141.281072:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858876416 00010000:00010000:2.0:1746143141.281093:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f3a expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.281118:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.281121:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:1.0:1746143141.281123:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009b59ad80 x1830962858876416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143141.281130:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 31 pid: 8449 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143141.281133:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59ad80 with x1830962858876416 ext(3145728->4194303) 00002000:00010000:1.0:1746143141.281138:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59ad80 00010000:00010000:2.0:1746143141.281147:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 31 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.281156:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094576a00, rc 0) 00000100:00100000:1.0:1746143141.281163:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6324 00000100:00100000:1.0:1746143141.281171:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858876416:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143141.281198:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:31197:x1830962858876544:12345-192.168.201.28@tcp:101:cat.0 Request processed in 198us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.281206:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12920 00000100:00100000:2.0:1746143141.281946:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.282008:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858876800 00000100:00100000:3.0:1746143141.282012:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858876800 00002000:00100000:3.0:1746143141.282050:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2826240->2830335) req@ffff880094511880 x1830962858876800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.282059:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511880 with x1830962858876800 ext(2826240->2830335) 00002000:00010000:3.0:1746143141.282063:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094511880 00000100:00100000:3.0:1746143141.282076:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6325 00000100:00100000:3.0:1746143141.282093:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858876800:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:3.0:1746143141.282205:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+31:1971:x1830962858876800:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 123us (260us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143141.282211:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6325 00002000:00100000:3.0:1746143141.282216:0:21521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x305:0x0] (2826240->2830335) req@ffff880094511880 x1830962858876800/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/4536 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.282223:0:21521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094511880 with x1830962858876800 ext(2826240->2830335) 00002000:00010000:3.0:1746143141.282225:0:21521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094511880 00000100:00100000:2.0:1746143141.283327:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861339904:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143141.283345:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143141.283640:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858876160:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5869us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.283650:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6868 00000100:00100000:0.0:1746143141.287371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.287570:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858877056 00000100:00100000:2.0:1746143141.287579:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858877056 00002000:00100000:2.0:1746143141.287623:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008fe7bb80 x1830962858877056/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.287633:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7bb80 with x1830962858877056 ext(3145728->4194303) 00002000:00010000:2.0:1746143141.287640:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7bb80 00000100:00100000:2.0:1746143141.287670:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6326 00000100:00100000:2.0:1746143141.287676:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858877056:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143141.292653:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.294743:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1968:x1830962858876416:12345-192.168.201.28@tcp:3:cat.0 Request processed in 13563us (14163us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143141.294757:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6324 00002000:00100000:1.0:1746143141.294770:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88009b59ad80 x1830962858876416/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143141.294781:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b59ad80 with x1830962858876416 ext(3145728->4194303) 00002000:00010000:1.0:1746143141.294787:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b59ad80 00000100:00100000:2.0:1746143141.295060:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858877184 00000100:00100000:2.0:1746143141.295070:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858877184 00000100:00100000:2.0:1746143141.295159:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12921 00000100:00100000:2.0:1746143141.295171:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:31202:x1830962858877184:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143141.295189:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.295211:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f41 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.295246:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 7 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.295260:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.295267:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.295273:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.295276:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.295280:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->3448831] (req 3145728->3448831) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.295314:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.295328:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:2.0:1746143141.295341:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861340032:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143141.295465:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 18 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.295475:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 18 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:2.0:1746143141.295484:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861340160:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143141.295528:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 7 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.295537:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 7 pid: 754 timeout: 1023 lvb_type: 1 00000100:00100000:2.0:1746143141.295546:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861340288:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143141.295574:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143141.298228:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858877056:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 10541us (10857us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143141.298240:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6326 00002000:00100000:2.0:1746143141.298252:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (3145728->4194303) req@ffff88008fe7bb80 x1830962858877056/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.298262:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe7bb80 with x1830962858877056 ext(3145728->4194303) 00002000:00010000:2.0:1746143141.298268:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe7bb80 00000100:00100000:2.0:1746143141.298938:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094511c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861340032:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143141.298946:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.298947:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861340160:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143141.298954:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861340288:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143141.298987:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [3145728->3448831] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.299003:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a2b7e00, rc 0) 00000100:00100000:2.0:1746143141.299025:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:31202:x1830962858877184:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 3858us (6384us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.299051:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12921 00000100:00100000:3.0:1746143141.299054:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858877312 00000100:00100000:3.0:1746143141.299060:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858877312 00010000:00010000:3.0:1746143141.299094:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 8 pid: 754 timeout: 1023 lvb_type: 1 00000100:00100000:3.0:1746143141.299131:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6869 00000100:00100000:3.0:1746143141.299138:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+8:1969:x1830962858877312:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143141.299150:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143141.299583:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 8 pid: 754 timeout: 1023 lvb_type: 1 00010000:00010000:3.0:1746143141.299595:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 8 pid: 754 timeout: 1023 lvb_type: 1 00010000:00010000:3.0:1746143141.299618:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e8b7200/0x25aee876ca70e73d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650edf expref: 8 pid: 754 timeout: 1023 lvb_type: 1 00010000:00010000:3.0:1746143141.299642:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143141.299671:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1969:x1830962858877312:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 534us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.299677:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6869 00000100:00100000:0.0:1746143141.300663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.300811:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858877440 00000100:00100000:3.0:1746143141.300817:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858877440 00010000:00010000:3.0:1746143141.300831:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:3.0:1746143141.300859:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6870 00000100:00100000:3.0:1746143141.300863:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858877440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143141.300872:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143141.300883:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.300891:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.300904:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d91400/0x25aee876ca70e705 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ec3 expref: 24 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.300911:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143141.300933:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1971:x1830962858877440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.300939:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6870 00000100:00100000:0.0:1746143141.302120:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.302210:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858877568 00000100:00100000:3.0:1746143141.302214:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858877568 00010000:00010000:3.0:1746143141.302232:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 19 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:3.0:1746143141.302252:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6871 00000100:00100000:3.0:1746143141.302258:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858877568:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143141.302267:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143141.302303:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 19 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.302313:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 19 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.302330:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e13600/0x25aee876ca70e759 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ef4 expref: 19 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.302341:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143141.302343:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143141.302350:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.302358:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.302391:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.302403:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861340416:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143141.302583:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143141.304443:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.304477:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.304605:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858877696 00000100:00100000:2.0:1746143141.304612:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858877696 00000100:00100000:2.0:1746143141.304651:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858877824 00000100:00100000:2.0:1746143141.304654:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858877824 00000100:00100000:2.0:1746143141.304685:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12922 00000100:00100000:2.0:1746143141.304693:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858877696:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143141.304709:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.304726:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093245400/0x25aee876ca70e7d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f48 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.304733:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12923 00000100:00100000:3.0:1746143141.304741:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858877824:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.304750:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.304762:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931f8200/0x25aee876ca70e7de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f4f expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143141.304979:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861340544:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143141.304987:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931f8200/0x25aee876ca70e7de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f4f expref: 27 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.305002:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931f8200/0x25aee876ca70e7de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f4f expref: 27 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.305012:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8200, rc 0) 00000100:00100000:2.0:1746143141.305058:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143141.305061:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1969:x1830962858877824:12345-192.168.201.28@tcp:101:cat.0 Request processed in 321us (582us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143141.305067:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12923 00000100:00100000:3.0:1746143141.305119:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861340416:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143141.305133:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143141.305152:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858877568:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 2895us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.305160:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6871 00000100:00100000:0.0:1746143141.307725:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.309163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.309227:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858877952 00000100:00100000:1.0:1746143141.309235:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858877952 00000100:00100000:0.0:1746143141.309251:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.309268:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858878080 00000100:00100000:1.0:1746143141.309271:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858878080 00000100:00100000:1.0:1746143141.309288:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12924 00000100:00100000:1.0:1746143141.309294:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1970:x1830962858877952:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143141.309312:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143141.309324:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12925 00010000:00010000:1.0:1746143141.309329:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f56 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143141.309332:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858878080:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143141.309340:0:754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.309350:0:754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a2b7c00/0x25aee876ca70e7ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f5d expref: -99 pid: 754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.309352:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.309354:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143141.309363:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.309369:0:754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a2b7c00/0x25aee876ca70e7ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f5d expref: 31 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143141.309377:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 24 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.309379:0:754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a2b7c00/0x25aee876ca70e7ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f5d expref: 31 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.309394:0:754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a2b7c00, rc 0) 00010000:00010000:1.0:1746143141.309425:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c7cc00, rc 0) 00000100:00100000:2.0:1746143141.309433:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1970:x1830962858878080:12345-192.168.201.28@tcp:101:cat.0 Request processed in 102us (275us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143141.309439:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12925 00000100:00100000:1.0:1746143141.309441:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1970:x1830962858877952:12345-192.168.201.28@tcp:101:cat.0 Request processed in 148us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143141.309451:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12924 00000100:00100000:2.0:1746143141.309465:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858878336 00000100:00100000:2.0:1746143141.309468:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858878336 00002000:00010000:3.0:1746143141.309540:0:8449:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime: 1746143139 -> 1746143140 00002000:00010000:3.0:1746143141.309544:0:8449:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime: 1746143139 -> 1746143140 00002000:00010000:3.0:1746143141.309546:0:8449:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime: 1746143139 -> 1746143140 00000100:00100000:3.0:1746143141.309567:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1830962861340544:192.168.201.28@tcp:106: 00010000:00010000:3.0:1746143141.309594:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093245400/0x25aee876ca70e7d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f48 expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.309604:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093245400/0x25aee876ca70e7d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f48 expref: 19 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.309611:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093245400, rc 0) 00000100:00100000:3.0:1746143141.309631:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:1969:x1830962858877696:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4940us (5195us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143141.309638:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12922 00002000:00100000:2.0:1746143141.310133:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3444736->3448831) req@ffff88009310fb80 x1830962858878336/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.310140:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310fb80 with x1830962858878336 ext(3444736->3448831) 00002000:00010000:2.0:1746143141.310144:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310fb80 00000100:00100000:2.0:1746143141.310165:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6327 00000100:00100000:2.0:1746143141.310170:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858878336:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:2.0:1746143141.310292:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858878336:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 122us (1042us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143141.310296:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6327 00002000:00100000:2.0:1746143141.310300:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3444736->3448831) req@ffff88009310fb80 x1830962858878336/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/4536 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.310305:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310fb80 with x1830962858878336 ext(3444736->3448831) 00002000:00010000:2.0:1746143141.310307:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009310fb80 00000100:00100000:0.0:1746143141.313181:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.313282:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.313388:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858878464 00000100:00100000:2.0:1746143141.313396:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858878464 00000100:00100000:1.0:1746143141.313498:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858878720 00000100:00100000:1.0:1746143141.313502:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858878720 00002000:00100000:1.0:1746143141.313535:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009310c700 x1830962858878720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143141.313598:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12926 00000100:00100000:2.0:1746143141.313606:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+18:31200:x1830962858878464:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:2.0:1746143141.313625:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.313689:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7a00/0x25aee876ca70e7f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f64 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.313724:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.313732:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143141.313734:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143141.313737:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7a00/0x25aee876ca70e7f3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f64 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143141.313776:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310c700 with x1830962858878720 ext(4194304->5210111) 00010000:00010000:1.0:1746143141.313784:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143141.313792:0:8454:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143141.313799:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310c700 00000100:00100000:1.0:1746143141.313817:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2058 00000100:00100000:1.0:1746143141.313823:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1971:x1830962858878720:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:0.0:1746143141.314181:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:2.0:1746143141.314248:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.314261:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 24 pid: 8449 timeout: 1023 lvb_type: 0 00000100:00100000:2.0:1746143141.314272:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861340672:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143141.314364:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143141.314694:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858878976 00000100:00100000:1.0:1746143141.314698:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858878976 00000100:00100000:2.0:1746143141.316022:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861340672:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143141.316069:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7a00/0x25aee876ca70e7f3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [4194304->5210111] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f64 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.316132:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a2b7a00, rc 0) 00000100:00100000:2.0:1746143141.316167:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31200:x1830962858878464:12345-192.168.201.28@tcp:101:cat.0 Request processed in 2562us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.316174:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12926 00000100:00100000:1.0:1746143141.316934:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3517 00000100:00100000:1.0:1746143141.316945:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f1d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+205:31202:x1830962858878976:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:0.0:1746143141.317003:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.317151:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858879104 00000100:00100000:2.0:1746143141.317157:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858879104 00002000:00100000:2.0:1746143141.317185:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3448831) req@ffff88009310d500 x1830962858879104/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.317194:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310d500 with x1830962858879104 ext(3145728->3448831) 00010000:00010000:2.0:1746143141.317200:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 25 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.317211:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 25 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:2.0:1746143141.317217:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310d500 00000100:00100000:2.0:1746143141.318158:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2059 00000100:00100000:2.0:1746143141.318166:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858879104:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:1.0:1746143141.318190:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f1d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:31202:x1830962858878976:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 1249us (4011us total) trans 8589942510 rc 0/0 00000100:00100000:1.0:1746143141.318196:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3517 00000100:00100000:0.0:1746143141.329538:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+28:1969:x1830962858879104:12345-192.168.201.28@tcp:4:cat.0 Request processed in 11364us (12532us total) trans 21474840136 rc 0/0 00000100:00100000:0.0:1746143141.329550:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2059 00002000:00100000:0.0:1746143141.329560:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2ff:0x0] (3145728->3448831) req@ffff88009310d500 x1830962858879104/t21474840136(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/448 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143141.329568:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310d500 with x1830962858879104 ext(3145728->3448831) 00010000:00010000:0.0:1746143141.329577:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:0.0:1746143141.329590:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 28 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:0.0:1746143141.329596:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310d500 00000100:00100000:0.0:1746143141.332461:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.332645:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858879232 00000100:00100000:2.0:1746143141.332652:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858879232 00000100:00100000:2.0:1746143141.332695:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12927 00000100:00100000:2.0:1746143141.332701:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:31206:x1830962858879232:12345-192.168.201.28@tcp:101:multiop.0 00010000:00010000:2.0:1746143141.332716:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143141.332729:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009340a600/0x25aee876ca70e7fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f6b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.333006:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.333015:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 27 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.333027:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.333059:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.333060:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.333064:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009340a600/0x25aee876ca70e7fa lrc: 6/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [1122304->1970175] (req 1122304->1970175) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f6b expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.333244:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 6 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.333255:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 6 pid: 754 timeout: 1023 lvb_type: 1 00000100:00100000:2.0:1746143141.333267:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861340800:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143141.333576:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1971:x1830962858878720:12345-192.168.201.28@tcp:3:cat.0 Request processed in 19734us (20275us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746143141.333587:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2058 00002000:00100000:3.0:1746143141.333598:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff88009310c700 x1830962858878720/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:H/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.333607:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009310c700 with x1830962858878720 ext(4194304->5210111) 00010000:00010000:3.0:1746143141.333616:0:8454:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.333627:0:8454:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 26 pid: 8449 timeout: 1023 lvb_type: 0 00002000:00010000:3.0:1746143141.333633:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009310c700 00010000:00010000:2.0:1746143141.333895:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 25 pid: 4756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.333906:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 25 pid: 4756 timeout: 1023 lvb_type: 1 00000100:00100000:2.0:1746143141.333915:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092996a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861340928:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143141.333954:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 20 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.333967:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 20 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:2.0:1746143141.333975:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861341056:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143141.333989:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129fc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143141.335105:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.335206:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861340800:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143141.335351:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858879360 00000100:00100000:3.0:1746143141.335357:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858879360 00010000:00010000:3.0:1746143141.335382:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 7 pid: 754 timeout: 1023 lvb_type: 1 00000100:00100000:3.0:1746143141.335732:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6872 00000100:00100000:3.0:1746143141.335741:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1968:x1830962858879360:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143141.335959:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143141.335977:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 7 pid: 754 timeout: 1023 lvb_type: 1 00010000:00010000:3.0:1746143141.335992:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 7 pid: 754 timeout: 1023 lvb_type: 1 00010000:00010000:3.0:1746143141.336010:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309f3e00/0x25aee876ca70e79f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f10 expref: 7 pid: 754 timeout: 1023 lvb_type: 1 00010000:00010000:3.0:1746143141.336026:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143141.336073:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1968:x1830962858879360:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 333us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.336080:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6872 00000100:00100000:2.0:1746143141.338311:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092996a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861340928:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143141.338387:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.338680:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858879488 00000100:00100000:2.0:1746143141.338685:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858879488 00010000:00010000:2.0:1746143141.338712:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 26 pid: 4756 timeout: 1023 lvb_type: 1 00000100:00100000:2.0:1746143141.338748:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6873 00000100:00100000:2.0:1746143141.338754:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1970:x1830962858879488:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143141.338765:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143141.338782:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 26 pid: 4756 timeout: 1023 lvb_type: 1 00010000:00010000:2.0:1746143141.338791:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 26 pid: 4756 timeout: 1023 lvb_type: 1 00010000:00010000:2.0:1746143141.338809:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092c7cc00/0x25aee876ca70e7e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f56 expref: 26 pid: 4756 timeout: 1023 lvb_type: 1 00010000:00010000:2.0:1746143141.338830:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143141.338872:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1970:x1830962858879488:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 116us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.338879:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6873 00000100:00100000:0.0:1746143141.339516:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.339720:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858880000 00000100:00100000:3.0:1746143141.339724:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858880000 00010000:00010000:3.0:1746143141.339741:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 25 pid: 8449 timeout: 1023 lvb_type: 0 00000100:00100000:3.0:1746143141.339758:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6874 00000100:00100000:3.0:1746143141.339764:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1971:x1830962858880000:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143141.339971:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143141.339984:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 25 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.339993:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 25 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.340006:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7e00/0x25aee876ca70e7d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f41 expref: 25 pid: 8449 timeout: 1023 lvb_type: 0 00010000:00010000:3.0:1746143141.340016:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143141.340018:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143141.340024:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7a00/0x25aee876ca70e7f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f64 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.340050:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7a00/0x25aee876ca70e7f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f64 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.340078:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7a00/0x25aee876ca70e7f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f64 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.340104:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861341184:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143141.340147:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4758:1830962861341056:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143141.340168:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b000 going to sleep for 11 seconds 00010000:00010000:2.0:1746143141.340173:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009340a600/0x25aee876ca70e7fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1122304->1970175] (req 1122304->1970175) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f6b expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.340690:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009340a600, rc 0) 00000100:00100000:2.0:1746143141.340743:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:31206:x1830962858879232:12345-192.168.201.28@tcp:101:multiop.0 Request processed in 8040us (8287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.340751:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12927 00000100:00100000:0.0:1746143141.340802:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.340858:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.340870:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858880128 00000100:00100000:0.0:1746143141.340874:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858880128 00010000:00010000:0.0:1746143141.340888:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 20 pid: 8169 timeout: 1023 lvb_type: 0 00000100:00100000:2.0:1746143141.340892:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858879744 00000100:00100000:2.0:1746143141.340896:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858879744 00000100:00100000:0.0:1746143141.340904:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6875 00000100:00100000:0.0:1746143141.340909:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1968:x1830962858880128:12345-192.168.201.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143141.340915:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12928 00010000:00010000:0.0:1746143141.340915:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143141.340921:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858879744:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:0.0:1746143141.340924:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 20 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.340931:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143141.340931:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 20 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.340941:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f79 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.340944:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d91800/0x25aee876ca70e728 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ed1 expref: 20 pid: 8169 timeout: 1023 lvb_type: 0 00010000:00010000:2.0:1746143141.340953:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.340955:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143141.340955:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143141.340957:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143141.340960:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143141.340961:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009340a600/0x25aee876ca70e7fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1970175) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f6b expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143141.340968:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009340a600/0x25aee876ca70e7fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1970175) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f6b expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143141.340976:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.340984:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009340b000, rc 0) 00010000:00010000:0.0:1746143141.340988:0:4759:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009340a600/0x25aee876ca70e7fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1970175) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f6b expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143141.340996:0:4759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b88a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861341312:192.168.201.28@tcp:105: 00000100:00100000:2.0:1746143141.341005:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858879744:12345-192.168.201.28@tcp:101:cat.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143141.341010:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12928 00000100:00100000:0.0:1746143141.341018:0:4759:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143141.341578:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.342245:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.342614:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858879616 00000100:00100000:3.0:1746143141.342619:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858879616 00000100:00100000:3.0:1746143141.342629:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858879872 00000100:00100000:3.0:1746143141.342631:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858879872 00000100:00100000:3.0:1746143141.342664:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12929 00000100:00100000:3.0:1746143141.342671:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858879872:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.342680:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.342691:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931f8c00/0x25aee876ca70e808 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f80 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.342711:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931f8c00/0x25aee876ca70e808 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f80 expref: 31 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.342724:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931f8c00/0x25aee876ca70e808 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f80 expref: 31 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.342733:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8c00, rc 0) 00000100:00100000:3.0:1746143141.342767:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1968:x1830962858879872:12345-192.168.201.28@tcp:101:cat.0 Request processed in 96us (521us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143141.342773:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12929 00000100:00100000:3.0:1746143141.342800:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12930 00000100:00100000:3.0:1746143141.342804:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+26:1968:x1830962858879616:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.342811:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.342818:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931f8000/0x25aee876ca70e80f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f72 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.342845:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861341440:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143141.342885:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e17b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143141.344005:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.344062:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858880384 00000100:00100000:2.0:1746143141.344066:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858880384 00002000:00100000:2.0:1746143141.344102:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800942c6680 x1830962858880384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.344110:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6680 with x1830962858880384 ext(4194304->5210111) 00002000:00010000:2.0:1746143141.344115:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c6680 00000100:00100000:2.0:1746143141.344136:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6328 00000100:00100000:2.0:1746143141.344143:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+20:1969:x1830962858880384:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143141.346784:0:4759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b88a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:4759:1830962861341312:192.168.201.28@tcp:105: 00010000:00010000:0.0:1746143141.346803:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143141.346830:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858880128:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 5920us (5971us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143141.346840:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6875 00000100:00100000:3.0:1746143141.349399:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861341184:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143141.349418:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143141.349460:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1971:x1830962858880000:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9695us (9944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143141.349664:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6874 00002000:00010000:2.0:1746143141.349881:0:8169:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime: 1746143139 -> 1746143140 00002000:00010000:2.0:1746143141.349885:0:8169:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime: 1746143139 -> 1746143140 00002000:00010000:2.0:1746143141.349887:0:8169:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime: 1746143139 -> 1746143140 00000100:00100000:2.0:1746143141.349903:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861341440:192.168.201.28@tcp:106: 00010000:00010000:2.0:1746143141.349923:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931f8000/0x25aee876ca70e80f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f72 expref: 26 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.349947:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931f8000/0x25aee876ca70e80f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f72 expref: 26 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143141.349957:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8000, rc 0) 00000100:00100000:2.0:1746143141.349977:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858879616:12345-192.168.201.28@tcp:101:cat.0 Request processed in 7172us (8401us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143141.349983:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12930 00000100:00100000:0.0:1746143141.349988:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.350011:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858880640 00000100:00100000:0.0:1746143141.350016:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858880640 00002000:00100000:0.0:1746143141.350069:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1122304->1126399) req@ffff880093b88a80 x1830962858880640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143141.350078:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b88a80 with x1830962858880640 ext(1122304->1126399) 00002000:00010000:0.0:1746143141.350094:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b88a80 00000100:00100000:0.0:1746143141.350118:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6329 00000100:00100000:0.0:1746143141.350126:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858880640:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143141.350262:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1968:x1830962858880640:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 136us (274us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143141.350271:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6329 00002000:00100000:0.0:1746143141.350277:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1122304->1126399) req@ffff880093b88a80 x1830962858880640/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/4536 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143141.350285:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b88a80 with x1830962858880640 ext(1122304->1126399) 00002000:00010000:0.0:1746143141.350288:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b88a80 00000100:00100000:2.0:1746143141.352910:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1969:x1830962858880384:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 8762us (8900us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746143141.352919:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6328 00002000:00100000:2.0:1746143141.352928:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (4194304->5210111) req@ffff8800942c6680 x1830962858880384/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/440 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.352937:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942c6680 with x1830962858880384 ext(4194304->5210111) 00002000:00010000:2.0:1746143141.352942:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942c6680 00000100:00100000:0.0:1746143141.355825:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.355870:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.355969:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858880768 00000100:00100000:3.0:1746143141.355977:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858880768 00000100:00100000:3.0:1746143141.356022:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858880896 00000100:00100000:3.0:1746143141.356025:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858880896 00000100:00100000:1.0:1746143141.356055:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12931 00000100:00100000:1.0:1746143141.356064:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858880768:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:1.0:1746143141.356079:0:4756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143141.356102:0:4756:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb74200/0x25aee876ca70e816 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f87 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143141.356209:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12932 00000100:00100000:3.0:1746143141.356216:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858880896:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.356224:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.356233:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931f8400/0x25aee876ca70e81d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f8e expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.356252:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931f8400/0x25aee876ca70e81d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f8e expref: 31 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.356263:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931f8400/0x25aee876ca70e81d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f8e expref: 31 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.356274:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8400, rc 0) 00000100:00100000:3.0:1746143141.356310:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+30:1969:x1830962858880896:12345-192.168.201.28@tcp:101:cat.0 Request processed in 96us (440us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143141.356316:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12932 00000100:00100000:1.0:1746143141.356479:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861341568:192.168.201.28@tcp:106: 00000100:00100000:1.0:1746143141.356526:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e21a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143141.358745:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.359268:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858881152 00000100:00100000:2.0:1746143141.359277:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858881152 00002000:00100000:2.0:1746143141.359311:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1966080->1970175) req@ffff88009a248e00 x1830962858881152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.359320:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248e00 with x1830962858881152 ext(1966080->1970175) 00002000:00010000:2.0:1746143141.359324:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a248e00 00000100:00100000:2.0:1746143141.359460:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6330 00000100:00100000:2.0:1746143141.359468:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858881152:12345-192.168.201.28@tcp:3:multiop.0 00000100:00100000:0.0:1746143141.359521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143141.359620:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861341568:192.168.201.28@tcp:106: 00000100:00100000:3.0:1746143141.359627:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858881280 00000100:00100000:3.0:1746143141.359631:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858881280 00010000:00010000:1.0:1746143141.359648:0:4756:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb74200/0x25aee876ca70e816 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f87 expref: 26 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143141.359655:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12933 00010000:00010000:1.0:1746143141.359658:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb74200/0x25aee876ca70e816 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f87 expref: 26 pid: 4756 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143141.359660:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858881280:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.359668:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143141.359671:0:4756:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb74200, rc 0) 00010000:00010000:3.0:1746143141.359678:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931f8a00/0x25aee876ca70e824 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f95 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.359703:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931f8a00/0x25aee876ca70e824 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f95 expref: 27 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.359716:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931f8a00/0x25aee876ca70e824 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f95 expref: 27 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.359724:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f8a00, rc 0) 00000100:00100000:2.0:1746143141.359833:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1968:x1830962858881152:12345-192.168.201.28@tcp:3:multiop.0 Request processed in 365us (1091us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143141.359840:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6330 00002000:00100000:2.0:1746143141.359846:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2fe:0x0] (1966080->1970175) req@ffff88009a248e00 x1830962858881152/t0(0) o3->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/4536 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143141.360105:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858880768:12345-192.168.201.28@tcp:101:cat.0 Request processed in 4042us (4286us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143141.360115:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12931 00002000:00100000:2.0:1746143141.360324:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248e00 with x1830962858881152 ext(1966080->1970175) 00002000:00010000:2.0:1746143141.360327:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a248e00 00000100:00100000:3.0:1746143141.360563:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858881280:12345-192.168.201.28@tcp:101:cat.0 Request processed in 901us (1041us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143141.360568:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12933 00000100:00100000:0.0:1746143141.362204:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143141.362735:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.362793:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858881792 00000100:00100000:1.0:1746143141.362793:0:16950:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858881536 00000100:00100000:2.0:1746143141.362799:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858881792 00000100:00100000:1.0:1746143141.362799:0:16950:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858881536 00002000:00100000:2.0:1746143141.362826:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88009a249180 x1830962858881792/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.362834:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a249180 with x1830962858881792 ext(5206016->5210111) 00002000:00010000:2.0:1746143141.362838:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a249180 00000100:00100000:1.0:1746143141.362840:0:16950:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3518 00000100:00100000:1.0:1746143141.362846:0:16950:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+15:31206:x1830962858881536:12345-192.168.201.28@tcp:35:multiop.0 00000100:00100000:2.0:1746143141.362851:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6331 00000100:00100000:2.0:1746143141.362855:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858881792:12345-192.168.201.28@tcp:3:cat.0 00000100:00100000:2.0:1746143141.362961:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858881792:12345-192.168.201.28@tcp:3:cat.0 Request processed in 105us (227us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143141.362966:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6331 00002000:00100000:2.0:1746143141.362971:0:8454:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2ff:0x0] (5206016->5210111) req@ffff88009a249180 x1830962858881792/t0(0) o3->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:292/0 lens 488/4536 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.362977:0:8454:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a249180 with x1830962858881792 ext(5206016->5210111) 00002000:00010000:2.0:1746143141.362980:0:8454:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a249180 00000100:00100000:1.0:1746143141.362988:0:16950:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31206:x1830962858881536:12345-192.168.201.28@tcp:35:multiop.0 Request processed in 142us (786us total) trans 8589942511 rc 0/0 00000100:00100000:1.0:1746143141.362994:0:16950:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3518 00000100:00100000:0.0:1746143141.363853:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.364193:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858881920 00000100:00100000:3.0:1746143141.364197:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858881920 00000100:00100000:3.0:1746143141.364229:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12934 00000100:00100000:3.0:1746143141.364235:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858881920:12345-192.168.201.28@tcp:101:cat.0 00010000:00010000:3.0:1746143141.364244:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143141.364256:0:8449:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931f9400/0x25aee876ca70e82b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650f9c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143141.364278:0:8449:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931f9400/0x25aee876ca70e82b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f9c expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.364288:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931f9400/0x25aee876ca70e82b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f9c expref: 27 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143141.364297:0:8449:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f9400, rc 0) 00000100:00100000:3.0:1746143141.364330:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+26:1970:x1830962858881920:12345-192.168.201.28@tcp:101:cat.0 Request processed in 96us (478us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143141.364336:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12934 00000100:00100000:1.0:1746143141.369278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.369390:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858882304 00000100:00100000:3.0:1746143141.369399:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858882304 00000100:00100000:3.0:1746143141.369643:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3519 00000100:00100000:3.0:1746143141.369649:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:31200:x1830962858882304:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:3.0:1746143141.369830:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:31200:x1830962858882304:12345-192.168.201.28@tcp:35:cat.0 Request processed in 179us (560us total) trans 8589942512 rc 0/0 00000100:00100000:3.0:1746143141.369836:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3519 00000100:00100000:0.0:1746143141.370050:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143141.370150:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858882432 00000100:00100000:3.0:1746143141.370153:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858882432 00000100:00100000:3.0:1746143141.370177:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3520 00000100:00100000:3.0:1746143141.370182:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+206:31197:x1830962858882432:12345-192.168.201.28@tcp:35:cat.0 00000100:00100000:3.0:1746143141.371734:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31197:x1830962858882432:12345-192.168.201.28@tcp:35:cat.0 Request processed in 1545us (1697us total) trans 8589942513 rc 0/0 00000100:00100000:3.0:1746143141.371742:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3520 00000100:00100000:0.0:1746143141.431512:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143141.431576:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858882560 00000100:00100000:2.0:1746143141.431585:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858882560 00002000:00100000:2.0:1746143141.431628:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1122304->1970175) req@ffff88009a248000 x1830962858882560/t0(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/0 e 0 to 0 dl 1746143152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143141.431637:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248000 with x1830962858882560 ext(1122304->1970175) 00002000:00010000:2.0:1746143141.431642:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a248000 00000100:00100000:2.0:1746143141.431669:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6332 00000100:00100000:2.0:1746143141.431677:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+19:1970:x1830962858882560:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143141.454777:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+21:1970:x1830962858882560:12345-192.168.201.28@tcp:4:cat.0 Request processed in 23090us (23262us total) trans 21474840137 rc 0/0 00000100:00100000:3.0:1746143141.454788:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6332 00002000:00100000:3.0:1746143141.454800:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2fe:0x0] (1122304->1970175) req@ffff88009a248000 x1830962858882560/t21474840137(0) o4->ab4e34bd-f4d2-4b66-8c4a-431938b39ad2@192.168.201.28@tcp:292/0 lens 488/448 e 0 to 0 dl 1746143152 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143141.454809:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a248000 with x1830962858882560 ext(1122304->1970175) 00002000:00010000:3.0:1746143141.454814:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a248000 00010000:00010000:0.0:1746143141.547262:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1746143141.972199:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872862 is committed 00000001:00080000:2.0:1746143141.972224:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872846 is committed 00000001:00080000:2.0:1746143141.972423:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872869 is committed 00000001:00080000:2.0:1746143141.972431:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872868 is committed 00000001:00080000:2.0:1746143141.972436:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872867 is committed 00000001:00080000:2.0:1746143141.972491:0:2209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872870 is committed 00000100:00100000:0.0:1746143142.251603:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143142.251643:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143142.251669:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143142.251696:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143142.251714:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143142.252010:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858882688 00000100:00100000:2.0:1746143142.252022:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858882688 00000100:00100000:2.0:1746143142.252114:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858882944 00000100:00100000:2.0:1746143142.252117:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858882944 00000100:00100000:2.0:1746143142.252134:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858883200 00000100:00100000:2.0:1746143142.252136:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858883200 00000100:00100000:2.0:1746143142.252148:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858882816 00000100:00100000:2.0:1746143142.252151:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858882816 00000100:00100000:0.0:1746143142.252160:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143142.252161:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858883072 00000100:00100000:2.0:1746143142.252163:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858883072 00000100:00100000:2.0:1746143142.252175:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858883328 00000100:00100000:2.0:1746143142.252178:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858883328 00000100:00100000:0.0:1746143142.252194:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12935 00000100:00100000:0.0:1746143142.252208:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858882688:12345-192.168.201.28@tcp:16:kworker.0 00000100:00100000:2.0:1746143142.252686:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12936 00000100:00100000:0.0:1746143142.252694:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12937 00000100:00100000:2.0:1746143142.252695:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858882944:12345-192.168.201.28@tcp:16:kworker.0 00000100:00100000:0.0:1746143142.252703:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858883200:12345-192.168.201.28@tcp:16:kworker.0 00000100:00100000:0.0:1746143142.252736:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12938 00000100:00100000:0.0:1746143142.252742:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858882816:12345-192.168.201.28@tcp:16:kworker.0 00000100:00100000:2.0:1746143142.253009:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858882944:12345-192.168.201.28@tcp:16:kworker.0 Request processed in 314us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143142.253017:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12936 00000100:00100000:2.0:1746143142.253048:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12939 00000100:00100000:2.0:1746143142.253054:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+23:1971:x1830962858883072:12345-192.168.201.28@tcp:16:kworker.0 00000100:00100000:2.0:1746143142.253100:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12940 00000100:00100000:2.0:1746143142.253106:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858883328:12345-192.168.201.28@tcp:16:kworker.0 00000100:00100000:2.0:1746143142.253136:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858883328:12345-192.168.201.28@tcp:16:kworker.0 Request processed in 30us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143142.253141:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12940 00000100:00100000:0.0:1746143142.253213:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1971:x1830962858882816:12345-192.168.201.28@tcp:16:kworker.0 Request processed in 470us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143142.253221:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12938 00000100:00100000:3.0:1746143142.351171:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3299:1830962861341696:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351229:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143142.351279:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861342208:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351303:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143142.351322:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746143142.351328:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1830962861341824:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351347:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143142.351359:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830962861342336:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351373:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143142.351393:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1830962861341952:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351410:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143142.351423:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143142.351427:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861342080:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351444:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143142.351472:0:14791:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861341696 00000100:00100000:3.0:1746143142.351479:0:14791:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861341696 00000100:00100000:3.0:1746143142.351514:0:14791:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1746143142.351521:0:14791:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3299:x1830962861341696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351562:0:14791:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd11cc8-8af2-413f-b8ae-b15f59b267b4+18:3299:x1830962861341696:12345-0@lo:400:kworker.0 Request processed in 41us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143142.351568:0:14791:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1746143142.351597:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861341824 00000100:00100000:3.0:1746143142.351600:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861341824 00000100:00100000:3.0:1746143142.351626:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861342336 00000100:00100000:3.0:1746143142.351628:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861342336 00000100:00100000:3.0:1746143142.351640:0:17079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861341952 00000100:00100000:3.0:1746143142.351642:0:17079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861341952 00000100:00100000:3.0:1746143142.351656:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1746143142.351661:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830962861341824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351689:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830962861341824:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143142.351695:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1746143142.351705:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1746143142.351709:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830962861342336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.351968:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830962861342336:12345-0@lo:400:kworker.0 Request processed in 258us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143142.351974:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1746143142.351985:0:17079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1746143142.351990:0:17079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830962861341952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.352013:0:17079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830962861341952:12345-0@lo:400:kworker.0 Request processed in 23us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143142.352018:0:17079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1746143142.352380:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861342208 00000100:00100000:1.0:1746143142.352585:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861342208 00000100:00100000:1.0:1746143142.352611:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861342080 00000100:00100000:1.0:1746143142.352614:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861342080 00000100:00100000:1.0:1746143142.352630:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1746143142.352635:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861342208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143142.352666:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1830962861342208:12345-0@lo:400:kworker.0 Request processed in 31us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143142.352672:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1746143142.352683:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1746143142.352687:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3301:x1830962861342080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143142.352711:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3301:x1830962861342080:12345-0@lo:400:kworker.0 Request processed in 24us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143142.352715:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00080000:1.0:1746143142.352731:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143142.352734:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143142.352736:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143142.354393:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861342080:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.355380:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1830962861341952:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.355616:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1830962861341824:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.355625:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830962861342336:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.355632:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dbd11cc8-8af2-413f-b8ae-b15f59b267b4:3299:1830962861341696:0@lo:400:kworker.0 00000100:00100000:3.0:1746143142.355638:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872867 gen 2 00000004:00080000:3.0:1746143142.355642:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135183480, transno 17179872825 00000004:00080000:3.0:1746143142.355649:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baa2680, transno 17179872826 00000004:00080000:3.0:1746143142.355652:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b4a80, transno 17179872827 00000004:00080000:3.0:1746143142.355654:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b7b80, transno 17179872828 00000004:00080000:3.0:1746143142.355656:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135181500, transno 17179872829 00000004:00080000:3.0:1746143142.355657:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b7480, transno 17179872830 00000004:00080000:3.0:1746143142.355660:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135180380, transno 17179872831 00000004:00080000:3.0:1746143142.355662:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317b5180, transno 17179872832 00000004:00080000:3.0:1746143142.355664:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d6d80, transno 17179872833 00000004:00080000:3.0:1746143142.355666:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d6a00, transno 17179872834 00000004:00080000:3.0:1746143142.355668:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d7100, transno 17179872835 00000004:00080000:3.0:1746143142.355670:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d6300, transno 17179872836 00000004:00080000:3.0:1746143142.355672:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d5880, transno 17179872837 00000004:00080000:3.0:1746143142.355673:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d7800, transno 17179872838 00000004:00080000:3.0:1746143142.355675:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d4a80, transno 17179872839 00000004:00080000:3.0:1746143142.355677:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3d4e00, transno 17179872840 00000004:00080000:3.0:1746143142.355679:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b5b100, transno 17179872852 00000004:00080000:3.0:1746143142.355681:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092994a80, transno 17179872853 00000004:00080000:3.0:1746143142.355683:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919ddf80, transno 17179872854 00000004:00080000:3.0:1746143142.355685:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092996d80, transno 17179872855 00000004:00080000:3.0:1746143142.355687:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919df800, transno 17179872856 00000004:00080000:3.0:1746143142.355689:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092997800, transno 17179872857 00000004:00080000:3.0:1746143142.355691:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919ddc00, transno 17179872858 00000004:00080000:3.0:1746143142.355693:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919de300, transno 17179872859 00000004:00080000:3.0:1746143142.355694:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135182300, transno 17179872860 00000004:00080000:3.0:1746143142.355696:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135181f80, transno 17179872861 00000004:00080000:3.0:1746143142.355698:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135183100, transno 17179872862 00000004:00080000:3.0:1746143142.355700:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b88000, transno 17179872863 00000004:00080000:3.0:1746143142.355703:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e4a80, transno 17179872864 00000004:00080000:3.0:1746143142.355705:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e4700, transno 17179872865 00000004:00080000:3.0:1746143142.355707:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b8a300, transno 17179872866 00000004:00080000:3.0:1746143142.355709:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a84e5c00, transno 17179872867 00000100:00100000:3.0:1746143142.355712:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861342208:0@lo:400:kworker.0 00000004:00080000:3.0:1746143142.356441:0:14837:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 32 done 00000100:00100000:3.0:1746143142.368296:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861342464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746143142.368352:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143142.368383:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861342464 00000100:00100000:2.0:1746143142.368391:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861342464 00000100:00100000:2.0:1746143142.368438:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1746143142.368445:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3301:x1830962861342464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746143142.368494:0:8451:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 552665088 pending 20447232 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746143142.368530:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3301:x1830962861342464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143142.368536:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1746143142.369260:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861342464:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1746143142.388136:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840136 is committed 00000001:00080000:2.0:1746143142.388156:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840130 is committed 00000001:00080000:2.0:1746143142.388165:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840135 is committed 00000001:00080000:2.0:1746143142.388177:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840131 is committed 00000001:00080000:2.0:1746143142.388202:0:510:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840137 is committed 00000100:00100000:1.0:1746143142.388400:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+11:1971:x1830962858882688:12345-192.168.201.28@tcp:16:kworker.0 Request processed in 136192us (136803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143142.388411:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12935 00000100:00100000:3.0:1746143142.388545:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+10:1971:x1830962858883072:12345-192.168.201.28@tcp:16:kworker.0 Request processed in 135490us (136828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143142.388552:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12939 00000100:00100000:0.0:1746143142.388664:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1971:x1830962858883200:12345-192.168.201.28@tcp:16:kworker.0 Request processed in 135962us (136992us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143142.388670:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12937 00000100:00100000:0.0:1746143142.399228:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143142.399246:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861342592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143142.399301:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143142.399345:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861342592 00000100:00100000:2.0:1746143142.399353:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861342592 00000100:00100000:2.0:1746143142.399388:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1746143142.399394:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1830962861342592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143142.399430:0:8451:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 566165504 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1746143142.399473:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1830962861342592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143142.399479:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1746143142.399509:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861342592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143142.403553:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143142.403593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143142.403771:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858883456 00000100:00100000:2.0:1746143142.403779:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858883456 00000100:00100000:2.0:1746143142.403835:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 625 00000100:00100000:2.0:1746143142.403842:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1971:x1830962858883456:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143142.403854:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143142.403870:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009da34000/0x25aee876ca7060b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ba37 expref: 15 pid: 14792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143142.403974:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143142.404020:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b7a6235-c644-44a1-b40d-4d4c3954ac20+14:1971:x1830962858883456:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 177us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143142.404027:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 625 00000100:00100000:0.0:1746143142.404259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143142.404321:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858883712 00000100:00100000:1.0:1746143142.404326:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858883712 00000100:00100000:1.0:1746143142.404346:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858883584 00000100:00100000:1.0:1746143142.404348:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858883584 00000100:00100000:1.0:1746143142.404362:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 626 00000100:00100000:1.0:1746143142.404367:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8b7a6235-c644-44a1-b40d-4d4c3954ac20+15:1971:x1830962858883712:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143142.404374:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143142.404382:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008fdd2a00/0x25aee876ca7060c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ba68 expref: 15 pid: 14791 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143142.404393:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143142.404625:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8b7a6235-c644-44a1-b40d-4d4c3954ac20+14:1971:x1830962858883712:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 51us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143142.404631:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 626 00000100:00100000:1.0:1746143142.404641:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 627 00000100:00100000:1.0:1746143142.404646:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8b7a6235-c644-44a1-b40d-4d4c3954ac20+13:1971:x1830962858883584:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143142.404652:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143142.404659:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009da35000/0x25aee876ca7060bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ba61 expref: 13 pid: 14792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143142.404665:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143142.404676:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8b7a6235-c644-44a1-b40d-4d4c3954ac20+12:1971:x1830962858883584:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 30us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143142.404680:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 627 00000100:00100000:1.0:1746143142.408692:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143142.408777:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858884224 00000100:00100000:0.0:1746143142.408786:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858884224 00000100:00100000:0.0:1746143142.408830:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12941 00000100:00100000:0.0:1746143142.408837:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+8:1967:x1830962858884224:12345-192.168.201.28@tcp:9:umount.0 00000020:00000080:0.0:1746143142.408864:0:8450:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x25aee876ca7060d8 00000020:00010000:0.0:1746143142.408869:0:8450:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012e1be800: total 0 00000100:00080000:0.0:1746143142.408873:0:8450:0:(import.c:66:import_set_state_nolock()) ffff88012e1be000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1746143142.408910:0:9870:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012e1be800: total 0 00000001:00000004:0.0:1746143142.408912:0:8450:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179872870 00010000:00010000:2.0:1746143142.408940:0:9870:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012e1be800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746143142.408981:0:9870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee83200/0x25aee876ca70e55a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650db2 expref: 7 pid: 754 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143142.409000:0:9870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee83600/0x25aee876ca70e545 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dab expref: 6 pid: 754 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746143142.409011:0:9870:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4137 -> 4139 00010000:00010000:2.0:1746143142.409018:0:9870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eaa0000/0x25aee876ca70e7c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f33 expref: 5 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143142.409026:0:9870:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012e1be800, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746143142.409054:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143142.409056:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143142.409058:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143142.409208:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+2:1967:x1830962858884224:12345-192.168.201.28@tcp:9:umount.0 Request processed in 370us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143142.409218:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12941 00000100:00100000:0.0:1746143142.426477:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143142.426584:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858884864 00000100:00100000:2.0:1746143142.426591:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858884864 00000100:00100000:2.0:1746143142.426630:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12942 00000100:00100000:2.0:1746143142.426637:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+9:1967:x1830962858884864:12345-192.168.201.28@tcp:9:umount.0 00000020:00000080:2.0:1746143142.426665:0:8450:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x25aee876ca7060d1 00000020:00010000:2.0:1746143142.426672:0:8450:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009b3c6000: total 0 00000100:00080000:2.0:1746143142.426676:0:8450:0:(import.c:66:import_set_state_nolock()) ffff88009b3c4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746143142.426712:0:8450:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840137 00000100:00100000:2.0:1746143142.426908:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+7:1967:x1830962858884864:12345-192.168.201.28@tcp:9:umount.0 Request processed in 272us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143142.426913:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12942 00000020:00010000:1.0:1746143142.426976:0:7114:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009b3c6000: total 0 00010000:00010000:1.0:1746143142.427002:0:7114:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009b3c6000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1746143142.427058:0:7114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094154200/0x25aee876ca70e530 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d9d expref: 6 pid: 4758 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746143142.427088:0:7114:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:1.0:1746143142.427102:0:7114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009340a600/0x25aee876ca70e7fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1122304->1970175) gid 0 flags: 0x44801000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f6b expref: 5 pid: 4758 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143142.427122:0:7114:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6151 -> 6155 00010000:00010000:1.0:1746143142.427133:0:7114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a2b7a00/0x25aee876ca70e7f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5210111) gid 0 flags: 0x44801000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f64 expref: 4 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143142.427149:0:7114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb200/0x25aee876ca7061f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164bb3a expref: 3 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143142.427159:0:7114:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009b3c6000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1746143142.427169:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143142.427170:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143142.427172:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143142.431979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143142.432106:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858885248 00000100:00100000:3.0:1746143142.432114:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858885248 00000100:00100000:3.0:1746143142.432161:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8282 00000100:00100000:3.0:1746143142.432170:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+17:1967:x1830962858885248:12345-192.168.201.28@tcp:39:umount.0 00000020:00000080:3.0:1746143142.432202:0:20619:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x25aee876ca7060ca 00000020:00010000:3.0:1746143142.432207:0:20619:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f878000: total 0 00000100:00080000:3.0:1746143142.432211:0:20619:0:(import.c:66:import_set_state_nolock()) ffff88009f878800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143142.432237:0:20619:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589942513 00000100:00100000:3.0:1746143142.432467:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ab4e34bd-f4d2-4b66-8c4a-431938b39ad2+16:1967:x1830962858885248:12345-192.168.201.28@tcp:39:umount.0 Request processed in 297us (494us total) trans 8589942514 rc 0/0 00000100:00100000:3.0:1746143142.432474:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8282 00000020:00010000:1.0:1746143142.432805:0:28928:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f878000: total 0 00010000:00010000:1.0:1746143142.432810:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143142.432848:0:28928:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f878000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1746143142.432874:0:28928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143142.432876:0:28928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143142.432882:0:28928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094154800/0x25aee876ca70e5c3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e0d expref: 15 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143142.432907:0:28928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143142.432910:0:28928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143142.432913:0:28928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f7a800/0x25aee876ca70e633 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e68 expref: 14 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143142.432926:0:28928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143142.432928:0:28928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746143142.432931:0:28928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090014000/0x25aee876ca706156 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164bb02 expref: 13 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143142.432942:0:28928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143142.432944:0:28928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143142.432947:0:28928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132051000/0x25aee876ca70e5ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e14 expref: 12 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143142.432955:0:28928:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f878000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1746143142.432966:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143142.432968:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143142.432969:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143142.550263:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143143.020472:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.020580:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.020628:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.021164:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858885376 00000100:00100000:2.0:1746143143.021172:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858885376 00000100:00100000:2.0:1746143143.021218:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858885632 00000100:00100000:2.0:1746143143.021220:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858885632 00000100:00100000:2.0:1746143143.021234:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858885504 00000100:00100000:2.0:1746143143.021235:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858885504 00000100:00100000:2.0:1746143143.021250:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 628 00000100:00100000:2.0:1746143143.021263:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b7a6235-c644-44a1-b40d-4d4c3954ac20+14:1970:x1830962858885376:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143143.021275:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143143.021290:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5e13800/0x25aee876ca7060df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164ba92 expref: 14 pid: 14791 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.021308:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143143.021406:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 629 00000100:00100000:1.0:1746143143.021414:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b7a6235-c644-44a1-b40d-4d4c3954ac20+13:1970:x1830962858885632:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143143.021422:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143143.021430:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800b4b7d800/0x25aee876ca7060ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164bac3 expref: 13 pid: 14791 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.021442:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143143.021480:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b7a6235-c644-44a1-b40d-4d4c3954ac20+12:1970:x1830962858885632:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 68us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143143.021486:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 629 00000100:00100000:1.0:1746143143.021502:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 630 00000100:00100000:1.0:1746143143.021507:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b7a6235-c644-44a1-b40d-4d4c3954ac20+11:1970:x1830962858885504:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143143.021513:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143143.021519:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009da34c00/0x25aee876ca7060e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164babc expref: 11 pid: 14792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.021526:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143143.021541:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b7a6235-c644-44a1-b40d-4d4c3954ac20+10:1970:x1830962858885504:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 33us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143143.021545:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 630 00000100:00100000:1.0:1746143143.022199:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.022252:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858886016 00000100:00100000:0.0:1746143143.022257:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858886016 00000100:00080000:1.0:1746143143.022496:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143143.022558:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12943 00000100:00100000:0.0:1746143143.022566:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+7:1967:x1830962858886016:12345-192.168.201.28@tcp:9:umount.0 00000020:00000080:0.0:1746143143.022586:0:8450:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x25aee876ca706102 00000020:00010000:0.0:1746143143.022593:0:8450:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a5aac000: total 0 00000100:00080000:0.0:1746143143.022596:0:8450:0:(import.c:66:import_set_state_nolock()) ffff8800a5aaa800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1746143143.022623:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b7a6235-c644-44a1-b40d-4d4c3954ac20+9:1970:x1830962858885376:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1365us (2159us total) trans 0 rc 0/0 00000001:00000004:0.0:1746143143.022625:0:8450:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179872870 00000100:00100000:2.0:1746143143.022629:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 628 00000020:00010000:1.0:1746143143.022732:0:9870:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a5aac000: total 0 00010000:00010000:1.0:1746143143.022762:0:9870:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a5aac000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1746143143.022798:0:9870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094576e00/0x25aee876ca70e496 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d73 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143143.022818:0:9870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094577200/0x25aee876ca70e48f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d6c expref: 6 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143143.023026:0:9870:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a5aac000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1746143143.023069:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143143.023071:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143143.023073:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143143.023721:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+2:1967:x1830962858886016:12345-192.168.201.28@tcp:9:umount.0 Request processed in 1155us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.023727:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12943 00000100:00100000:0.0:1746143143.031889:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.032928:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858886272 00000100:00100000:2.0:1746143143.032937:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858886272 00000100:00100000:2.0:1746143143.033442:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12944 00000100:00100000:2.0:1746143143.033451:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+6:1967:x1830962858886272:12345-192.168.201.28@tcp:9:umount.0 00000020:00000080:2.0:1746143143.033480:0:8450:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x25aee876ca7060fb 00000020:00010000:2.0:1746143143.033488:0:8450:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009b3c5000: total 0 00000100:00080000:2.0:1746143143.033492:0:8450:0:(import.c:66:import_set_state_nolock()) ffff88009b3c4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746143143.033532:0:8450:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840137 00000100:00100000:2.0:1746143143.033682:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009314d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+4:1967:x1830962858886272:12345-192.168.201.28@tcp:9:umount.0 Request processed in 231us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.033689:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12944 00000020:00010000:0.0:1746143143.034320:0:7114:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009b3c5000: total 0 00010000:00010000:0.0:1746143143.034347:0:7114:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009b3c5000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746143143.034388:0:7114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094576600/0x25aee876ca70e488 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650d65 expref: 3 pid: 8449 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143143.034406:0:7114:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009b3c5000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746143143.034414:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143143.034416:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143143.034418:0:7114:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1746143143.034471:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143143.047204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.047999:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858886656 00000100:00100000:3.0:1746143143.048007:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858886656 00000100:00080000:1.0:1746143143.048212:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143143.048264:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8283 00000100:00100000:3.0:1746143143.048274:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+9:1967:x1830962858886656:12345-192.168.201.28@tcp:39:umount.0 00000020:00000080:3.0:1746143143.048303:0:20619:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x25aee876ca7060f4 00000020:00010000:3.0:1746143143.048308:0:20619:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a5aab800: total 0 00000100:00080000:3.0:1746143143.048313:0:20619:0:(import.c:66:import_set_state_nolock()) ffff8800a5aae800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143143.048331:0:20619:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589942514 00000020:00010000:1.0:1746143143.048520:0:28928:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a5aab800: total 0 00010000:00010000:1.0:1746143143.048555:0:28928:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a5aab800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1746143143.048580:0:28928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143143.048584:0:28928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143143.048589:0:28928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be4e000/0x25aee876ca70e76e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f02 expref: 8 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.048622:0:28928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:1.0:1746143143.048625:0:28928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746143143.048628:0:28928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c045e00/0x25aee876ca706110 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c164baed expref: 7 pid: 14794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.048637:0:28928:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a5aab800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1746143143.048644:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143143.048645:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143143.048647:0:28928:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143143.048906:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c7fd2f1a-8c07-4384-bfb1-47722c458ae7+5:1967:x1830962858886656:12345-192.168.201.28@tcp:39:umount.0 Request processed in 633us (1710us total) trans 8589942515 rc 0/0 00000100:00100000:3.0:1746143143.048917:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8283 00000100:00100000:0.0:1746143143.098415:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.098550:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858886784 00000100:00100000:3.0:1746143143.098557:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858886784 00000100:00080000:1.0:1746143143.098858:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143143.098969:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8284 00000100:00100000:3.0:1746143143.098978:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+207:31253:x1830962858886784:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.099001:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.099018:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fa3 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.099115:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099126:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099135:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099146:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099151:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099155:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099391:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099400:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099407:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:3.0:1746143143.099431:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:3.0:1746143143.099435:0:20619:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143143.099448:0:20619:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099457:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099463:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099469:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099474:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099480:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79a400 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143143.099483:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099488:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099497:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a55dda00) 00010000:00010000:3.0:1746143143.099499:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143143.099502:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099507:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79a400/0x25aee876ca70e839 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099523:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099528:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099533:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099537:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79b800 already unused, calling callback (ffffffffa1347690) 00010000:00010000:3.0:1746143143.099539:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099543:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099549:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f449200) 00010000:00010000:3.0:1746143143.099550:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143143.099552:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099557:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79b800/0x25aee876ca70e840 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.099578:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 209 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.099587:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 208 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.099593:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143143.099596:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143143.099598:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f79b200, rc 0) 00000100:00100000:3.0:1746143143.104354:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:31253:x1830962858886784:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 5369us (5936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.104364:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8284 00000100:00100000:0.0:1746143143.109691:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.110193:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858886912 00000100:00100000:3.0:1746143143.110203:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858886912 00000100:00080000:1.0:1746143143.110274:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143143.110279:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12945 00000100:00100000:3.0:1746143143.110287:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1970:x1830962858886912:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.110305:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.110321:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650faa expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143143.110342:0:8169:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x681407a4, atime: 0x681407a3, ctime: 0x681407a4, blocks: 0x821 00010000:00010000:3.0:1746143143.110361:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.110362:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.110370:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 14 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.110383:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 14 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.110393:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f79bc00, rc 0) 00000100:00100000:3.0:1746143143.110433:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1970:x1830962858886912:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 147us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.110439:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12945 00000100:00100000:0.0:1746143143.110586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.111622:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858887040 00000100:00100000:3.0:1746143143.111629:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858887040 00000100:00100000:3.0:1746143143.111667:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12946 00000100:00080000:1.0:1746143143.111669:0:7123:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143143.111673:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858887040:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.111682:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.111692:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f79b600/0x25aee876ca70e855 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fb1 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.111711:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f79b600/0x25aee876ca70e855 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fb1 expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.111720:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79b600/0x25aee876ca70e855 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fb1 expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.111735:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f79b600, rc 0) 00000100:00100000:3.0:1746143143.111974:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1970:x1830962858887040:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 300us (1388us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143143.111980:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12946 00000100:00100000:0.0:1746143143.119143:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.119206:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858887296 00000100:00100000:3.0:1746143143.119216:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858887296 00000100:00100000:3.0:1746143143.119265:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8285 00000100:00100000:3.0:1746143143.119272:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+208:31253:x1830962858887296:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.119292:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.119310:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b000/0x25aee876ca70e85c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fb8 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.119397:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.119413:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 209 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.119420:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.119621:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 209 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.119633:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 209 pid: 20619 timeout: 1024 lvb_type: 0 00000100:00100000:3.0:1746143143.119646:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861342720:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143143.119743:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.122004:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20619:1830962861342720:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143143.122005:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00010000:00010000:3.0:1746143143.122024:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000100:00100000:2.0:1746143143.123410:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858887424 00000100:00100000:2.0:1746143143.123416:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858887424 00010000:00010000:2.0:1746143143.123439:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 210 pid: 20619 timeout: 1024 lvb_type: 0 00000100:00100000:2.0:1746143143.123462:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6876 00000100:00100000:2.0:1746143143.123469:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:1969:x1830962858887424:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143143.123481:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143143.123487:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 210 pid: 20619 timeout: 1024 lvb_type: 0 00010000:00010000:2.0:1746143143.123497:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 210 pid: 20619 timeout: 1024 lvb_type: 0 00010000:00010000:2.0:1746143143.123514:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b200/0x25aee876ca70e847 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fa3 expref: 210 pid: 20619 timeout: 1024 lvb_type: 0 00010000:00010000:2.0:1746143143.123533:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143143.123537:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.123546:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.123552:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.123581:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143143.123593:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00010000:00010000:0.0:1746143143.123598:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:0.0:1746143143.123613:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000100:00100000:2.0:1746143143.123721:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:1969:x1830962858887424:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 251us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.123727:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6876 00010000:00010000:0.0:1746143143.123784:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79b000/0x25aee876ca70e85c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fb8 expref: 210 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.123809:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fb8 expref: 209 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.123814:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143143.123817:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143143.123820:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f79a600, rc 0) 00000100:00100000:0.0:1746143143.123842:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:31253:x1830962858887296:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4572us (4821us total) trans 8589942516 rc 0/0 00000100:00100000:0.0:1746143143.123849:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8285 00000100:00100000:0.0:1746143143.126756:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.126826:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858887552 00000100:00100000:3.0:1746143143.126833:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858887552 00000100:00100000:3.0:1746143143.128964:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12947 00000100:00100000:3.0:1746143143.128978:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858887552:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.129010:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.129027:0:8169:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f79b800/0x25aee876ca70e871 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fbf expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.129082:0:8169:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f79b800/0x25aee876ca70e871 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fbf expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.129096:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79b800/0x25aee876ca70e871 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fbf expref: 21 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.129124:0:8169:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f79b800, rc 0) 00000100:00100000:3.0:1746143143.129187:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858887552:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 213us (2438us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143143.129194:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12947 00000100:00100000:0.0:1746143143.136963:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143143.137135:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858887808 00000100:00100000:1.0:1746143143.137144:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858887808 00000100:00100000:1.0:1746143143.137185:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8286 00000100:00100000:1.0:1746143143.137193:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+209:31253:x1830962858887808:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:1.0:1746143143.137214:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143143.137217:0:20619:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143143.137246:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79a600/0x25aee876ca70e863 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x27a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fb8 expref: 209 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.137280:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143143.137284:0:20619:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143143.137294:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74600/0x25aee876ca70e878 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fc6 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.137373:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74400/0x25aee876ca70e87f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143143.137384:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74400/0x25aee876ca70e87f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:1.0:1746143143.137391:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74400/0x25aee876ca70e87f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00200000:1.0:1746143143.137401:0:20619:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00010000:00010000:1.0:1746143143.137491:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74600/0x25aee876ca70e878 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fc6 expref: 211 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.137503:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74400/0x25aee876ca70e87f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fc6 expref: 210 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.137510:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143143.137512:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143143.137514:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb74400, rc 0) 00000100:00100000:1.0:1746143143.137555:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:31253:x1830962858887808:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 362us (599us total) trans 8589942517 rc 0/0 00000100:00100000:1.0:1746143143.137561:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8286 00000100:00100000:0.0:1746143143.141418:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.142391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.143020:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.143364:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858887936 00000100:00100000:3.0:1746143143.143373:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858887936 00000100:00100000:0.0:1746143143.143390:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.143411:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.143414:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858888192 00000100:00100000:3.0:1746143143.143417:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858888192 00000100:00100000:3.0:1746143143.143428:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858888448 00000100:00100000:3.0:1746143143.143430:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858888448 00000100:00100000:0.0:1746143143.143437:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.143445:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858888064 00000100:00100000:3.0:1746143143.143447:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858888064 00000100:00100000:0.0:1746143143.143455:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858888320 00000100:00100000:0.0:1746143143.143457:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858888320 00000100:00100000:3.0:1746143143.143460:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858888576 00000100:00100000:3.0:1746143143.143462:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858888576 00000100:00100000:0.0:1746143143.143473:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12948 00000100:00100000:0.0:1746143143.143479:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858887936:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143143.143516:0:8448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.143532:0:8448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 16 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143143.143538:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.143540:0:8448:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.143543:0:8448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.143561:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12949 00000100:00100000:3.0:1746143143.143567:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858888192:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:0.0:1746143143.143570:0:8448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 16 pid: 8448 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143143.143581:0:8448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 16 pid: 8448 timeout: 1024 lvb_type: 1 00010000:00010000:3.0:1746143143.143583:0:8449:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.143593:0:8449:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 22 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143143.143593:0:8448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a249880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861342848:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143143.143598:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.143599:0:8449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.143601:0:8449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.143615:0:8449:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 22 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.143621:0:8449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 22 pid: 10061 timeout: 1024 lvb_type: 1 00000100:00100000:3.0:1746143143.143629:0:8449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861342976:192.168.201.28@tcp:104: 00000100:00100000:0.0:1746143143.143654:0:8448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.143656:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12950 00000100:00100000:3.0:1746143143.143661:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858888448:12345-192.168.201.28@tcp:1:lfs.0 00000100:00100000:0.0:1746143143.143670:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12951 00010000:00010000:3.0:1746143143.143675:0:4756:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.143676:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858888064:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:3.0:1746143143.143685:0:4756:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143143.143688:0:26949:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.143690:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.143691:0:4756:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.143693:0:4756:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.143695:0:26949:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 22 pid: 10061 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143143.143701:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.143702:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.143704:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.143705:0:4756:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.143713:0:4756:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 16 pid: 4758 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.143716:0:26949:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 22 pid: 10061 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143143.143722:0:4756:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861343104:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143143.143723:0:26949:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 22 pid: 10061 timeout: 1024 lvb_type: 1 00000100:00100000:0.0:1746143143.143729:0:26949:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861343232:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143143.143739:0:4756:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143143.143742:0:26949:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aeec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.143748:0:8449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.143757:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12952 00000100:00100000:3.0:1746143143.143762:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858888320:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:3.0:1746143143.143773:0:8169:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.143783:0:8169:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 16 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.143789:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.143790:0:8169:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.143792:0:8169:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.143804:0:8169:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 16 pid: 8169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.143811:0:8169:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 16 pid: 8169 timeout: 1024 lvb_type: 1 00000100:00100000:3.0:1746143143.143818:0:8169:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861343360:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143143.144138:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12953 00000100:00100000:1.0:1746143143.144147:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858888576:12345-192.168.201.28@tcp:1:lfs.0 00010000:00010000:1.0:1746143143.144165:0:21048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.144176:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.144184:0:21048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.144190:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143143.144191:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143143.144193:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.144209:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.144218:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 22 pid: 8449 timeout: 1024 lvb_type: 0 00000100:00100000:1.0:1746143143.144226:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861343488:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143143.145165:0:21048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 22 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.145175:0:21048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 22 pid: 8449 timeout: 1024 lvb_type: 0 00000100:00100000:1.0:1746143143.145184:0:21048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090f22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861343616:192.168.201.28@tcp:104: 00000100:00100000:1.0:1746143143.145218:0:21048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.145633:0:8169:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143143.154070:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.154115:0:8169:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8169:1830962861343360:192.168.201.28@tcp:104: 00010000:00010000:0.0:1746143143.154143:0:8169:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143143.154227:0:26949:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:26949:1830962861343232:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143143.154241:0:26949:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143143.154262:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861343488:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143143.154327:0:8448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a249880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1830962861342848:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143143.154339:0:8448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143143.154360:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858888960 00000100:00100000:2.0:1746143143.154365:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858888960 00010000:00010000:2.0:1746143143.154391:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 23 pid: 10061 timeout: 1024 lvb_type: 1 00000100:00100000:2.0:1746143143.154413:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6877 00000100:00100000:2.0:1746143143.154419:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858888960:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143143.154431:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143143.154448:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 23 pid: 10061 timeout: 1024 lvb_type: 1 00010000:00010000:2.0:1746143143.154458:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 23 pid: 10061 timeout: 1024 lvb_type: 1 00010000:00010000:2.0:1746143143.154485:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.154487:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.154491:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.154499:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.154513:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143143.154547:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858888960:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 127us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.154553:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6877 00000100:00100000:2.0:1746143143.154609:0:4756:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4756:1830962861343104:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143143.154620:0:4756:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155583:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a529f800/0x25aee876ca70e576 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ddc expref: 22 pid: 10061 timeout: 1024 lvb_type: 1 00000100:00100000:3.0:1746143143.155606:0:8449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1830962861342976:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143143.155622:0:8449:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155630:0:8449:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155636:0:8449:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155659:0:8449:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155666:0:8449:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155672:0:8449:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155677:0:8449:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f79b200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746143143.155681:0:8449:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155687:0:8449:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155702:0:8449:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.155708:0:8449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79b200/0x25aee876ca70e894 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.157980:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858888192:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 14407us (15585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.157992:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12949 00000100:00100000:2.0:1746143143.158581:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.158673:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.159761:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858889216 00000100:00100000:0.0:1746143143.159769:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858889216 00010000:00010000:0.0:1746143143.159798:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 21 pid: 8449 timeout: 1024 lvb_type: 0 00000100:00100000:2.0:1746143143.160416:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143143.160508:0:21048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090f22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21048:1830962861343616:192.168.201.28@tcp:104: 00010000:00010000:1.0:1746143143.160528:0:21048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.162139:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858888704 00000100:00100000:0.0:1746143143.162145:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858888704 00010000:00010000:0.0:1746143143.162167:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 17 pid: 8448 timeout: 1024 lvb_type: 1 00000100:00100000:0.0:1746143143.162199:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858889088 00000100:00100000:0.0:1746143143.162202:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858889088 00010000:00010000:0.0:1746143143.162212:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 18 pid: 8169 timeout: 1024 lvb_type: 1 00000100:00100000:0.0:1746143143.162228:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6878 00000100:00100000:0.0:1746143143.162235:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858889216:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143143.162247:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143143.162267:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 21 pid: 8449 timeout: 1024 lvb_type: 0 00010000:00010000:0.0:1746143143.162279:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 21 pid: 8449 timeout: 1024 lvb_type: 0 00010000:00010000:0.0:1746143143.162301:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094576a00/0x25aee876ca70e7c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f3a expref: 21 pid: 8449 timeout: 1024 lvb_type: 0 00010000:00010000:0.0:1746143143.162320:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143143.162368:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858889216:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 133us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.162375:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6878 00000100:00100000:0.0:1746143143.162389:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6879 00000100:00100000:0.0:1746143143.162394:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858888704:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143143.162400:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143143.162411:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 18 pid: 8448 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.162421:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 18 pid: 8448 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.162435:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a529f000/0x25aee876ca70e58b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dce expref: 18 pid: 8448 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.162444:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.162445:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.162450:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162457:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162476:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143143.162487:0:8448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162495:0:8448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162517:0:8448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162524:0:8448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162532:0:8448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162538:0:8448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be09000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143143.162542:0:8448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162549:0:8448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162559:0:8448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162564:0:8448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be09000/0x25aee876ca70e88d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.162599:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858887936:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 19120us (21188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.162607:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12948 00000100:00100000:0.0:1746143143.162630:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1971:x1830962858888704:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 236us (3957us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.162636:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6879 00000100:00100000:0.0:1746143143.162647:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6880 00000100:00100000:0.0:1746143143.162651:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1971:x1830962858889088:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143143.162658:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143143.162668:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 15 pid: 8169 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.162677:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 15 pid: 8169 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.162688:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f79bc00/0x25aee876ca70e84e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650faa expref: 15 pid: 8169 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.162697:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.162698:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.162701:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162708:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.162720:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143143.162736:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092994700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1971:x1830962858889088:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 84us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.162742:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6880 00000100:00100000:0.0:1746143143.162779:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.162822:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.162910:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.162959:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858888832 00000100:00100000:0.0:1746143143.162963:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858888832 00010000:00010000:0.0:1746143143.162975:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 14 pid: 4758 timeout: 1024 lvb_type: 1 00000100:00100000:0.0:1746143143.162985:0:4759:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858889344 00000100:00100000:0.0:1746143143.162987:0:4759:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858889344 00010000:00010000:0.0:1746143143.163010:0:4759:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 20 pid: 10061 timeout: 1024 lvb_type: 1 00000100:00100000:0.0:1746143143.163021:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6881 00000100:00100000:0.0:1746143143.163026:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1971:x1830962858888832:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143143.163063:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143143.163074:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 14 pid: 4758 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.163083:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 14 pid: 4758 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.163095:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009340b000/0x25aee876ca70e801 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f79 expref: 14 pid: 4758 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.163104:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.163105:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.163108:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163120:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163135:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143143.163147:0:4756:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163154:0:4756:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163166:0:4756:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163173:0:4756:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163180:0:4756:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163186:0:4756:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79bc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143143.163189:0:4756:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163196:0:4756:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163205:0:4756:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163211:0:4756:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79bc00/0x25aee876ca70e89b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.163244:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858888448:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 19582us (20224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.163251:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12950 00000100:00100000:0.0:1746143143.163275:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:1971:x1830962858888832:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 249us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.163280:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6881 00000100:00100000:0.0:1746143143.163291:0:4759:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6882 00000100:00100000:0.0:1746143143.163296:0:4759:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858889344:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143143.163303:0:4759:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143143.163313:0:4759:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 20 pid: 10061 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.163321:0:4759:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 20 pid: 10061 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.163331:0:4759:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a529f600/0x25aee876ca70e56f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650dd5 expref: 20 pid: 10061 timeout: 1024 lvb_type: 1 00010000:00010000:0.0:1746143143.163339:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.163341:0:4759:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.163343:0:4759:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163355:0:4759:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163370:0:4759:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143143.163380:0:26949:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163387:0:26949:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163400:0:26949:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163406:0:26949:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163412:0:26949:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163417:0:26949:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e2ca00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143143.163623:0:26949:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163629:0:26949:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163643:0:26949:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163650:0:26949:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e2ca00/0x25aee876ca70e8a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.163680:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858888064:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 20004us (20289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.163687:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12951 00000100:00100000:0.0:1746143143.163709:0:4759:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1971:x1830962858889344:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 412us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.163714:0:4759:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6882 00010000:00010000:0.0:1746143143.163728:0:8169:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163734:0:8169:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163747:0:8169:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163754:0:8169:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163761:0:8169:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163772:0:8169:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79a200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746143143.163775:0:8169:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163781:0:8169:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163790:0:8169:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.163797:0:8169:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79a200/0x25aee876ca70e8a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.163826:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0dc46dfc-5e40-47a2-aeed-123c1c0de782+11:1969:x1830962858888320:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 20063us (20415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143143.163832:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12952 00000100:00100000:3.0:1746143143.165224:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858889472 00000100:00100000:3.0:1746143143.165232:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858889472 00002000:00100000:3.0:1746143143.165260:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2826240->3145727) req@ffff880092aee680 x1830962858889472/t0(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:294/0 lens 488/0 e 0 to 0 dl 1746143154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143143.165270:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aee680 with x1830962858889472 ext(2826240->3145727) 00010000:00010000:3.0:1746143143.165276:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 18 pid: 8449 timeout: 1024 lvb_type: 0 00010000:00010000:3.0:1746143143.165288:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 18 pid: 8449 timeout: 1025 lvb_type: 0 00002000:00010000:3.0:1746143143.165295:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aee680 00000100:00100000:3.0:1746143143.165312:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 2060 00000100:00100000:3.0:1746143143.165318:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858889472:12345-192.168.201.28@tcp:4:cat.0 00000100:00100000:3.0:1746143143.183379:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858889472:12345-192.168.201.28@tcp:4:cat.0 Request processed in 18051us (20459us total) trans 17179872871 rc 0/0 00000100:00100000:3.0:1746143143.183394:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 2060 00002000:00100000:3.0:1746143143.183407:0:31806:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x305:0x0] (2826240->3145727) req@ffff880092aee680 x1830962858889472/t17179872871(0) o4->0dc46dfc-5e40-47a2-aeed-123c1c0de782@192.168.201.28@tcp:294/0 lens 488/448 e 0 to 0 dl 1746143154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143143.183417:0:31806:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092aee680 with x1830962858889472 ext(2826240->3145727) 00010000:00010000:3.0:1746143143.183426:0:31806:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 20 pid: 8449 timeout: 1025 lvb_type: 0 00010000:00010000:3.0:1746143143.183441:0:31806:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 20 pid: 8449 timeout: 1025 lvb_type: 0 00002000:00010000:3.0:1746143143.183448:0:31806:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092aee680 00000100:00100000:0.0:1746143143.186761:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.186825:0:7112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858889600 00000100:00100000:2.0:1746143143.186834:0:7112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858889600 00010000:00010000:2.0:1746143143.186865:0:7112:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 20 pid: 8449 timeout: 1025 lvb_type: 0 00000100:00100000:2.0:1746143143.186906:0:7112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6883 00000100:00100000:2.0:1746143143.186914:0:7112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1971:x1830962858889600:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143143.186927:0:7112:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143143.186943:0:7112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143139 -> 1746143140 00010000:00010000:2.0:1746143143.186949:0:7112:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 20 pid: 8449 timeout: 1025 lvb_type: 0 00010000:00010000:2.0:1746143143.186962:0:7112:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 20 pid: 8449 timeout: 1025 lvb_type: 0 00010000:00010000:2.0:1746143143.186982:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309f3a00/0x25aee876ca70e7bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2826240->3145727] (req 2826240->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650f2c expref: 20 pid: 8449 timeout: 1025 lvb_type: 0 00010000:00010000:2.0:1746143143.186997:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.186999:0:7112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.187003:0:7112:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.187012:0:7112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.187076:0:7112:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143143.187111:0:7112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1971:x1830962858889600:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 197us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.187118:0:7112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6883 00010000:00010000:1.0:1746143143.188857:0:21048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.188869:0:21048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.188892:0:21048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.188900:0:21048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.188907:0:21048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.188915:0:21048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb74800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143143.188918:0:21048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.188925:0:21048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.188938:0:21048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.188945:0:21048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb74800/0x25aee876ca70e8b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143143.189000:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858888576:12345-192.168.201.28@tcp:1:lfs.0 Request processed in 44853us (45560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143143.189009:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12953 00000100:00100000:0.0:1746143143.191824:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143143.191916:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858889856 00000100:00100000:1.0:1746143143.191925:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858889856 00000100:00100000:1.0:1746143143.191962:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8287 00000100:00100000:1.0:1746143143.191970:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+210:31253:x1830962858889856:12345-192.168.201.28@tcp:36:lfs.0 00010000:00010000:1.0:1746143143.192017:0:14796:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746143143.192080:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d90c00/0x25aee876ca70e656 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e6f expref: 210 pid: 17079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.192099:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132050e00/0x25aee876ca70e5d1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650e1b expref: 209 pid: 14795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.192109:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:1.0:1746143143.192113:0:14796:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143143.192135:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143143.192147:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:1.0:1746143143.192155:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000040:00080000:1.0:1746143143.192766:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2460, 88 off209200 00000004:00080000:1.0:1746143143.192774:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925032742708ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.195175:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2469, 88 off209728 00000004:00080000:1.0:1746143143.195185:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925035153749ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143143.195214:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2470, 88 off209816 00000004:00080000:1.0:1746143143.195217:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925035185946ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143143.195230:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2461, 88 off209288 00000004:00080000:1.0:1746143143.195233:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925035201234ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.195740:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2462, 88 off209376 00000004:00080000:1.0:1746143143.195745:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925035713082ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.195753:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2471, 88 off209904 00000004:00080000:1.0:1746143143.195756:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925035724118ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143143.196531:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2472, 88 off209992 00000004:00080000:1.0:1746143143.196537:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925036505188ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143143.196544:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2473, 88 off210080 00000004:00080000:1.0:1746143143.196546:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925036515070ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143143.196554:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2463, 88 off209464 00000004:00080000:1.0:1746143143.196557:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925036525128ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.196578:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2474, 88 off210168 00000004:00080000:1.0:1746143143.196583:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925036551516ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143143.196590:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2464, 88 off209552 00000004:00080000:1.0:1746143143.196593:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925036561281ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.196599:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2475, 88 off210256 00000004:00080000:1.0:1746143143.196602:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925036570657ns, next at 860119223596ns, rc = 0 00000040:00080000:1.0:1746143143.196608:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2465, 88 off209640 00000004:00080000:1.0:1746143143.196611:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925036579330ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.196617:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2466, 88 off209728 00000004:00080000:1.0:1746143143.196621:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925036589908ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.196628:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2467, 88 off209816 00000004:00080000:1.0:1746143143.196631:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925036599325ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.196638:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2468, 88 off209904 00000004:00080000:1.0:1746143143.196640:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925036608561ns, next at 860071159912ns, rc = 0 00000040:00080000:1.0:1746143143.196646:0:14796:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2476, 88 off210344 00000004:00080000:1.0:1746143143.196649:0:14796:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925036617113ns, next at 860119223596ns, rc = 0 00000004:00010000:3.0:1746143143.239799:0:14796:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092aed500 reply state ffff88008f727800 transno 8589942518 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000001:00080000:0.0:1746143143.239799:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942516 is committed 00000100:00100000:3.0:1746143143.239810:0:14796:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746143143.239811:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942518 is committed 00000004:00080000:0.0:1746143143.239814:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1893 committed 00000004:00080000:0.0:1746143143.239821:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1890 committed 00000004:00080000:0.0:1746143143.239826:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1889 committed 00000004:00080000:0.0:1746143143.239827:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1888 committed 00000004:00080000:0.0:1746143143.239829:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1887 committed 00000004:00080000:0.0:1746143143.239831:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1892 committed 00000004:00080000:0.0:1746143143.239832:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1886 committed 00000004:00080000:0.0:1746143143.239834:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1891 committed 00000004:00080000:0.0:1746143143.239835:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1885 committed 00000004:00080000:0.0:1746143143.239837:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1890 committed 00000004:00080000:0.0:1746143143.239839:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1889 committed 00000004:00080000:0.0:1746143143.239840:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1888 committed 00000004:00080000:0.0:1746143143.239841:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1884 committed 00000004:00080000:0.0:1746143143.239843:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1883 committed 00000004:00080000:0.0:1746143143.239844:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1887 committed 00000004:00080000:0.0:1746143143.239845:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1886 committed 00000004:00080000:0.0:1746143143.239847:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1882 committed 00000001:00080000:0.0:1746143143.239852:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942511 is committed 00000001:00080000:0.0:1746143143.239871:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942507 is committed 00000001:00100000:0.0:1746143143.239879:0:14860:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c7fd2f1a-8c07-4384-bfb1-47722c458ae7 00000001:00080000:0.0:1746143143.239882:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942515 is committed 00000001:00100000:0.0:1746143143.239885:0:14860:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ab4e34bd-f4d2-4b66-8c4a-431938b39ad2 00000001:00080000:0.0:1746143143.239888:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942514 is committed 00010000:00080000:3.0:1746143143.239893:0:14796:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000020:00000080:0.0:1746143143.239899:0:14860:0:(genops.c:904:class_export_put()) final put ffff8800a5aab800/c7fd2f1a-8c07-4384-bfb1-47722c458ae7 00000100:00100000:3.0:1746143143.239906:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+202:31253:x1830962858889856:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 47933us (48086us total) trans 8589942518 rc 0/0 00000100:00100000:3.0:1746143143.239914:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8287 00000020:00000080:0.0:1746143143.239919:0:14860:0:(genops.c:904:class_export_put()) final put ffff88009f878000/ab4e34bd-f4d2-4b66-8c4a-431938b39ad2 00010000:00010000:0.0:1746143143.239932:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143143.239939:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143143.239945:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143143.239950:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb74200 already unused, calling callback (ffffffffa1347690) 00010000:00010000:0.0:1746143143.239953:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143143.239962:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143143.239974:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:0.0:1746143143.239977:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143143.239980:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00010000:00010000:0.0:1746143143.239984:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74200/0x25aee876ca70e8b7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14796 initiator: MDT0 00000020:00000080:3.0:1746143143.240080:0:10697:0:(genops.c:863:class_export_destroy()) destroying export ffff8800a5aab800/c7fd2f1a-8c07-4384-bfb1-47722c458ae7 for lustre-MDT0000 00000020:00000080:3.0:1746143143.240122:0:10697:0:(genops.c:863:class_export_destroy()) destroying export ffff88009f878000/ab4e34bd-f4d2-4b66-8c4a-431938b39ad2 for lustre-MDT0000 00000020:00000080:3.0:1746143143.240148:0:10697:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800a5aae800 for lustre-MDT0000 00000020:00000080:3.0:1746143143.240152:0:10697:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009f878800 for lustre-MDT0000 00000100:00100000:3.0:1746143143.240167:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861343744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240210:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.240248:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861344256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240264:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.240277:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746143143.240281:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861343872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240295:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.240306:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861344384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240318:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.240338:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861344128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240352:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.240364:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861344640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240376:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.240385:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143143.240387:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861343744 00000100:00100000:3.0:1746143143.240389:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861344000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.240394:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861343744 00000100:00100000:3.0:1746143143.240400:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.240408:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861344512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240419:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.240419:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861344256 00000100:00100000:1.0:1746143143.240421:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861344256 00000100:00100000:1.0:1746143143.240430:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861343872 00000100:00100000:1.0:1746143143.240432:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861343872 00000100:00100000:3.0:1746143143.240437:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861344384 00000100:00100000:3.0:1746143143.240439:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861344384 00000100:00100000:1.0:1746143143.240440:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861344128 00000100:00100000:1.0:1746143143.240441:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861344128 00000100:00100000:3.0:1746143143.240448:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861344000 00000100:00100000:1.0:1746143143.240448:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861344640 00000100:00100000:1.0:1746143143.240449:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861344640 00000100:00100000:3.0:1746143143.240450:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861344000 00000100:00100000:3.0:1746143143.240626:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861344512 00000100:00100000:3.0:1746143143.240628:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861344512 00000100:00100000:1.0:1746143143.240630:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12954 00000100:00100000:3.0:1746143143.240635:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12955 00000100:00100000:1.0:1746143143.240636:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861343744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240639:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861344256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.240651:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12956 00000100:00100000:1.0:1746143143.240655:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3299:x1830962861343872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.240700:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12957 00000100:00100000:1.0:1746143143.240705:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861344128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240792:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861344256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (526us total) trans 17179872872 rc 0/0 00000100:00100000:3.0:1746143143.240798:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12955 00000100:00100000:3.0:1746143143.240809:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12958 00000100:00100000:3.0:1746143143.240813:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861344384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.240819:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861344128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (467us total) trans 17179872873 rc 0/0 00000100:00100000:1.0:1746143143.240825:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12957 00000100:00100000:1.0:1746143143.240834:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12959 00000100:00100000:1.0:1746143143.240864:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861344640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.240920:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3299:x1830962861344384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (600us total) trans 17179872874 rc 0/0 00000100:00100000:1.0:1746143143.240925:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3302:x1830962861344640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (549us total) trans 17179872875 rc 0/0 00000100:00100000:3.0:1746143143.240926:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12958 00000100:00100000:1.0:1746143143.240930:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12959 00000100:00100000:3.0:1746143143.240935:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12960 00000100:00100000:1.0:1746143143.240937:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12961 00000100:00100000:3.0:1746143143.240939:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861344000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.240941:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3302:x1830962861344512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.241014:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3302:x1830962861344000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (612us total) trans 17179872876 rc 0/0 00000100:00100000:3.0:1746143143.241019:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12960 00000100:00100000:1.0:1746143143.241046:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861343872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 375us (735us total) trans 17179872877 rc 0/0 00000100:00100000:1.0:1746143143.241063:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12956 00000004:00080000:3.0:1746143143.241080:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136beb800/2, rc 0, transno 17179872876 00000100:00100000:3.0:1746143143.241085:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861344000:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143143.241091:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136be8380/2, rc 0, transno 17179872873 00000100:00100000:3.0:1746143143.241094:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861344128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143143.241099:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b89180/2, rc 0, transno 17179872875 00000100:00100000:3.0:1746143143.241102:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861344640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143143.241113:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136beaa00/2, rc 0, transno 17179872877 00000100:00100000:3.0:1746143143.241115:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861343872:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143143.241120:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136bea300/2, rc 0, transno 17179872874 00000100:00100000:3.0:1746143143.241123:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861344384:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143143.241128:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136bea680/2, rc 0, transno 17179872872 00000100:00100000:3.0:1746143143.241130:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861344256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.241138:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3302:x1830962861344512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (718us total) trans 17179872878 rc 0/0 00000004:00080000:3.0:1746143143.241139:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136beb100/2, rc 0, transno 17179872878 00000100:00100000:3.0:1746143143.241141:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861344512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.241143:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12961 00000100:00100000:1.0:1746143143.241257:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3299:x1830962861343744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 621us (1046us total) trans 17179872879 rc 0/0 00000100:00100000:1.0:1746143143.241262:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12954 00000100:00100000:1.0:1746143143.243195:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861345024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.243239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.243273:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861345536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.243287:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.243301:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143143.243305:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861345024 00000100:00100000:1.0:1746143143.243305:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861345152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143143.243312:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861345024 00000100:00100000:1.0:1746143143.243318:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.243329:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861345664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143143.243336:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861345536 00000100:00100000:2.0:1746143143.243338:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861345536 00000100:00100000:1.0:1746143143.243342:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143143.243351:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861345152 00000100:00100000:2.0:1746143143.243354:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861345152 00000100:00100000:1.0:1746143143.243361:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861345664 00000100:00100000:1.0:1746143143.243364:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861345664 00000100:00100000:2.0:1746143143.243367:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12962 00000100:00100000:2.0:1746143143.243373:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1830962861345024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.243384:0:8169:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12963 00000100:00100000:1.0:1746143143.243389:0:8169:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3301:x1830962861345536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.243421:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12964 00000100:00100000:1.0:1746143143.243426:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3301:x1830962861345152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143143.243497:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12965 00000100:00100000:2.0:1746143143.243502:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861345664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.243541:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861345152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (222us total) trans 21474840138 rc 0/0 00000100:00100000:1.0:1746143143.243548:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12964 00000100:00100000:2.0:1746143143.243599:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861345664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (255us total) trans 21474840139 rc 0/0 00000100:00100000:2.0:1746143143.243605:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12965 00000100:00100000:1.0:1746143143.243635:0:8169:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3301:x1830962861345536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 246us (346us total) trans 21474840140 rc 0/0 00000100:00100000:1.0:1746143143.243641:0:8169:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12963 00000100:00100000:2.0:1746143143.243654:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3301:x1830962861345024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 281us (415us total) trans 21474840141 rc 0/0 00000100:00100000:2.0:1746143143.243659:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12962 00000100:00100000:1.0:1746143143.243670:0:3301:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840131 gen 2 00000004:00080000:1.0:1746143143.243675:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094424e00, transno 21474840114 00000004:00080000:1.0:1746143143.243680:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5841880, transno 21474840115 00000004:00080000:1.0:1746143143.243683:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094426680, transno 21474840116 00000004:00080000:1.0:1746143143.243686:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094424000, transno 21474840117 00000004:00080000:1.0:1746143143.243688:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5841f80, transno 21474840118 00000004:00080000:1.0:1746143143.243690:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094426300, transno 21474840119 00000004:00080000:1.0:1746143143.243693:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094424380, transno 21474840120 00000004:00080000:1.0:1746143143.243695:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094424a80, transno 21474840121 00000004:00080000:1.0:1746143143.243697:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009310c380, transno 21474840122 00000004:00080000:1.0:1746143143.243699:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314f100, transno 21474840123 00000004:00080000:1.0:1746143143.243702:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e680, transno 21474840124 00000004:00080000:1.0:1746143143.243704:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314e300, transno 21474840125 00000004:00080000:1.0:1746143143.243707:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314ea00, transno 21474840126 00000004:00080000:1.0:1746143143.243709:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314c380, transno 21474840127 00000004:00080000:1.0:1746143143.243711:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314fb80, transno 21474840128 00000004:00080000:1.0:1746143143.243713:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314d180, transno 21474840129 00000004:00080000:1.0:1746143143.243715:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009314df80, transno 21474840130 00000004:00080000:1.0:1746143143.243717:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092aefb80, transno 21474840131 00000100:00100000:1.0:1746143143.243722:0:3301:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880094514a80 x1830962861345152/t21474840138(21474840138) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143159 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143143.243730:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094514a80/2, rc 0, transno 21474840138 00000100:00100000:1.0:1746143143.243734:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861345152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143143.244531:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eaaea00/2, rc 0, transno 21474840139 00000100:00100000:1.0:1746143143.244536:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861345664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143143.244544:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092997800/2, rc 0, transno 21474840141 00000100:00100000:1.0:1746143143.244547:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861345024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143143.244552:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eaad180/2, rc 0, transno 21474840140 00000100:00100000:1.0:1746143143.244554:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861345536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143143.244642:0:14835:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 21 in progress, 4 in flight, 5 done 00000004:00080000:2.0:1746143143.244745:0:14835:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 13 done 00000100:00100000:3.0:1746143143.244869:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861344896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.244900:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.244946:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861345408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.244965:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.244980:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746143143.244984:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861344896 00000100:00100000:0.0:1746143143.244984:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861345408 00000100:00100000:3.0:1746143143.244985:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861344768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.244987:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861344896 00000100:00100000:0.0:1746143143.244987:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861345408 00000100:00100000:3.0:1746143143.245000:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143143.245007:0:4756:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861344768 00000100:00100000:0.0:1746143143.245009:0:4756:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861344768 00000100:00100000:3.0:1746143143.245011:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861345280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.245014:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12966 00000100:00100000:1.0:1746143143.245020:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3300:x1830962861345408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.245023:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143143.245024:0:4756:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12967 00000100:00100000:0.0:1746143143.245029:0:4756:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3300:x1830962861344896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.245061:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861345792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.245078:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143143.245112:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136bead80/2, rc 0, transno 17179872879 00000100:00100000:3.0:1746143143.245116:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861343744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.245163:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3300:x1830962861345408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (196us total) trans 21474840142 rc 0/0 00000100:00100000:1.0:1746143143.245168:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12966 00000100:00100000:1.0:1746143143.245178:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861345280 00000100:00100000:1.0:1746143143.245181:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861345280 00000100:00100000:1.0:1746143143.245192:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861345792 00000100:00100000:1.0:1746143143.245194:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861345792 00000100:00100000:1.0:1746143143.245204:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12968 00000100:00100000:1.0:1746143143.245208:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3300:x1830962861344768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.245305:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3300:x1830962861344768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (303us total) trans 21474840144 rc 0/0 00000100:00100000:1.0:1746143143.245310:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12968 00000100:00100000:1.0:1746143143.245321:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12969 00000100:00100000:1.0:1746143143.245326:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3300:x1830962861345280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.245408:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3300:x1830962861345280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (383us total) trans 21474840145 rc 0/0 00000100:00100000:1.0:1746143143.245413:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12969 00000100:00100000:1.0:1746143143.245424:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12970 00000100:00100000:1.0:1746143143.245428:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3300:x1830962861345792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.245504:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3300:x1830962861345792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (424us total) trans 21474840146 rc 0/0 00000100:00100000:1.0:1746143143.245509:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12970 00000100:00100000:0.0:1746143143.245516:0:4756:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3300:x1830962861344896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 486us (614us total) trans 21474840143 rc 0/0 00000100:00100000:0.0:1746143143.245522:0:4756:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12967 00000004:00080000:3.0:1746143143.245662:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092994a80/2, rc 0, transno 21474840144 00000100:00100000:3.0:1746143143.245666:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861344768:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143143.245672:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eaad880/2, rc 0, transno 21474840145 00000100:00100000:3.0:1746143143.245675:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861345280:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143143.245681:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009310c380/2, rc 0, transno 21474840146 00000100:00100000:3.0:1746143143.245683:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861345792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143143.245687:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092996d80/2, rc 0, transno 21474840143 00000100:00100000:3.0:1746143143.245690:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861344896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143143.245695:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eaaed80/2, rc 0, transno 21474840142 00000100:00100000:3.0:1746143143.245697:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861345408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.246223:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.246273:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858889984 00000100:00100000:3.0:1746143143.246277:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858889984 00000100:00100000:3.0:1746143143.246302:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8288 00000100:00100000:3.0:1746143143.246308:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:31253:x1830962858889984:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.246321:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.246336:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fcd expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.246379:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.246392:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 199 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.246408:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143143.246411:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143143.246414:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d91000, rc 0) 00000100:00100000:3.0:1746143143.246442:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31253:x1830962858889984:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 134us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.246448:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8288 00000100:00100000:1.0:1746143143.252381:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.252455:0:14796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858890112 00000100:00100000:2.0:1746143143.252464:0:14796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858890112 00000100:00100000:2.0:1746143143.252501:0:14796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8289 00000100:00100000:2.0:1746143143.252507:0:14796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31253:x1830962858890112:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.252523:0:14796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.252537:0:14796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717800/0x25aee876ca70e8c5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fd4 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.252605:0:14796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716c00/0x25aee876ca70e8cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143143.252618:0:14796:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716c00/0x25aee876ca70e8cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143143.252627:0:14796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716c00/0x25aee876ca70e8cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00000004:00200000:2.0:1746143143.252650:0:14796:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x27a:0x0]: returning size 9401344 00000004:00200000:2.0:1746143143.252653:0:14796:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143143.252665:0:14796:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716c00/0x25aee876ca70e8cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14796 initiator: MDT0 00010000:00010000:2.0:1746143143.252685:0:14796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b717800/0x25aee876ca70e8c5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fd4 expref: 201 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.252697:0:14796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716c00/0x25aee876ca70e8cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fd4 expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.252704:0:14796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143143.252707:0:14796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143143.252710:0:14796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b716c00, rc 0) 00000100:00100000:2.0:1746143143.252748:0:14796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31253:x1830962858890112:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 241us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.252754:0:14796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8289 00000100:00100000:0.0:1746143143.258554:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.259704:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.259752:0:21048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858890240 00000100:00100000:2.0:1746143143.259761:0:21048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858890240 00000100:00100000:2.0:1746143143.259814:0:21048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12971 00000100:00100000:2.0:1746143143.260068:0:21048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+11:1969:x1830962858890240:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.260086:0:21048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.260104:0:21048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fdb expref: -99 pid: 21048 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143143.260125:0:21048:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fc:0x0] initial LVB size: 1048576, mtime: 0x681407a0, atime: 0x681407a0, ctime: 0x681407a0, blocks: 0x7cf 00010000:00010000:2.0:1746143143.260143:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.260146:0:21048:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.260153:0:21048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 12 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.260168:0:21048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 12 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.260178:0:21048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4919400, rc 0) 00000100:00100000:3.0:1746143143.260316:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858890368 00000100:00100000:3.0:1746143143.260321:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858890368 00000100:00100000:2.0:1746143143.260327:0:21048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0dc46dfc-5e40-47a2-aeed-123c1c0de782+12:1969:x1830962858890240:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 504us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.260333:0:21048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12971 00000100:00100000:3.0:1746143143.260345:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12972 00000100:00100000:3.0:1746143143.260350:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1969:x1830962858890368:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.260357:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.260367:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fe2 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143143.260387:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 2097152, mtime: 0x681407a1, atime: 0x681407a1, ctime: 0x681407a1, blocks: 0x821 00010000:00010000:3.0:1746143143.260395:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.260397:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.260401:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.260410:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.260416:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d90400, rc 0) 00000100:00100000:3.0:1746143143.260435:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1969:x1830962858890368:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 85us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143143.260773:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143143.260788:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143143.260798:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143143.260821:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.261468:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12972 00000100:00100000:3.0:1746143143.261482:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858890624 00000100:00100000:3.0:1746143143.261485:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858890624 00000100:00100000:3.0:1746143143.261506:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858890880 00000100:00100000:3.0:1746143143.261508:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858890880 00000100:00100000:3.0:1746143143.261520:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858890496 00000100:00100000:3.0:1746143143.261521:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858890496 00000100:00100000:3.0:1746143143.261531:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858890752 00000100:00100000:3.0:1746143143.261532:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858890752 00000100:00100000:3.0:1746143143.261543:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12973 00000100:00100000:3.0:1746143143.261548:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858890624:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.261557:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.261567:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ff0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143143.261584:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2fe:0x0] initial LVB size: 2097152, mtime: 0x681407a4, atime: 0x681407a3, ctime: 0x681407a4, blocks: 0x821 00010000:00010000:3.0:1746143143.261592:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.261593:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.261597:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.261607:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.261614:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4871a00, rc 0) 00000100:00100000:3.0:1746143143.261636:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858890624:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 88us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.261641:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12973 00000100:00100000:3.0:1746143143.261651:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12974 00000100:00100000:3.0:1746143143.261656:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858890880:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.261661:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.261668:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ffe expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143143.261679:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 4194304, mtime: 0x681407a4, atime: 0x681407a4, ctime: 0x681407a3, blocks: 0x102b 00010000:00010000:3.0:1746143143.261686:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.261688:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.261691:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.261705:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.261713:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d91800, rc 0) 00000100:00100000:3.0:1746143143.261725:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858890880:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 69us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.261729:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12974 00000100:00100000:3.0:1746143143.261738:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12975 00000100:00100000:3.0:1746143143.261742:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1969:x1830962858890496:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.261747:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.261752:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650fe9 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143143.261761:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 2097152, mtime: 0x681407a1, atime: 0x681407a1, ctime: 0x681407a1, blocks: 0x81f 00010000:00010000:3.0:1746143143.261768:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.261769:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.261773:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.261781:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.261787:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d90a00, rc 0) 00000100:00100000:3.0:1746143143.261800:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858890496:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 57us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.261808:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12975 00000100:00100000:2.0:1746143143.261818:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12976 00000100:00100000:2.0:1746143143.262067:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+13:1969:x1830962858890752:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.262076:0:26949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.262084:0:26949:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1650ff7 expref: -99 pid: 26949 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143143.262098:0:26949:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x2ff:0x0] initial LVB size: 5207040, mtime: 0x681407a4, atime: 0x681407a3, ctime: 0x681407a4, blocks: 0x180b 00010000:00010000:2.0:1746143143.262106:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.262107:0:26949:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.262112:0:26949:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 14 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.262122:0:26949:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 14 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.262129:0:26949:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4919200, rc 0) 00000100:00100000:2.0:1746143143.262147:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858890752:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 82us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.262152:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12976 00000100:00100000:0.0:1746143143.271290:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.271346:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.272907:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.273295:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858891136 00000100:00100000:3.0:1746143143.273305:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858891136 00000100:00100000:0.0:1746143143.273319:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.273355:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858891392 00000100:00100000:3.0:1746143143.273358:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858891392 00000100:00100000:3.0:1746143143.273374:0:31806:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858891648 00000100:00100000:3.0:1746143143.273376:0:31806:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858891648 00000100:00100000:2.0:1746143143.273382:0:21521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858891904 00000100:00100000:2.0:1746143143.273386:0:21521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858891904 00000100:00100000:3.0:1746143143.273391:0:31806:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6333 00000100:00100000:3.0:1746143143.273398:0:31806:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858891136:12345-192.168.201.28@tcp:3:lfs.0 00000100:00100000:2.0:1746143143.273405:0:21521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6334 00000100:00100000:2.0:1746143143.273409:0:21521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858891392:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:3.0:1746143143.273427:0:31806:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.273427:0:21521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.273439:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.273439:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.273441:0:31806:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.273441:0:21521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.273444:0:31806:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.273444:0:21521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.273455:0:31806:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.273455:0:21521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143143.275293:0:21522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6335 00000100:00100000:2.0:1746143143.275304:0:21522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800999cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858891648:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:2.0:1746143143.275327:0:21522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.275337:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.275338:0:21522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.275342:0:21522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.275351:0:21522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.277549:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6336 00000100:00100000:0.0:1746143143.277562:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1968:x1830962858891904:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143143.277591:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.277601:0:21520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.277603:0:21520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.277606:0:21520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.277617:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.279523:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.280548:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.281229:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.281270:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.281297:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858892288 00000100:00100000:0.0:1746143143.281304:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858892288 00000100:00100000:0.0:1746143143.281347:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858892416 00000100:00100000:0.0:1746143143.281350:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858892416 00000100:00100000:0.0:1746143143.281360:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858892800 00000100:00100000:0.0:1746143143.281361:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858892800 00000100:00100000:0.0:1746143143.281370:0:11337:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858892672 00000100:00100000:0.0:1746143143.281371:0:11337:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858892672 00000100:00100000:0.0:1746143143.281382:0:11337:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6337 00000100:00100000:0.0:1746143143.281389:0:11337:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858892288:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143143.281421:0:11337:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.281434:0:11337:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.281437:0:11337:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.281441:0:11337:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.281453:0:11337:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143143.283648:0:31432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6338 00000100:00100000:0.0:1746143143.283657:0:31432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+19:1968:x1830962858892416:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:0.0:1746143143.283680:0:31432:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.283691:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.283692:0:31432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143143.283697:0:31432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143143.283707:0:31432:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.284601:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6339 00000100:00100000:3.0:1746143143.284610:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858892800:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:3.0:1746143143.284631:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.284638:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.284639:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.284641:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.284649:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143143.285710:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6340 00000100:00100000:1.0:1746143143.286420:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858892672:12345-192.168.201.28@tcp:3:lfs.0 00010000:00010000:1.0:1746143143.286446:0:8454:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.286457:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143143.286459:0:8454:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143143.286463:0:8454:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.286473:0:8454:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.321352:0:21521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.321367:0:21521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.321375:0:21521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.321381:0:21521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b717800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143143.321384:0:21521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.321391:0:21521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.321406:0:21521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.321411:0:21521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b717800/0x25aee876ca70e8fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143143.321690:0:21521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+27:1968:x1830962858891392:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 48275us (50338us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143143.321700:0:21521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6334 00010000:00010000:2.0:1746143143.331018:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.331082:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.331092:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.331099:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79b600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143143.331102:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.331111:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.331127:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.331133:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c79b600/0x25aee876ca70e912 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143143.332740:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+20:1968:x1830962858891904:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 55173us (59411us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143143.332751:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6336 00010000:00010000:1.0:1746143143.345786:0:8454:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.345802:0:8454:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.345810:0:8454:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.345816:0:8454:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5577000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143143.345820:0:8454:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.345827:0:8454:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.345843:0:8454:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.345849:0:8454:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5577000/0x25aee876ca70e92e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143143.345940:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1968:x1830962858892672:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 60218us (64664us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143143.345949:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6340 00010000:00010000:2.0:1746143143.346348:0:11337:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.346357:0:11337:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.346367:0:11337:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.346372:0:11337:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f81200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143143.346375:0:11337:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.346380:0:11337:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.346390:0:11337:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.346395:0:11337:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f81200/0x25aee876ca70e919 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11337 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143143.347296:0:11337:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0dc46dfc-5e40-47a2-aeed-123c1c0de782+18:1968:x1830962858892288:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 65905us (67775us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143143.347303:0:11337:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6337 00010000:00010000:2.0:1746143143.354646:0:21522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.354660:0:21522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.354668:0:21522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.354674:0:21522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b717c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143143.354677:0:21522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.354684:0:21522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.354698:0:21522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.354703:0:21522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b717c00/0x25aee876ca70e90b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143143.354777:0:21522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800999cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1968:x1830962858891648:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 79472us (81869us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143143.354786:0:21522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6335 00010000:00010000:2.0:1746143143.363252:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.363265:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.363272:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.363278:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800949e9800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143143.363282:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.363289:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.363302:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.363307:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800949e9800/0x25aee876ca70e927 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143143.363376:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858892800:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 78762us (82143us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143143.363385:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6339 00010000:00010000:1.0:1746143143.367080:0:31806:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.367093:0:31806:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.367100:0:31806:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.367105:0:31806:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c0c7000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746143143.367109:0:31806:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.367115:0:31806:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.367127:0:31806:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143143.367132:0:31806:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0c7000/0x25aee876ca70e904 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31806 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143143.367193:0:31806:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1968:x1830962858891136:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 93791us (95905us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143143.367207:0:31806:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6333 00010000:00010000:2.0:1746143143.374854:0:31432:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.374871:0:31432:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.374880:0:31432:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.374887:0:31432:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f81600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746143143.374890:0:31432:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.374897:0:31432:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.374914:0:31432:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.374921:0:31432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f81600/0x25aee876ca70e920 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143143.375000:0:31432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1968:x1830962858892416:12345-192.168.201.28@tcp:3:lfs.0 Request processed in 91339us (94449us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143143.375009:0:31432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6338 00000100:00100000:0.0:1746143143.387111:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.387304:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858893184 00000100:00100000:2.0:1746143143.387314:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858893184 00000100:00100000:2.0:1746143143.387363:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8290 00000100:00100000:2.0:1746143143.387371:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31253:x1830962858893184:12345-192.168.201.28@tcp:36:lfs.0 00010000:00010000:2.0:1746143143.387414:0:20619:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143143.387437:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b716c00/0x25aee876ca70e8cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x27a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fd4 expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.387465:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143143.387468:0:20619:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143143.387497:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.387636:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.387646:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000004:00010000:2.0:1746143143.388018:0:20619:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c1e8000 reply state ffff88008f396000 transno 8589942519 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20619 initiator: MDT0 00000100:00100000:2.0:1746143143.388025:0:20619:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143143.388688:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:31253:x1830962858893184:12345-192.168.201.28@tcp:36:lfs.0 Request processed in 1317us (1584us total) trans 8589942519 rc 0/0 00000100:00100000:2.0:1746143143.388695:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8290 00000100:00100000:0.0:1746143143.393153:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.393212:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858893312 00000100:00100000:3.0:1746143143.393220:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858893312 00000100:00100000:3.0:1746143143.393264:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12977 00000100:00100000:3.0:1746143143.393272:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:31253:x1830962858893312:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:3.0:1746143143.393289:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143143.393302:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800949e8a00/0x25aee876ca70e93c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1651005 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.393328:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 15 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143143.393335:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.393337:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.393340:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949e8a00/0x25aee876ca70e93c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651005 expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.393346:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.393353:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.393358:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.393363:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe82600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143143.393366:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.393371:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 15 pid: 21048 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.393372:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20619 initiator: MDT0 00010000:00010000:3.0:1746143143.393381:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 15 pid: 21048 timeout: 1025 lvb_type: 1 00010000:00010000:2.0:1746143143.393383:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143143.393385:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143143.393388:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00010000:00010000:2.0:1746143143.393392:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe82600/0x25aee876ca70e935 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20619 initiator: MDT0 00000100:00100000:3.0:1746143143.393393:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861345920:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143143.393468:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.396744:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861345920:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143143.396971:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800949e8a00/0x25aee876ca70e93c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651005 expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.396987:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949e8a00, rc 0) 00000100:00100000:3.0:1746143143.397058:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:31253:x1830962858893312:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 3785us (3911us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.397067:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12977 00000100:00100000:0.0:1746143143.399114:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.400461:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858893440 00000100:00100000:3.0:1746143143.400469:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858893440 00010000:00010000:3.0:1746143143.400498:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 15 pid: 21048 timeout: 1025 lvb_type: 1 00000100:00100000:3.0:1746143143.400522:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6884 00000100:00100000:3.0:1746143143.400528:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858893440:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143143.400539:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143143.400558:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 15 pid: 21048 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.400568:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 15 pid: 21048 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.400587:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4919400/0x25aee876ca70e8d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fdb expref: 15 pid: 21048 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.400616:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.400617:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.400623:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800949e8a00/0x25aee876ca70e93c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651005 expref: 14 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.400630:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949e8a00/0x25aee876ca70e93c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651005 expref: 14 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.400659:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800949e8a00/0x25aee876ca70e93c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651005 expref: 14 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.400671:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861346048:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143143.403220:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.407796:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861346048:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143143.407817:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143143.408205:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.409116:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858893568 00000100:00100000:2.0:1746143143.409123:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858893568 00000100:00100000:2.0:1746143143.409255:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12978 00000100:00100000:2.0:1746143143.409262:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31253:x1830962858893568:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.409277:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.409290:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe82200/0x25aee876ca70e943 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165100c expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.409496:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.409504:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.409506:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.409509:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe82200/0x25aee876ca70e943 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165100c expref: 22 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.409535:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.409545:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:2.0:1746143143.409556:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861346176:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143143.409880:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858893440:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 9350us (10767us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.409889:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6884 00000100:00100000:2.0:1746143143.410072:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143143.413413:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861346176:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143143.413442:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe82200/0x25aee876ca70e943 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165100c expref: 22 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.413462:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82200, rc 0) 00000100:00100000:2.0:1746143143.413522:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31253:x1830962858893568:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4260us (5318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.413530:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12978 00000100:00100000:1.0:1746143143.413921:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.414066:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858893696 00000100:00100000:3.0:1746143143.414072:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858893696 00010000:00010000:3.0:1746143143.414099:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:3.0:1746143143.414131:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6885 00000100:00100000:3.0:1746143143.414138:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1968:x1830962858893696:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143143.414150:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143143.414168:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.414180:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.414199:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d90400/0x25aee876ca70e8da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe2 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.416261:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.416266:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.416278:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe82200/0x25aee876ca70e943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165100c expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.416288:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe82200/0x25aee876ca70e943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165100c expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.416327:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe82200/0x25aee876ca70e943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165100c expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.416340:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861346304:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143143.416431:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.421700:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861346304:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143143.421719:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143143.421755:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1968:x1830962858893696:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 7617us (7834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.421765:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6885 00000100:00100000:0.0:1746143143.422401:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.422713:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858893824 00000100:00100000:2.0:1746143143.422720:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858893824 00000100:00100000:2.0:1746143143.422756:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12979 00000100:00100000:2.0:1746143143.422762:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31253:x1830962858893824:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.422778:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.422792:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70e94a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1651013 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.422816:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.422822:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.422824:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.422826:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70e94a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651013 expref: 22 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.422850:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.422860:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:2.0:1746143143.422876:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861346432:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143143.425665:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143143.426911:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861346432:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143143.426936:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70e94a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651013 expref: 22 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.426952:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82a00, rc 0) 00000100:00100000:2.0:1746143143.426998:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31253:x1830962858893824:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 4235us (4597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.427006:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12979 00000100:00100000:0.0:1746143143.427745:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.428157:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858893952 00000100:00100000:3.0:1746143143.428164:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858893952 00010000:00010000:3.0:1746143143.428189:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:3.0:1746143143.429377:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6886 00000100:00100000:3.0:1746143143.429387:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858893952:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143143.429400:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143143.429419:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.429433:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.429453:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d90a00/0x25aee876ca70e8ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fe9 expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.429464:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.429466:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.429471:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70e94a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651013 expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.429478:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70e94a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651013 expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.429504:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe82a00/0x25aee876ca70e94a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651013 expref: 21 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.429517:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861346560:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143143.429602:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143143.432800:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.432927:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861346560:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143143.432946:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143143.433319:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858894080 00000100:00100000:2.0:1746143143.433325:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858894080 00000100:00100000:2.0:1746143143.433364:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12980 00000100:00100000:2.0:1746143143.433370:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:31253:x1830962858894080:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.433559:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.433572:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe83a00/0x25aee876ca70e951 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165101a expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.433595:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.433603:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.433604:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.433607:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe83a00/0x25aee876ca70e951 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165101a expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.433636:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.433647:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 15 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:2.0:1746143143.433659:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861346688:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143143.434045:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:1969:x1830962858893952:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4658us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.434064:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6886 00000100:00100000:2.0:1746143143.435250:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143143.439603:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.439707:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861346688:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143143.439735:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe83a00/0x25aee876ca70e951 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165101a expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.439749:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe83a00, rc 0) 00000100:00100000:3.0:1746143143.440446:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858894208 00000100:00100000:3.0:1746143143.440452:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858894208 00010000:00010000:3.0:1746143143.440654:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 16 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:3.0:1746143143.443270:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6887 00000100:00100000:3.0:1746143143.443287:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858894208:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143143.443305:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143143.443328:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 16 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.443344:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 16 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.443365:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4871a00/0x25aee876ca70e8e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff0 expref: 16 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.443404:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.443406:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.443412:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe83a00/0x25aee876ca70e951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165101a expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.443420:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe83a00/0x25aee876ca70e951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165101a expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.443454:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe83a00/0x25aee876ca70e951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165101a expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.443467:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861346816:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143143.443552:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.443587:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:31253:x1830962858894080:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 10215us (10792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.443594:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12980 00000100:00100000:0.0:1746143143.447261:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.447789:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861346816:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143143.447813:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143143.447857:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858894208:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4576us (8258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.447869:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6887 00000100:00100000:2.0:1746143143.447984:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858894336 00000100:00100000:2.0:1746143143.447995:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858894336 00000100:00100000:2.0:1746143143.448079:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12981 00000100:00100000:2.0:1746143143.448087:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:31253:x1830962858894336:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.448115:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.448132:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe82c00/0x25aee876ca70e958 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1651021 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.448157:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 15 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.448169:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.448170:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.448173:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe82c00/0x25aee876ca70e958 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651021 expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.448201:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 15 pid: 26949 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.448213:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 15 pid: 26949 timeout: 1025 lvb_type: 1 00000100:00100000:2.0:1746143143.448225:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861346944:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143143.448315:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143143.450716:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:20836:1830962861346944:192.168.201.28@tcp:104: 00010000:00010000:2.0:1746143143.450739:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe82c00/0x25aee876ca70e958 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651021 expref: 15 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.450753:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe82c00, rc 0) 00000100:00100000:2.0:1746143143.450807:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:31253:x1830962858894336:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 2720us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.450814:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12981 00000100:00100000:0.0:1746143143.450857:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.450936:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858894464 00000100:00100000:3.0:1746143143.450978:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858894464 00010000:00010000:3.0:1746143143.451007:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 15 pid: 26949 timeout: 1025 lvb_type: 1 00000100:00100000:3.0:1746143143.451077:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6888 00000100:00100000:3.0:1746143143.451085:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858894464:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143143.451097:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143143.452498:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 15 pid: 26949 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.452515:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 15 pid: 26949 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.452539:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4919200/0x25aee876ca70e8f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ff7 expref: 15 pid: 26949 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.452568:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.452570:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.452576:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe82c00/0x25aee876ca70e958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651021 expref: 14 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.452583:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe82c00/0x25aee876ca70e958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651021 expref: 14 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.452621:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe82c00/0x25aee876ca70e958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651021 expref: 14 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.452634:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861347072:192.168.201.28@tcp:105: 00000100:00100000:3.0:1746143143.453343:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.454519:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9869:1830962861347072:192.168.201.28@tcp:105: 00010000:00010000:3.0:1746143143.454539:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143143.454593:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858894464:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 3503us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.454602:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6888 00000100:00100000:0.0:1746143143.459222:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.459308:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858894592 00000100:00100000:2.0:1746143143.459319:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858894592 00000100:00100000:2.0:1746143143.459381:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12982 00000100:00100000:2.0:1746143143.459389:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+21:31253:x1830962858894592:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.459411:0:20836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.459426:0:20836:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e96000/0x25aee876ca70e95f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c1651028 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.459451:0:20836:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.459457:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.459459:0:20836:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143143.459463:0:20836:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e96000/0x25aee876ca70e95f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651028 expref: 22 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.459491:0:20836:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143143.459501:0:20836:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 22 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:2.0:1746143143.459513:0:20836:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861347200:192.168.201.28@tcp:104: 00000100:00100000:2.0:1746143143.459602:0:20836:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5e0c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143143.468169:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.468272:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858894720 00000100:00100000:3.0:1746143143.468281:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858894720 00010000:00010000:3.0:1746143143.468314:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 23 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:3.0:1746143143.468341:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6889 00000100:00100000:3.0:1746143143.468349:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858894720:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143143.468361:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143143.468380:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 23 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.468392:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 23 pid: 8450 timeout: 1025 lvb_type: 1 00010000:00010000:3.0:1746143143.468414:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.468416:0:9869:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143143.468422:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e96000/0x25aee876ca70e95f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651028 expref: 23 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.468430:0:9869:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e96000/0x25aee876ca70e95f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651028 expref: 23 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.468470:0:9869:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130e96000/0x25aee876ca70e95f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651028 expref: 23 pid: 20836 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143143.468483:0:9869:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861347328:192.168.201.28@tcp:105: 00010000:00010000:2.0:1746143143.468518:0:20836:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d91800/0x25aee876ca70e8e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650ffe expref: 23 pid: 8450 timeout: 1025 lvb_type: 1 00000100:00100000:2.0:1746143143.468545:0:20836:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:20836:1830962861347200:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143143.468558:0:9869:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143143.468564:0:20836:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e96000/0x25aee876ca70e95f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1651028 expref: 22 pid: 20836 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.468580:0:20836:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e96000, rc 0) 00000100:00100000:2.0:1746143143.468605:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:31253:x1830962858894592:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 9217us (9393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.468613:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12982 00000100:00100000:0.0:1746143143.471686:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.472021:0:9869:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9869:1830962861347328:192.168.201.28@tcp:105: 00000100:00100000:0.0:1746143143.472367:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.472448:0:20836:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858894848 00000100:00100000:2.0:1746143143.472454:0:20836:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858894848 00000100:00100000:1.0:1746143143.472472:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858894976 00000100:00100000:1.0:1746143143.472482:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858894976 00000100:00100000:2.0:1746143143.472492:0:20836:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12983 00000100:00100000:2.0:1746143143.472499:0:20836:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+14:1969:x1830962858894848:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:2.0:1746143143.472656:0:20836:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143143.472659:0:20836:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143136 -> 1746143140 00002000:00010000:2.0:1746143143.472661:0:20836:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143136 -> 1746143140 00002000:00010000:2.0:1746143143.472663:0:20836:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143136 -> 1746143142 00002000:00010000:2.0:1746143143.472664:0:20836:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1999 -> 1999 00000100:00100000:2.0:1746143143.472695:0:20836:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0dc46dfc-5e40-47a2-aeed-123c1c0de782+15:1969:x1830962858894848:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 196us (1013us total) trans 21474840147 rc 0/0 00000100:00100000:1.0:1746143143.472773:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12984 00000100:00100000:1.0:1746143143.472783:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858894976:12345-192.168.201.28@tcp:2:lfs.0 00010000:00010000:3.0:1746143143.473000:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143143.473029:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858894720:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 4680us (4868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.473062:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6889 00002000:00010000:1.0:1746143143.473298:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143143.473301:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143137 -> 1746143140 00002000:00010000:1.0:1746143143.473303:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143137 -> 1746143140 00002000:00010000:1.0:1746143143.473305:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143137 -> 1746143142 00002000:00010000:1.0:1746143143.473308:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143143.473322:0:20836:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12983 00000100:00100000:1.0:1746143143.473348:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+22:1969:x1830962858894976:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 567us (981us total) trans 17179872880 rc 0/0 00000100:00100000:1.0:1746143143.473355:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12984 00000100:00100000:0.0:1746143143.474653:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.474683:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.474708:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:0.0:1746143143.474743:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:1.0:1746143143.474798:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858895232 00000100:00100000:1.0:1746143143.474804:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858895232 00000100:00100000:1.0:1746143143.474832:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858895488 00000100:00100000:1.0:1746143143.474835:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858895488 00000100:00100000:1.0:1746143143.474845:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858895104 00000100:00100000:1.0:1746143143.474846:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858895104 00000100:00100000:1.0:1746143143.474855:0:8449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858895360 00000100:00100000:1.0:1746143143.474857:0:8449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858895360 00000100:00100000:1.0:1746143143.474868:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12985 00000100:00100000:1.0:1746143143.474873:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858895232:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:1.0:1746143143.474998:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143143.475001:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00002000:00010000:1.0:1746143143.475004:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143139 -> 1746143140 00002000:00010000:1.0:1746143143.475005:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143140 -> 1746143142 00002000:00010000:1.0:1746143143.475007:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143143.475067:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858895232:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 192us (416us total) trans 21474840148 rc 0/0 00000100:00100000:1.0:1746143143.475074:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12985 00000100:00100000:1.0:1746143143.475090:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12986 00000100:00100000:1.0:1746143143.475095:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858895488:12345-192.168.201.28@tcp:2:lfs.0 00000100:00100000:3.0:1746143143.475111:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12987 00000100:00100000:3.0:1746143143.475118:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+23:1969:x1830962858895104:12345-192.168.201.28@tcp:2:lfs.0 00002000:00010000:1.0:1746143143.475176:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143143.475179:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00002000:00010000:1.0:1746143143.475181:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143140 -> 1746143140 00002000:00010000:1.0:1746143143.475182:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143139 -> 1746143142 00002000:00010000:1.0:1746143143.475184:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:3.0:1746143143.475197:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143143.475200:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143137 -> 1746143140 00002000:00010000:3.0:1746143143.475201:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143137 -> 1746143140 00000100:00100000:1.0:1746143143.475201:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+25:1969:x1830962858895488:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 106us (517us total) trans 17179872881 rc 0/0 00002000:00010000:3.0:1746143143.475203:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143137 -> 1746143142 00002000:00010000:3.0:1746143143.475205:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143143.475206:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12986 00000100:00100000:1.0:1746143143.475216:0:8449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 12988 00000100:00100000:3.0:1746143143.475219:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dc46dfc-5e40-47a2-aeed-123c1c0de782+24:1969:x1830962858895104:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 102us (511us total) trans 17179872882 rc 0/0 00000100:00100000:1.0:1746143143.475220:0:8449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+16:1969:x1830962858895360:12345-192.168.201.28@tcp:2:lfs.0 00000100:00100000:3.0:1746143143.475224:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12987 00002000:00010000:1.0:1746143143.476658:0:8449:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:1.0:1746143143.476662:0:8449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00002000:00010000:1.0:1746143143.476664:0:8449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143139 -> 1746143140 00002000:00010000:1.0:1746143143.476665:0:8449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143140 -> 1746143142 00002000:00010000:1.0:1746143143.476667:0:8449:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:1.0:1746143143.476693:0:8449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dc46dfc-5e40-47a2-aeed-123c1c0de782+17:1969:x1830962858895360:12345-192.168.201.28@tcp:2:lfs.0 Request processed in 1471us (1948us total) trans 21474840149 rc 0/0 00000100:00100000:1.0:1746143143.476700:0:8449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 12988 00000100:00100000:0.0:1746143143.480005:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.481799:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858895744 00000100:00100000:3.0:1746143143.481809:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858895744 00000100:00100000:3.0:1746143143.481861:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3521 00000100:00100000:3.0:1746143143.481869:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:31253:x1830962858895744:12345-192.168.201.28@tcp:35:lfs.0 00000004:00010000:3.0:1746143143.481924:0:16983:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x27a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74400/0x25aee876ca70e87f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fc6 expref: 200 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.481963:0:16983:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16983 initiator: MDT0 00010000:00010000:3.0:1746143143.481976:0:16983:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.481983:0:16983:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16983 initiator: MDT0 00010000:00010000:3.0:1746143143.482026:0:16983:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 200 pid: 14796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143143.482614:0:16983:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 200 pid: 14796 timeout: 1025 lvb_type: 0 00000100:00100000:3.0:1746143143.482629:0:16983:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:16983:1830962861347456:192.168.201.28@tcp:104: 00000100:00100000:3.0:1746143143.482721:0:16983:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143143.487118:0:16983:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:16983:1830962861347456:192.168.201.28@tcp:104: 00010000:00010000:3.0:1746143143.487143:0:16983:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16983 initiator: MDT0 00000100:00100000:0.0:1746143143.487184:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:3.0:1746143143.487478:0:9869:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858895872 00000100:00100000:3.0:1746143143.487484:0:9869:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858895872 00010000:00010000:3.0:1746143143.487517:0:9869:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 201 pid: 14796 timeout: 1025 lvb_type: 0 00000100:00100000:3.0:1746143143.490279:0:9869:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 6890 00000100:00100000:3.0:1746143143.490297:0:9869:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+201:1969:x1830962858895872:12345-192.168.201.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143143.490314:0:9869:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143143.490323:0:9869:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 201 pid: 14796 timeout: 1025 lvb_type: 0 00010000:00010000:3.0:1746143143.490337:0:9869:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 201 pid: 14796 timeout: 1025 lvb_type: 0 00010000:00010000:3.0:1746143143.490357:0:9869:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d91000/0x25aee876ca70e8be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fcd expref: 201 pid: 14796 timeout: 1025 lvb_type: 0 00010000:00010000:3.0:1746143143.491084:0:9869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:3.0:1746143143.491090:0:9869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16983 initiator: MDT0 00010000:00010000:3.0:1746143143.491100:0:9869:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16983 initiator: MDT0 00010000:00010000:3.0:1746143143.491106:0:9869:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16983 initiator: MDT0 00010000:00010000:3.0:1746143143.491348:0:9869:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143143.491601:0:9869:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+200:1969:x1830962858895872:12345-192.168.201.28@tcp:103:ldlm_bl.0 Request processed in 1310us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143143.491609:0:9869:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 6890 00010000:00010000:2.0:1746143143.491673:0:16983:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16983 initiator: MDT0 00010000:00010000:2.0:1746143143.491681:0:16983:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16983 initiator: MDT0 00000040:00080000:2.0:1746143143.493784:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2469, 88 off209992 00000004:00080000:2.0:1746143143.493791:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333759513ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493844:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2477, 88 off210432 00000004:00080000:2.0:1746143143.493848:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925333816295ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143143.493870:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2478, 88 off210520 00000004:00080000:2.0:1746143143.493874:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925333842185ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143143.493881:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2470, 88 off210080 00000004:00080000:2.0:1746143143.493883:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333852070ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493889:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2471, 88 off210168 00000004:00080000:2.0:1746143143.493891:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333860043ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493897:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2479, 88 off210608 00000004:00080000:2.0:1746143143.493899:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925333867750ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143143.493904:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2480, 88 off210696 00000004:00080000:2.0:1746143143.493907:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925333875303ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143143.493913:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2481, 88 off210784 00000004:00080000:2.0:1746143143.493915:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925333883753ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143143.493921:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2472, 88 off210256 00000004:00080000:2.0:1746143143.493923:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333891453ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493929:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2482, 88 off210872 00000004:00080000:2.0:1746143143.493932:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925333900121ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143143.493938:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2473, 88 off210344 00000004:00080000:2.0:1746143143.493940:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333908275ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493946:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2483, 88 off210960 00000004:00080000:2.0:1746143143.493948:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925333916813ns, next at 860119223596ns, rc = 0 00000040:00080000:2.0:1746143143.493954:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2474, 88 off210432 00000004:00080000:2.0:1746143143.493956:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333924801ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493962:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2475, 88 off210520 00000004:00080000:2.0:1746143143.493964:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333933053ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493971:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2476, 88 off210608 00000004:00080000:2.0:1746143143.493973:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333941363ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493979:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2477, 88 off210696 00000004:00080000:2.0:1746143143.493982:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 925333950786ns, next at 860071159912ns, rc = 0 00000040:00080000:2.0:1746143143.493989:0:16983:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2484, 88 off211048 00000004:00080000:2.0:1746143143.493991:0:16983:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925333959604ns, next at 860119223596ns, rc = 0 00000001:00080000:1.0:1746143143.516191:0:14860:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942520 is committed 00000004:00080000:1.0:1746143143.516202:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1901 committed 00000004:00080000:1.0:1746143143.516212:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1899 committed 00000004:00080000:1.0:1746143143.516216:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1898 committed 00000004:00080000:1.0:1746143143.516218:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1897 committed 00000004:00080000:1.0:1746143143.516219:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1896 committed 00000004:00080000:1.0:1746143143.516220:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1900 committed 00000004:00080000:1.0:1746143143.516222:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1895 committed 00000004:00080000:1.0:1746143143.516223:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1899 committed 00000004:00080000:1.0:1746143143.516225:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1894 committed 00000004:00080000:1.0:1746143143.516226:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1898 committed 00000004:00080000:1.0:1746143143.516227:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1897 committed 00000004:00080000:1.0:1746143143.516229:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1896 committed 00000004:00080000:1.0:1746143143.516230:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1893 committed 00000004:00080000:1.0:1746143143.516231:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1892 committed 00000004:00080000:1.0:1746143143.516232:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1895 committed 00000004:00080000:1.0:1746143143.516234:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1894 committed 00000004:00080000:1.0:1746143143.516235:0:14860:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1891 committed 00000004:00010000:2.0:1746143143.516249:0:16983:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5e39f80 reply state ffff88012ff07000 transno 8589942520 ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16983 initiator: MDT0 00000100:00100000:2.0:1746143143.516261:0:16983:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746143143.516270:0:16983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143143.516273:0:16983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143143.516282:0:16983:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb74400/0x25aee876ca70e87f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x27a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c1650fc6 expref: 198 pid: 20619 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1746143143.516375:0:16983:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143143.516388:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:31253:x1830962858895744:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 34519us (36388us total) trans 8589942520 rc 0/0 00000100:00100000:2.0:1746143143.516397:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3521 00010000:00010000:2.0:1746143143.516605:0:3285:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16983 initiator: MDT0 00010000:00010000:2.0:1746143143.516612:0:3285:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16983 initiator: MDT0 00010000:00010000:2.0:1746143143.516617:0:3285:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16983 initiator: MDT0 00010000:00010000:2.0:1746143143.516622:0:3285:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800949e9600 already unused, calling callback (ffffffffa1347690) 00010000:00010000:2.0:1746143143.516625:0:3285:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16983 initiator: MDT0 00010000:00010000:2.0:1746143143.516630:0:3285:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16983 initiator: MDT0 00010000:00010000:2.0:1746143143.516644:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800953bd000) 00010000:00010000:2.0:1746143143.516646:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143143.516649:0:3285:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16983 initiator: MDT0 00010000:00010000:2.0:1746143143.516654:0:3285:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949e9600/0x25aee876ca70e966 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16983 initiator: MDT0 00000100:00100000:1.0:1746143143.516707:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861347712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.516748:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.516750:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861347584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.516770:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.516770:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861348224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.516782:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861348096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.516783:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.516794:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.516797:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861348736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.516803:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861348608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.516811:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.516817:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861347968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.517014:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861349248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.517024:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.517060:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861347712 00000100:00100000:3.0:1746143143.517063:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861348480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.517067:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861347712 00000100:00100000:3.0:1746143143.517077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.517086:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861348992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.517092:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861347584 00000100:00100000:1.0:1746143143.517094:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861347584 00000100:00100000:3.0:1746143143.517098:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.517202:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861349504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.517219:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.517343:0:8169:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861348224 00000100:00100000:1.0:1746143143.517346:0:8169:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861348224 00000100:00100000:3.0:1746143143.517513:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861347840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.517533:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143143.517576:0:10061:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861348096 00000100:00100000:0.0:1746143143.517580:0:10061:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861348096 00000100:00100000:2.0:1746143143.517614:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861348736 00000100:00100000:2.0:1746143143.517618:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861348736 00000100:00100000:2.0:1746143143.517632:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861347968 00000100:00100000:2.0:1746143143.517633:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861347968 00000100:00100000:2.0:1746143143.517640:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861348480 00000100:00100000:2.0:1746143143.517641:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861348480 00000100:00100000:2.0:1746143143.517646:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861348992 00000100:00100000:2.0:1746143143.517647:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861348992 00000100:00100000:2.0:1746143143.517652:0:8448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861349504 00000100:00100000:2.0:1746143143.517653:0:8448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861349504 00000100:00100000:2.0:1746143143.517660:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12989 00000100:00100000:2.0:1746143143.517665:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861347712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143143.518132:0:8448:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143143.518136:0:8448:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00002000:00010000:2.0:1746143143.518137:0:8448:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb atime from disk: 1746143140 -> 1746143140 00002000:00010000:2.0:1746143143.518139:0:8448:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb ctime from disk: 1746143142 -> 1746143142 00002000:00010000:2.0:1746143143.518141:0:8448:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fe:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143143.518425:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861348352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.518443:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.518450:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861348864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.518463:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.518468:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861349376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.518480:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143143.518498:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861347840 00000100:00100000:3.0:1746143143.518501:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861347840 00000100:00100000:3.0:1746143143.518513:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861348352 00000100:00100000:3.0:1746143143.518515:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861348352 00000100:00100000:3.0:1746143143.518521:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861348864 00000100:00100000:3.0:1746143143.518523:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861348864 00000100:00100000:3.0:1746143143.518528:0:26949:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861349376 00000100:00100000:3.0:1746143143.518529:0:26949:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861349376 00000100:00100000:3.0:1746143143.518537:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12990 00000100:00100000:3.0:1746143143.518542:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861347584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143143.518629:0:26949:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143143.518631:0:26949:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00002000:00010000:3.0:1746143143.518633:0:26949:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb atime from disk: 1746143140 -> 1746143140 00002000:00010000:3.0:1746143143.518635:0:26949:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb ctime from disk: 1746143142 -> 1746143142 00002000:00010000:3.0:1746143143.518637:0:26949:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2fc:0x0] updating lvb blocks from disk: 1999 -> 1999 00000100:00100000:3.0:1746143143.518656:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3300:x1830962861347584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (1885us total) trans 21474840151 rc 0/0 00000100:00100000:3.0:1746143143.518663:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12990 00000100:00100000:3.0:1746143143.518675:0:26949:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12991 00000100:00100000:3.0:1746143143.518679:0:26949:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861348224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.518758:0:26949:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3301:x1830962861348224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1973us total) trans 21474840152 rc 0/0 00000100:00100000:3.0:1746143143.518763:0:26949:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12991 00000100:00100000:2.0:1746143143.518939:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3301:x1830962861347712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1272us (2189us total) trans 21474840150 rc 0/0 00000100:00100000:2.0:1746143143.518944:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12989 00000100:00100000:2.0:1746143143.518955:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12992 00000100:00100000:2.0:1746143143.518960:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3301:x1830962861348736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143143.519005:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12993 00000100:00100000:0.0:1746143143.519011:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3299:x1830962861347968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143143.519081:0:8448:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143143.519083:0:8448:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00002000:00010000:2.0:1746143143.519085:0:8448:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb atime from disk: 1746143140 -> 1746143140 00002000:00010000:2.0:1746143143.519087:0:8448:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb ctime from disk: 1746143142 -> 1746143142 00002000:00010000:2.0:1746143143.519089:0:8448:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x304:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143143.519109:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3301:x1830962861348736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (2297us total) trans 17179872883 rc 0/0 00000100:00100000:2.0:1746143143.519114:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12992 00000100:00100000:2.0:1746143143.519124:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12994 00000100:00100000:0.0:1746143143.519124:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861347968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (2099us total) trans 21474840153 rc 0/0 00000100:00100000:2.0:1746143143.519129:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861348480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143143.519129:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12993 00000100:00100000:0.0:1746143143.519136:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12995 00000100:00100000:0.0:1746143143.519140:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3299:x1830962861348992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143143.519203:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3299:x1830962861348480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (2125us total) trans 21474840154 rc 0/0 00000100:00100000:0.0:1746143143.519204:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3299:x1830962861348992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (2105us total) trans 17179872884 rc 0/0 00000100:00100000:2.0:1746143143.519208:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12994 00000100:00100000:0.0:1746143143.519210:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12995 00000100:00100000:0.0:1746143143.519217:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12996 00000100:00100000:2.0:1746143143.519219:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12997 00000100:00100000:0.0:1746143143.519221:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3299:x1830962861349504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143143.519223:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3302:x1830962861347840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143143.519280:0:8448:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb size from disk: 5207040 -> 5207040 00002000:00010000:2.0:1746143143.519282:0:8448:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00002000:00010000:2.0:1746143143.519284:0:8448:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb atime from disk: 1746143140 -> 1746143140 00002000:00010000:2.0:1746143143.519286:0:8448:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb ctime from disk: 1746143142 -> 1746143142 00002000:00010000:2.0:1746143143.519288:0:8448:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x2ff:0x0] updating lvb blocks from disk: 6155 -> 6155 00000100:00100000:0.0:1746143143.519289:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3299:x1830962861349504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (2069us total) trans 17179872885 rc 0/0 00000100:00100000:0.0:1746143143.519295:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12996 00000100:00100000:0.0:1746143143.519304:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12998 00000100:00100000:2.0:1746143143.519305:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861347840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (1772us total) trans 21474840155 rc 0/0 00000100:00100000:0.0:1746143143.519308:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861348352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143143.519310:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12997 00000100:00100000:2.0:1746143143.519318:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12999 00000100:00100000:2.0:1746143143.519322:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3302:x1830962861348864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143143.519377:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3302:x1830962861348352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (932us total) trans 21474840156 rc 0/0 00002000:00010000:2.0:1746143143.519378:0:8448:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143143.519380:0:8448:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00002000:00010000:2.0:1746143143.519382:0:8448:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb atime from disk: 1746143140 -> 1746143140 00000100:00100000:0.0:1746143143.519383:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12998 00002000:00010000:2.0:1746143143.519384:0:8448:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb ctime from disk: 1746143142 -> 1746143142 00002000:00010000:2.0:1746143143.519385:0:8448:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x305:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746143143.519392:0:10061:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13000 00000100:00100000:0.0:1746143143.519396:0:10061:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3302:x1830962861349376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143143.519400:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3302:x1830962861348864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (936us total) trans 17179872886 rc 0/0 00000100:00100000:2.0:1746143143.519404:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12999 00000100:00100000:2.0:1746143143.519412:0:8448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13001 00000100:00100000:2.0:1746143143.519416:0:8448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861348096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143143.519464:0:10061:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3302:x1830962861349376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (983us total) trans 17179872887 rc 0/0 00000100:00100000:0.0:1746143143.519469:0:10061:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13000 00000100:00100000:2.0:1746143143.519475:0:8448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861348096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (2680us total) trans 21474840157 rc 0/0 00000100:00100000:2.0:1746143143.519479:0:8448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13001 00000004:00080000:2.0:1746143143.519508:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e39500/2, rc 0, transno 21474840155 00000100:00100000:2.0:1746143143.519517:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861347840:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143143.519524:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e38a80/2, rc 0, transno 21474840156 00000100:00100000:2.0:1746143143.519527:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861348352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143143.519529:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000004:00080000:2.0:1746143143.519533:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc9180/2, rc 0, transno 17179872886 00000100:00100000:2.0:1746143143.519536:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861348864:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143143.519542:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ccad80/2, rc 0, transno 17179872887 00000100:00100000:2.0:1746143143.519544:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1830962861349376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143143.519555:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858896000 00000100:00100000:2.0:1746143143.519558:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858896000 00000100:00100000:2.0:1746143143.519578:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 8291 00000100:00100000:2.0:1746143143.519582:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+197:31253:x1830962858896000:12345-192.168.201.28@tcp:101:lfs.0 00010000:00010000:2.0:1746143143.519594:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143143.519606:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e96d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfacdfbc3c165102f expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.519645:0:20619:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e96d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165102f expref: 198 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.519655:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e96a00/0x25aee876ca70e96d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x27a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.28@tcp remote: 0xfacdfbc3c165102f expref: 198 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143143.519669:0:20619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x27a:0x0].0x0 (ffff8800931f2100) 00010000:00010000:2.0:1746143143.519671:0:20619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143143.519674:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e96a00, rc 0) 00000100:00100000:1.0:1746143143.519692:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143143.519698:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:31253:x1830962858896000:12345-192.168.201.28@tcp:101:lfs.0 Request processed in 116us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143143.519703:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 8291 00000004:00080000:1.0:1746143143.519714:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e3bb80/2, rc 0, transno 21474840150 00000100:00100000:1.0:1746143143.519717:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861347712:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143143.519723:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e3b800/2, rc 0, transno 21474840152 00000100:00100000:1.0:1746143143.519725:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861348224:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143143.519734:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc9c00/2, rc 0, transno 17179872883 00000100:00100000:1.0:1746143143.519736:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861348736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.519747:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861349248 00000100:00100000:1.0:1746143143.519750:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861349248 00000100:00100000:1.0:1746143143.519766:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13002 00000100:00100000:1.0:1746143143.519770:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3301:x1830962861349248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.519848:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.519875:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3301:x1830962861349248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (183us total) trans 17179872888 rc 0/0 00000100:00100000:3.0:1746143143.519880:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861349120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.519880:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13002 00000100:00100000:1.0:1746143143.519889:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861348608 00000100:00100000:1.0:1746143143.519891:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861348608 00000100:00100000:3.0:1746143143.519898:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143143.519902:0:22204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861349120 00000100:00100000:1.0:1746143143.519903:0:22204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861349120 00000100:00100000:3.0:1746143143.519910:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861349632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143143.519913:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13003 00000100:00100000:1.0:1746143143.519917:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3300:x1830962861348608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.519924:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143143.519939:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e3a680/2, rc 0, transno 21474840151 00000100:00100000:3.0:1746143143.519943:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861347584:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143143.519952:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e3b480/2, rc 0, transno 21474840157 00000100:00100000:3.0:1746143143.519955:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861348096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.519967:0:754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962861349632 00000100:00100000:3.0:1746143143.519969:0:754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962861349632 00000100:00100000:3.0:1746143143.519985:0:754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13004 00002000:00010000:1.0:1746143143.519985:0:22204:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143143.519988:0:22204:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb mtime from disk: 1746143140 -> 1746143140 00000100:00100000:3.0:1746143143.519989:0:754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861349120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143143.519990:0:22204:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb atime from disk: 1746143140 -> 1746143140 00002000:00010000:1.0:1746143143.519993:0:22204:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb ctime from disk: 1746143142 -> 1746143142 00002000:00010000:1.0:1746143143.519994:0:22204:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x303:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143143.520016:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861348608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (167us total) trans 17179872889 rc 0/0 00000100:00100000:1.0:1746143143.520021:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13003 00000100:00100000:1.0:1746143143.520030:0:22204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13005 00000100:00100000:1.0:1746143143.520035:0:22204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3300:x1830962861349632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143143.520097:0:754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3300:x1830962861349120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (197us total) trans 17179872890 rc 0/0 00000100:00100000:3.0:1746143143.520102:0:754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13004 00000004:00080000:3.0:1746143143.520124:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cca680/2, rc 0, transno 17179872889 00000100:00100000:3.0:1746143143.520128:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861348608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143143.520133:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc8700/2, rc 0, transno 17179872890 00000100:00100000:3.0:1746143143.520136:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861349120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143143.520139:0:22204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3300:x1830962861349632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (213us total) trans 21474840158 rc 0/0 00000004:00080000:3.0:1746143143.520142:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009310c000/2, rc 0, transno 21474840158 00000100:00100000:1.0:1746143143.520144:0:22204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13005 00000100:00100000:3.0:1746143143.520145:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009310c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1830962861349632:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143143.520157:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e38380/2, rc 0, transno 21474840153 00000100:00100000:3.0:1746143143.520160:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861347968:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143143.520164:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ccb100/2, rc 0, transno 17179872888 00000004:00080000:3.0:1746143143.520166:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e38e00/2, rc 0, transno 21474840154 00000100:00100000:1.0:1746143143.520167:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1830962861349248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143143.520169:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861348480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143143.520175:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc8e00/2, rc 0, transno 17179872884 00000100:00100000:3.0:1746143143.520177:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861348992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143143.520183:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5cc9f80/2, rc 0, transno 17179872885 00000100:00100000:3.0:1746143143.520185:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1830962861349504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143143.523242:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.201.28@tcp (source: 12345-192.168.201.28@tcp) 00000100:00100000:2.0:1746143143.523404:0:16983:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962858896256 00000100:00100000:2.0:1746143143.523625:0:16983:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962858896256 00000100:00100000:2.0:1746143143.523675:0:16983:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.28@tcp, seq: 3522 00000100:00100000:2.0:1746143143.523683:0:16983:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f1c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+198:31253:x1830962858896256:12345-192.168.201.28@tcp:35:lfs.0 00000100:00100000:2.0:1746143143.524173:0:16983:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f1c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:0dc46dfc-5e40-47a2-aeed-123c1c0de782+199:31253:x1830962858896256:12345-192.168.201.28@tcp:35:lfs.0 Request processed in 490us (935us total) trans 8589942521 rc 0/0 00000100:00100000:2.0:1746143143.524180:0:16983:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.28@tcp, seq: 3522 00010000:00010000:0.0:1746143143.554153:0:7115:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746143144.465425:0:2643:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:1.0:1746143144.560080:0:9870:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69350 lines, 69350 kept, 0 dropped, 0 bad.